24/7 incident line +1-555-0187[email protected]

Report WL-0397. Manufacturing. Contained in 47 minutes.
Public copy, names removed

A remote tool, a night shift and a line that kept running

§1 Report sheetWL-0397 / Sample report

Engineer and shift supervisor at a factory network point at night
Time to contain
47 min
First alert 23:12, contained 23:59

Report sheet

Sector

Manufacturing, two plants

Scope

620 accounts, 2 plants, 41 engineering PCs

Findings by severity

1 Critical  2 High  6 Low

Time to contain

47 minutes

Result

Line kept running, no lost shift

A support tool nobody on shift had installed.

Written for the client's board. Names, sites and hostnames are removed from this copy.

§2.1 What happened

At 23:12 a remote support tool started on an engineering PC at plant name removed, outside any change window. The account behind it did not belong to the plant's support vendor, vendor name removed, or to anyone on shift.

§2.2 What we did

The analyst traced the account, then called the shift lead before touching anything. Together they blocked the tool at the plant firewall and moved the PC to a quarantine network between two batches.

§2.3 What it means

The tool reached one file server and took nothing we could find. The line never stopped and no shift was lost. The way in was a support login shared by three contractors, and it no longer exists.

§3 TimelineWL-0397 / Sample report

Forty-seven minutes, line by line.

Copied from the incident log. Times are local to the plant.

Time

Event

By

Elapsed

23:12

Remote support tool starts on an engineering PC, no change window open

Sensor

0 min

23:14

Alert assigned to night analyst

Queue

2 min

23:21

Tool traced to an unknown account, not the plant's vendor

Analyst

9 min

23:27

Same account browses the file server that holds line recipes

Sensor

15 min

23:33

Shift lead called, containment steps agreed

Analyst

21 min

23:41

Approval given, tool blocked at the plant firewall

Client

29 min

23:52

Engineering PC moved to a quarantine network between batches

Client

40 min

23:59

Contained. Handover note sent.

Analyst

47 min

After containment

Day 1

Report delivered at 08:30, walked through with the plant manager at 11:00

Lead

9 hr

Day 4

Unapproved remote tools removed, one approved tool kept

Client IT

Closed

Day 8

Engineering PCs moved to their own network segment

Client IT

Closed

Day 15

Vendor access moved to named accounts with a time limit

Client IT

Closed

§4 FindingsWL-0397 / Sample report

Nine findings. Three shown in full.

Severity

Finding

Status

Critical

Unapproved remote tool on engineering PCs

Day 4

High

Support login shared by three contractors

Day 15

High

Engineering PCs on the office network

Day 8

Low

finding removed

Closed

Low

finding removed

Closed

Six Low findings are kept in the client's copy. Two shown as removed.
Two network engineers in a dark server aisle, one holding a laptop with a terminal open
Findings, sample client

Critical

1

High

2

Low

6

§5 Client noteWL-0397 / Sample report

I was braced to stop the line. They told my shift lead what they would touch and what they would leave alone, and we ran the whole night.

Plant manager, two-site manufacturer (fictional client)
What changed

One approved remote tool, with a named owner

Engineering PCs on their own network

Vendors sign in by name, for a set time

§6 More reportsEnd of WL-0397