No. 003 · Wing of the Global Push

Channel File 291

· hours to fix, days to weeks to clean up

Impact 7.6/10

  1. 1Security vendor ships a routine content update to its Windows sensor
  2. 2Update defines more input fields than the sensor code expects
  3. 3Kernel driver reads out of bounds and crashes
  4. 4About 8.5 million Windows machines boot-loop on a blue screen
  5. 5Airlines, hospitals and banks fix machines one by one, by hand ✕

Content updates are code updates. Stage them like code.

Source: CrowdStrike root cause analysis, August 2024

Impact

Five dimensions, 0 to 10 each. The overall 7.6/10 is their average. How impact is scored

Reach10Duration10Loss0Recovery8Cascade10
DimensionScoreBasis
Reach10About 8.5 million machines, in airlines, hospitals and banks
Duration10Days to weeks to clean up
Loss0None stated in the source
Recovery8Machines were fixed one by one, by hand
Cascade10Flights, hospitals and banks were disrupted

CrowdStrike outage, July 2024. Duration: hours to fix, days to weeks to clean up. 5 hops from the first change to the failure.

See this exhibit in the 3D hall