No. 008 · The Enter Key Gallery

45 Minutes, $460 Million

· 45 minutes

Impact 4.4/10

  1. 1New trading code reuses a flag that once enabled retired logic
  2. 2Deployment misses one of eight servers
  3. 3Market opens; that server runs the dead code
  4. 4It fires millions of unintended orders
  5. 5The firm loses more than $460 million and is left with serious net capital problems ✕

Delete dead code. Verify every deploy target. Never recycle a flag.

Source: SEC order, October 2013

Impact

Five dimensions, 0 to 10 each. The overall 4.4/10 is their average. How impact is scored

Reach2Duration4Loss8Recovery4Cascade4
DimensionScoreBasis
Reach2One trading firm's systems
Duration445 minutes
Loss8More than $460 million, stated in the SEC order
Recovery4Staff intervened by hand while the market was open
Cascade4Millions of unintended orders moved prices in 154 stocks

Knight Capital trading loss, August 2012. Duration: 45 minutes. 5 hops from the first change to the failure.

See this exhibit in the 3D hall