No. 011 · Clock Room
The Extra Second
· hours, depending on who you were
Impact 4.0/10
- 1A leap second is inserted at 23:59:60 UTC
- 2A Linux kernel timer bug makes some processes spin
- 3Java and MySQL servers pin their CPUs
- 4Reddit, Mozilla and others slow down or fall over
- 5Fix: set the clock again, or reboot ✕
Time is an input. Test the weird ones.
Source: Public postmortems and kernel mailing list, July 2012
Impact
Five dimensions, 0 to 10 each. The overall 4.0/10 is their average. How impact is scored
| Dimension | Score | Basis |
|---|
| Reach | 8 | Reddit, Mozilla and others |
|---|
| Duration | 6 | Hours, depending on the site |
|---|
| Loss | 0 | None stated in the source |
|---|
| Recovery | 4 | Set the clock again, or reboot, server by server |
|---|
| Cascade | 2 | Each site's own Java and MySQL servers |
|---|
Leap second bug, June 2012. Duration: hours, depending on who you were. 5 hops from the first change to the failure.
See this exhibit in the 3D hall