Patch Notes #206 — The 49-Minute Internet and the Bitcoin Nation
On June 8th, a huge slice of the internet vanished for ~49 minutes, Reuters, the Guardian, gov.uk, Amazon’s homepage, Reddit, Twitch, and the cause was one customer’s valid configuration change hitting a dormant bug in Fastly’s edge software, deployed a month earlier, waiting for the exact config shape that would detonate it globally. The file admires everything about the response (bug identified in minutes, mostly restored inside the hour, transparent postmortem within 24) and files the structural lesson with its siblings: the CDN layer is the new single point of failure the multi-cloud crowd forgot to diversify (the old Dyn entry, evolved, DNS then, edge now), “valid input, latent bug” is the failure signature staged rollouts exist to catch and config changes routinely skip (the Cloudflare regex; the emergency lane and the config lane keep being the same unguarded lane), and a 49-minute outage that makes global front pages is, perversely, evidence of how reliable the substrate usually is, nobody headlines the highway that flows. The archive’s concentration-risk shelf now needs its own bookcase. ...