Patch Notes #109 — Amazon Buys Groceries, Real Madrid Buy Glory

Amazon announced it’s buying Whole Foods for $13.7 billion, and the strategic shockwave was measurable in real time: every grocery stock on Earth dropped the moment the press release hit, billions in competitor market cap deleted by a PDF. The chess is beautiful and slightly terrifying: 460 refrigerated warehouses in wealthy zip codes, a delivery-density dream, the Go store’s sensor tech with a live laboratory, and Prime as the loyalty program stitching it all together. Amazon spent 2016 making buying invisible and is now buying the physical substrate of the most frequent purchase in human life. “Your margin is my opportunity” has entered its produce-aisle era. ...

June 23, 2017

Patch Notes #108 — Apple Points at Reality

WWDC delivered a sleeper hit: ARKit. Apple’s framework for augmented reality on plain iPhones (world tracking, plane detection, light estimation) shipping to hundreds of millions of devices this fall with, functionally, one import statement. The demos on dev Twitter within 48 hours (tape measures, furniture previews, tiny dragons on desks) already outclass everything Google Glass and most of the VR industry promised. The strategic read: while everyone chased headsets, Apple made the phone in your pocket the largest AR platform on Earth overnight, and made every future-headset developer learn their stack first. Platform judo. Alexa did it with speakers; Apple’s doing it with cameras. ...

June 8, 2017

Patch Notes #107 — The Worm That Held Hospitals Hostage

WannaCry happened. A ransomware worm, self-spreading, no clicks needed, tore through 200,000+ Windows machines across 150 countries in a weekend, encrypting everything and demanding Bitcoin. The UK’s NHS got hit hardest: appointments cancelled, ambulances diverted, hospitals running on paper because of unpatched Windows 7 boxes on flat networks (the old segmentation sermon, now with casualties). The exploit, “EternalBlue,” leaked from the NSA’s own stockpile, a government hoarded a vulnerability, lost custody of it, and watched it hit its own health system’s supply chain. Every debate from Apple-vs-FBI about “keys that only good guys hold” just got its empirical result. ...

May 24, 2017

Patch Notes #106 — Quiet Fortnight, Loud Cluster

No planetary news cycle this window (the universe occasionally rests between chaos sprints), so a working dispatch from the Kubernetes trenches, where the real 2017 is happening. Status: five services migrated, two incidents caused, one genuinely new capability unlocked. The incidents, briefly, because incidents are the tuition: (1) we set memory limits from vibes instead of profiles and the OOMKiller taught us our own traffic patterns; (2) liveness probes pointed at an endpoint that touched the database, so a database blip made Kubernetes “helpfully” restart every healthy pod at once, a self-inflicted thundering herd (drink), the automation amplifying the failure it was meant to contain. GitHub’s and Google’s SRE writing warned me about exactly this genre: your resilience machinery is itself a failure domain, and it fails enthusiastically. Probes now check only what the pod itself controls. ...

May 9, 2017

Patch Notes #105 — The $400 Bag Squeezer

Bloomberg performed the tech journalism of the decade: they squeezed a Juicero bag by hand. Backstory for the future readers of this archive: Juicero raised ~$120M from top-tier VCs for a $400 (originally $700) WiFi-connected juice press that squeezes proprietary $7 produce bags, DRM’d juice, QR-verified, subscription-locked. The machine is, by teardown consensus, a gorgeous over-engineered marvel of custom machining. And Bloomberg demonstrated that human hands squeeze the bags just as well. Faster, actually. ...

April 24, 2017

Patch Notes #104 — Re-Accommodated

This week United Airlines had passengers watch security drag a seated, paying customer off an overbooked flight, bloodied, filmed from four angles, viral before the plane took off. The CEO’s first response apologized for having to “re-accommodate” customers, a word that instantly entered the corporate-euphemism hall of fame next to “sunsetting” and “rightsizing.” The stock is already paying for it and the apology is on its third iteration. Filed for the craft because it’s an incident-response case study: the event was bad; the response made it catastrophic. First statement matters most; euphemism reads as contempt; and any policy that ends with “and then we call security on our own customer” was a bug long before it executed. Every company has policies like this, dormant, absurd, waiting for their viral moment. Audit for them the way we audit for Shellshock. ...

April 9, 2017

Patch Notes #103 — Demo Day at Scale

YC Demo Day this week: about 100 companies, and the batch reads like a map of 2017’s ambitions: AI-for-everything (radiology, contracts, crops), a heavy fintech contingent aiming at everything banks do badly, and a few “hard tech” moonshots. Four years ago the joke was “Airbnb for boats.” My marina-logistics friend from that era? His “boring, profitable” pivot just raised a Series A. The joke companies died; the spreadsheet-shaped ones compounded. Demo Day is a portfolio-priors update on schedule: whatever’s overrepresented in March is oversaturated by August, and the winner is usually filed under “wait, that’s a company?” ...

March 25, 2017

Patch Notes #102 — The Typo and the Triumph

The great S3 outage of 2017: on February 28th, an AWS engineer debugging the billing system typo’d a playbook command and removed way more capacity than intended from us-east-1’s S3, and it turned out half the internet, including AWS’s own status dashboard, lives in that bucket-shaped basket. Four hours of a broken web. Amazon’s postmortem is admirably specific: the tool allowed too-big removals (now capped), and a subsystem hadn’t been restarted in years and took ages to cold-boot. Zero blame placed on the human, all of it on the system that let one keystroke go nuclear, the Joyent lesson from 2014 at 100x scale. If a typo can take down the internet, the typo isn’t the bug. Also: host your status page somewhere else. Everyone. Please. ...

March 10, 2017

Patch Notes #101 — The Blog Post That Shook an Industry

The most consequential engineering document of the fortnight wasn’t a paper or a postmortem, it was a personal blog post. Susan Fowler, an engineer, published “Reflecting on One Very, Very Strange Year at Uber”: calm, precise, receipts-grade documentation of harassment reported and buried, HR processes that protected the wrong people, and a culture rotting from its incentives. It detonated. Uber launched an external investigation within days; the industry’s whisper networks went loud; and every eng leadership team I know (including ours, forty people, no excuses) is asking “could that happen here and would we know?” The technical-adjacent lesson: she wrote it like an incident report, with a timeline, evidence, escalation paths, and systemic analysis over villain-hunting, and that is why it couldn’t be dismissed. Documentation is power. It always was. ...

February 23, 2017

Patch Notes #100 — 28-3

Entry one hundred. Four years and a month of fortnightly patch notes, and the office spent the milestone week debating the greatest comebacks in sports history. We kept returning to Manchester United’s 1999 Champions League final. Down 1-0 in the 90th minute (win probability models would have shown Bayern Munich above 99%), and then the most dramatic three minutes in football history, sealed before the whistle. Teddy Sheringham sweeping in the equalizer, Ole Gunnar Solskjær stabbing the winner into the roof of the net like a man defying the concept of physics out of spite. ...

February 8, 2017