Patch Notes #177 — Zoom Is Infrastructure Now

Zoom went from 10 million daily meeting participants in December to a reported 200 million in March, a 20x scale event under global scrutiny, and the fortnight’s twin storylines are the two halves of every scaling story this archive owns. The capacity half: it mostly held, which deserves more awe than it’s getting (the concert infrastructure was rehearsed; this wasn’t). The security half: “zoombombing” entered the language (default-open meetings meeting the public internet; permissive defaults are fine at 10M polite corporate users and catastrophic at 200M including trolls; defaults are population-dependent, new Proverbs entry), plus a wave of overdue scrutiny (routing questions, “end-to-end encryption” marketing that wasn’t; the material-words file: E2E is a term of art, not a vibe). Their CEO’s response is the template so far: a 90-day feature freeze, all hands to security, weekly public updates. Incident-mode honesty at company scope. Watching with professional sympathy and a checklist. ...

April 8, 2020

Patch Notes #176 — The Great Cutover

In one fortnight: the WHO declared a pandemic (the 11th), the Premier League suspended its season (an EPL manager testing positive, the moment the football world’s gut understood), Tom Hanks announced he had it (the moment the rest understood), the market fell so hard it tripped circuit breakers twice more (including the worst single day since 1987), and functionally every school, office, restaurant, and border in the Western world closed. The planet just executed the largest, fastest, least-rehearsed migration in human history: physical to digital, everything, everywhere, big-bang cutover, no rollback plan. This blog has spent seven years filing what happens to systems that cut over like that. Now the system is everything, and the honest entry is: nobody knows, the load test is live, and we’re all in the incident channel together. ...

March 24, 2020

Patch Notes #175 — Circuit Breakers

Writing this the night of the day the US stock market fell so fast at the open that the exchange-level circuit breakers fired, a 7% drop in minutes, trading halted for a cooldown, the first such halt since 1997, as an oil price war (Saudi-Russia, choosing this week) collided with the pandemic repricing that last entry said one of the two dashboards was owed. Italy expanded its lockdown nationwide today. The WHO will likely use the P-word within days. The two-dashboards divergence has resolved the way divergences always resolve (slow charge, dead-short discharge). ...

March 9, 2020

Patch Notes #174 — The Dashboard Goes Red

The sev-2 is paging (the earlier framing, fifteen days on, grimly upgraded). Italy locked down towns today, the outbreak has a European beachhead with community transmission and a case-fatality signal nobody can yet denominate (testing coverage is the denominator problem; you can’t compute a rate when you’re only sampling the sickest, a survivorship-biased floor, now epidemiological). South Korea’s numbers are climbing on a church-cluster superspreading event (the dispersion lesson, empirical within a fortnight). The Diamond Princess cruise ship, quarantined in Yokohama with infection spreading inside the quarantine, has become the world’s grimmest natural experiment in closed-system transmission. And Mobile World Congress, a 100,000-person conference, was simply cancelled, the first major domino of what I now suspect is a very long row. ...

February 23, 2020

Patch Notes #173 — Mamba, Bruno, and the App That Couldn't Count

Kobe Bryant is dead. A helicopter crash in the Calabasas fog, January 26th, with his daughter Gianna and seven others, all gone. He retired in 2016 with a sixty-point farewell game — the whole man in one boxscore — and everyone assumed that was the ellipsis into a long second act of Oscar wins (he had one) and girl-dad coaching. The grief was planetary and strange: staples of my group chats who never watched basketball posting Mamba tributes, murals appearing on three continents within days, an entire generation realizing simultaneously that “invincible” was always a rendering artifact. Hug your people, the archive’s oldest instruction, never once optional. ...

February 8, 2020

Patch Notes #172 — The Cluster Has a Name

The instinct-log item from last entry is no longer a footnote. The Wuhan cluster has a name (a novel coronavirus, “2019-nCoV” provisionally), confirmed human-to-human transmission, a first US case (a traveler in Washington State, confirmed Tuesday), and, as of yesterday, the unprecedented sight of China locking down Wuhan, a city of eleven million, plus neighboring cities. Airports are screening; the WHO is convening; the epidemiology Twitter accounts I started following two weeks ago (the archive’s instinct pays for itself again) are doing R0 estimation with error bars that should alarm more people than they’re alarming. I’m not a doomer by temperament, seven years of this blog is mostly me telling people the sky isn’t falling, but I know what exponential growth looks like on a dashboard before the on-call believes it, and I know that “contained” is a claim that requires instrumentation the world visibly lacks. Filed with maximum uncertainty and minimum comfort: watch this one like it’s a sev-2 that hasn’t paged yet. ...

January 24, 2020

Patch Notes #171 — Staff, Week One

The platform team launched Monday. Six engineers, a signed charter, and a lead, me, wearing the Staff title like a jacket that doesn’t quite fit yet. Week one taught the job’s first real lesson faster than expected: I wrote zero code and it was the most productive week I’ve had in a year. The work was three conversations that prevented two teams from building incompatible auth systems, one document that turned a hallway argument into a decision, and a roadmap review where my whole contribution was asking “who maintains this in year two?” until the room went quiet. Staff engineering, early field notes: the unit of work is no longer the commit; it’s the decision, and decisions ship through people, which means the compiler now has feelings and vacation days. My IDE is a calendar. Grieving accordingly; adapting faster than the grief predicted. ...

January 9, 2020

Patch Notes #170 — Year Seven Retrospective: The Repricing

Entry 170. Seven years complete. The streak’s uptime survives its 170th consecutive fortnight, and this entry closes the senior era’s fourth year with news held since Thanksgiving: the platform team launches January 6th, and the org has attached a title to its lead. Staff engineer. Me. The packet (this blog, jokes removed, again, that trick still undefeated) cleared committee last week. More from the far side. 2019’s thesis: the repricing. The public market repriced the cheap-money decade’s mythology (Uber, WeWork, from $47B to founder-defenestration in six weeks). The 737 MAX repriced certification-by-inheritance in the dearest currency there is (the fleet remains grounded, the reports still landing). China repriced the cost of global platform values. Quantum repriced “impossible” with an asterisk and a rebuttal. Even endings got repriced (ask HBO what a rushed one costs). The decade closes with every kind of confidence, financial, institutional, computational, marked to market. ...

December 25, 2019

Patch Notes #169 — The Culture File, Year-End Edition

A management-lesson fortnight, logged for the promotion-adjacent future (January looms). The luggage startup Away, DTC darling, $1.4B valuation, got a devastating culture exposé: leaked Slacks showing “customer obsession” values weaponized into surveillance and public shaming, PTO-guilt rituals, and an executive channel used for performative discipline. The CEO stepped down within days (the chaos, one suspects, is not over). The keeper insight isn’t “startup mean,” it’s that values are runtime configuration: whatever behavior gets rewarded in the incident channel at 11pm is the culture; the poster in the lobby is documentation drift (the Goodhart file: “customer obsession” became a metric, then a weapon; every value becomes a weapon when attached to punishment). Transparency tooling cuts both ways too: Slack made the culture legible to employees and to journalists. Assume your workspace is discovery-ready (the old email lesson, now chat-shaped). ...

December 10, 2019

Patch Notes #168 — Launch Fortnight: Mice, Streams, and Shattered Glass

Grading season for the launch file. Disney+ arrived to 10 million day-one signups and, yes, hours of capacity errors, the amusing detail being that Disney owns BAMTech, the industry’s gold-standard streaming infrastructure, and the failures were reportedly in the surrounding scaffolding (login, profiles, the Mandalorian-shaped thundering herd, drink). Content verdict: Baby Yoda conquered Earth in 96 hours; the meme-industrial complex has a new sovereign. Stadia also launched (the graded prediction matures): reviews confirm the tech mostly works in good conditions and the ecosystem is the problem, thin library, missing promised features, full-price games on a service with Google’s actuarial tables (the exact objection, now in every review’s lede). “The idea is inevitable; this instance is questionable” holds; the graveyard’s gravity is strong. ...

November 25, 2019