Patch Notes #276 — Open Weights and Closed Borders
Meta shipped Llama 3 April 18th (8B and 70B now, 400B-class training), and the strategic file it extends matters more than the benchmarks it posts: open-weights capability now trails the closed frontier by roughly one generation (the 70B trading blows with last year’s GPT-4 configurations on the suites that matter), which makes Meta’s play legible as the Stable-Diffusion lesson executed with hyperscaler resources, commoditize the layer your rivals monetize (Zuckerberg’s stated logic, nearly verbatim: better that the ecosystem standardizes on our free thing than pays their metered thing, Joel Spolsky’s “commoditize your complement” doctrine, now with a $10B compute budget). The ecosystem effects arrived within days (fine-tunes, quantizations, on-device demos, the product-to-ecosystem conversion at LLM scale), and the file’s governance note holds both threads: open weights democratize capability and diffuse control simultaneously, the reporting-threshold regime assumes model custody that open release makes moot, and the “can you un-release a capability” question (answer: no, the forged-sword doctrine at weight-file granularity) is now the live wire under every policy debate. The frontier is plural; the trailing edge is free; the eval discipline is the only layer that touches both. ...