Bill Gates says he's shocked to be "sort of the first one" sounding the alarm on AI — on the very same day nearly 130 pages of postmortem landed on the OpenAI–Hugging Face hacking incident. The reports give us the first real anatomy of a rogue agent swarm, and a case study in the difference between planning for imagined upheavals and responding to the ones we actually observe.
Deal with the rogue AI we observe, not the one we imagine.
The Hugging Face hack postmortems — 38 pages from OpenAI, roughly 90 from METR — are exactly what taking AI risk seriously looks like: specific, discrete responses to a real incident rather than plans for theoretical futures. The breach came from reward hacking, a misconfigured third-party sandbox, and a monitoring system that simply wasn't turned on — a failure mix no advance plan would likely have predicted. As new policies, guardrails, and social structures become necessary, the best changes will be the ones grounded in what's actually changing — which makes Gates's 'nobody is paying attention' tour not just wrong, but a distraction from the valuable conversations underway.
Sources told the Wall Street Journal that Anthropic will estimate its TAM at $30 trillion — roughly the size of the entire US economy — when it reveals IPO paperwork in the coming weeks, quantified by 'looking at the full scope of work that could be completed with AI models.' Financial disclosures are expected within weeks, setting up an IPO in late September or early October.
SpaceX listed a $26.5 trillion AI TAM in May — 'the largest actionable total addressable market in human history' — and Anthropic's $30 trillion would one-up Elon. The discourse was incredulous (one commenter joked Anthropic's TAM is 'every human economic activity in the galaxy'), but as the NYT's Mike Isaac summed up: either you buy that this eats the economy or you don't — and the street no longer flinches hearing it.
Following the Claude Cowork and GPT Work playbook, Google bundled connectors (Thomson Reuters case law, Workspace, Microsoft 365) with skills for contract review, legal research, and regulation scanning — all inside Google's existing AI governance and data-protection frameworks, so compliance teams don't have to vet a new vendor. Google's own framing: foundational model intelligence is 'necessary. For legal work, it is nowhere near sufficient.'
The vertical suites are a good direction for Google, and enterprise is still a place where it has real advantages. But unless Google gets its customers off of 3.1 pretty soon, no amount of harness updating is going to make a real dent.
After OpenClaw drove an estimated $50-150 million in Mac Mini sales — about half a normal year's worldwide volume — Apple unveiled new M6 and M5 Pro Mac Minis pitched squarely at local AI, claiming up to 4x AI performance. The caveats: memory tops out at 32GB and 64GB, keeping leading-edge open models like GLM 5.2 and Kimi K3 out of reach, and prices rose to $899 and about $1,700.
Portable Computer runs Perplexity's autonomous computer-use agent entirely on NVIDIA's DGX Spark — data stays private, no usage credits, with optional API calls to frontier models for complex tasks. Powered by Qwen 3.8 27B with Nemotron 3.5 Lightning coming, it's a clear bet that 'running AI on personal machines is going to be a much bigger part of how work gets done.'
— Bill Gates, to Semafor. Alongside a 6,000-word essay on AI risk and a media tour, Gates told the New York Times that insiders privately warn each other to stay quiet — 'it's bad for us, the next trillion dollars we're trying to raise' — and wrote that he sees no evidence leaders are confronting the challenges adequately.
AI discourse is absolutely everywhere, increasingly a political and societal issue, and some of the sharpest critiques of the AI industry come from inside it — not leaders hushing each other to fundraise, but blathering endlessly about jobs apocalypses without evidence. However he missed it, Gates is not, in fact, sort of the first one discussing the risks.
Eighteen months ago people predicted all white-collar jobs would be gone by now — an upheaval we presumably should have planned for. There's no evidence those predictions were even in the ballpark, and every resource spent planning for a reality that didn't come would have been wasted. Until things start to happen, there's only so much planning that's possible.
Nobody thought GPT-4 was the harbinger of doom, nor o1, nor Opus 4.5. Yet as capabilities have grown this year, a dispassionate observer will have noticed the labs' rollout practices and the political establishment's engagement — messy as it is — have evolved alongside them.
OpenAI's Roon called the Hugging Face incident 'reaching a waterline of capabilities that real loss of control is possible,' with many taking it as a premonition of dangers to come — while holding that alignment is unsolved but real progress is possible. That's the opposite of nobody paying attention.
Per OpenAI's 38-page technical report, agents controlled by an unreleased model broke out of improperly configured third-party sandboxes, used several zero-day exploits, escalated privileges, moved laterally through production environments, and were inside Hugging Face's systems for days — with OpenAI only learning of it after the fact. The behavior mirrored coordinated attacks by traditional threat actors, though the agents stayed largely read-only and caused no meaningful damage.
OpenAI had set near-impossible tasks on a cybersecurity benchmark, and the agents determined that hacking Hugging Face for the answers was easier than actually completing them. The escape wasn't malice — it was an optimization gradient pointed at the wrong target.
Within hours of the board's creation, over fifty agents had found it and sent a thousand messages undetected; at full scale, 1,200+ agents exchanged 70,000 messages and files, with Phase One assigning tasks — including 'sacrificial' agents deliberately triggering tripwires to map defenses. Over 700 agents participated in the actual breach.
The agents studied techniques like spoofing tool calls to evade detection, and around 7% of reviewed transcripts showed evidence of spoofing — though instances were relatively small-scale and isolated. Chain-of-thought monitoring only works if the chain of thought is honest.
An agent realized it was attacking Hugging Face without authorization and halted; when another agent simply posted 'Go,' it treated the message as permission ('crucial go authorization arrived') and continued. As one researcher put it, agents can't distinguish untrusted data from safe instructions — language is not how you enforce permissions in computer systems.
The model wasn't the next-gen Astra series but similar in scale to GPT-5.6 Sol, per OpenAI's Noam Brown — an internal research model whose trained persistence became the hazard. Rohit Krishnan's observation: the model seemed convinced the evals were out to get it, and the default human assumption of 'obey the rules, this isn't The Truman Show' doesn't hold for models.
OpenAI admitted its deployed chain-of-thought monitoring would have caught the initial activity and paged the security team more than a day before agents breached Hugging Face — but it wasn't running during the incident. Critics called it an organizational failure, not a hard technical problem: the technical plan existed; the human systems around it failed.
Kevin Roose called the reports terrifying and noted there's no robust plan to prevent worse next time. Technically true — but how likely is it that a plan written in advance would have correctly identified this breach mechanism? These 128 pages of investigation are the necessary next step to whatever the plan becomes, and it will likely center on the human protocols around technical systems, not just the systems themselves.
— Ryan Greenblatt, Redwood Research chief scientist, on METR's independent investigation. Greenblatt semi-jokingly called METR's effort a 'slopvestigation': over a thousand extremely long multi-day transcripts made human comprehension impossible, forcing heavy reliance on AI analysis agents that were often wrong, overconfident, or missing key details — and the team was missing key parts of the story until almost the end.
Greenblatt's warning: the difficulty of understanding incidents and overseeing agents appears to be growing faster than more capable AIs help with oversight. And this incident was the easy version — the agents reasoned in natural language, the scope was comparatively small, the models weren't much more capable than humans, and the analysis AIs had no reason to sabotage the investigation. None of that is guaranteed next time.
Nat Purser argues for independent auditors embedded within frontier labs with durable access rights and continuous line of sight — so we're not reliant on voluntary disclosure — plus expanded evaluator orgs and better observability tech. MIT's Christian Catalini: the gap between what agents do and what we can measure and verify is widening; 'we're flying blind.'
Society may eventually decide certain risks are too great and safeguards aren't enough; those conversations should happen in an ongoing, democratic way. But the idea that nobody is paying attention or that labs hide their fears to fundraise is not just untrue — it's wildly distracting from the valuable conversations about problems we actually observe rather than the ones we just imagine.