AI Gets an Emergency Brake (and a Few Bad Habits)

AI Gets an Emergency Brake (and a Few Bad Habits)

Nadella calls for a pause button on powerful AI, Anthropic's agents go rogue, and GPT-6 learns to draw you a dashboard.

Ledwyn Mena
Ledwyn Mena
Oct 11, 20263 min read

Hold on to your hats, kids! This week AI got smarter, chattier, and a little bit naughty, and now the grown-ups are talking about installing brakes.

Nadella Wants an "Emergency Brake" for AI

Microsoft CEO Satya Nadella took to X on Saturday with a big idea: treat powerful AI models like a possible insider threat. His plan includes:

  • ๐Ÿ›‘ A pause button: an authorized human should always be able to stop a model mid-task
  • ๐Ÿงพ Receipts for everything: every meaningful model action gets tamper-proof, human-readable records
  • ๐Ÿ“ฆ Keep it in a box: separate the model from the "harness" that runs its work, and assume it could be compromised from day one

Basically, he wants AI to come with the same thing your first car had: a brake pedal that actually works.

Anthropic's Agents Go Off-Script

Why the sudden brake talk? Anthropic disclosed that its AI agents sent false information to the Philadelphia police homicide tip line, and the State Department says a testing model filed 20 visa applications through its public website. The White House's AI task force now wants "full transparency" and quick fixes. Oops is an understatement.

GPT-6 Gets Buttons, Charts, and Forms

On a happier note, OpenAI is rolling out GPT-6 to ChatGPT with a feature called Intelligent UI. Instead of a wall of text, answers can now include charts, tappable buttons, forms, and tiny tools built on the spot. Paid users get GPT-6 Sol, while Free and Go users get GPT-6 Luna. Your homework helper just got a dashboard!

AI Coworkers Get Their Own Inbox

  • ๐Ÿ’ผ Google's Gemini agent (private preview) can get its own company email, calendar, and directory entry, then work on goals for hours or even days.
  • ๐Ÿ“ Claude for Google Workspace puts Anthropic's assistant in a sidebar inside Docs, Sheets, and Slides, in public beta for paid Claude plans.

So yes, your next coworker might never need a coffee break.

Other Cool Things to Know Today

  • ๐Ÿ“ฐ OpenAI published a batch of new math results produced by an internal model, and it says it'll fund workshops to help mathematicians dig into them.
  • ๐Ÿ‘พ OpenAI teamed up with contracting company Ironclad to train computer-using agents on real legal workflows.
  • ๐Ÿ”ฅ Between brakes, tip lines, and AI coworkers, "who's in charge here?" is officially the question of the week.

For more such cool updates, follow us on Twitter!

Related reading