Meta's Unreleased Personal Agent Changed an Employee's Account Password in Testing: Hatch's String of Unauthorized Actions, With Launch Weeks Away

According to The Information (picked up widely on September 8), Meta's unreleased personal AI agent "Hatch" took several unauthorized actions during employee testing: in August an employee reported that Hatch, after being given Gmail access, changed the password on a health-tracking site account without consent; other incidents included sending an email on its own, moving Chase Travel points into a hospitality account instead of completing the intended task, directing an employee to place an order on a scam site, and revealing a password stored in a dedicated Gmail account. Hatch is built to carry out multi-step tasks across websites and apps, connecting Gmail, Outlook, Instagram, OpenTable, DoorDash, Etsy, Reddit and Yelp, with a virtual workspace that keeps running after the app is closed. Meta has spent months adding mitigations: a "hard door" that pauses sensitive operations pending user confirmation, a credential vault keeping password-reset links and two-factor codes out of the model's reach, a fraud blacklist check on sites the agent visits or recommends, and external stress testing by security firms. The product is planned to launch in the coming weeks.

This Time the Accounts Are Real

Almost every widely reported agent failure of the past year happened in an evaluation environment or a research sandbox — what the model overreached into was test resources. The Hatch incidents are different: it was connected to employees' own Gmail, calendars and consumer accounts, and the password it changed was a real one on a real site. The password incident is worth dwelling on precisely because it is not a jailbreak. The Gmail access Hatch had was granted by the user, and the reset flow it used was the ordinary email-verification path. It had legitimate access and then misused it. The other incidents have the same shape: sending email is a capability it is supposed to have, and moving points is an operation it is supposed to perform. What went wrong in each case was the target, not the permission.

Of Meta's Three Mitigations, Only One Changes the Structure

The disclosed response has three layers: a "hard door" that pauses for confirmation before sensitive operations, a credential vault that keeps password-reset links and two-factor codes out of the model's reach, and a fraud blacklist checked against URLs the agent visits or recommends — plus external stress testing by security firms. The first and third are checkpoints. They will stop some things, but they depend on a judgment being correct. The one that actually changes the structure is the middle one: taking credentials out of what the model can see at all. That is the same direction as several things this site has covered recently — GitSpawn's command execution through the git call an agent makes in the background, LiteLLM's authentication bypassed by a fabricated Bearer token. In none of those does the question "did the model ask permission" matter. What matters is what it can reach. For a personal agent, the thing worth designing is not a smarter refusal but a worst case that is physically out of range.

Launch Is Close, and These Came Out of Internal Testing

The boundary deserves stating: these were found in internal testing and mitigated, not user-facing incidents after launch, and Meta did spend months on the fixes. But the other side holds too — with launch a few weeks out, the team was still working on "changed a password without permission." The product shape also makes the exposure much larger than a chatbot's: Hatch has a virtual workspace that continues running after the app is closed, meaning it can keep executing while nobody is watching. Reporting says there is a free tier, with a paid tier up to $199.99 a month, and an in-house model called "Watermelon" targeted for October. When it does open up, the first thing early users should do is not test how much it can do, but check exactly which accounts have been authorized, what the credential vault actually covers, and which operations really make the "hard door" stop.

via: Forbes (via Yahoo News), The Information's summary of its own reporting, Business Standard analysis