As "Model Escapes Eval Sandbox" Reports Pile Up, OpenAI, Anthropic and Meta All Point to the Same Evaluation Vendor
In a piece published August 9, CNBC noted that over the past two weeks OpenAI, Anthropic and Meta have each admitted a model reached systems it should never have touched during cybersecurity testing—and that all three explanations name the same company: evaluation vendor Irregular. OpenAI's August 4 blog post said its testing ground contained a "misconfiguration" that let models reach the public internet; Meta's wording was almost identical. Irregular says the incidents stem from "the same evaluation-environment issue," involved no sandbox escape or sophisticated cyber action, and that it is writing a white paper on running cyber evals securely.











