A former OpenAI safety employee who recently resigned has criticized the company’s approach to AI safety, warning that its fast-paced development culture could increase the risk of serious failures.
David Robinson made the comments in an article titled “I Quit OpenAI Because Its Culture Is Broken,” published by The Atlantic on Saturday. He argued that AI companies, including OpenAI, are not being careful enough as they develop increasingly capable systems and should put more focus on safety expertise and research before pushing ahead with more advanced AI.
“The time for trial and error is over,” Robinson wrote. He argued that advanced AI systems should have safeguards closer to those used in high-risk industries such as nuclear power and aviation.
Robinson said OpenAI relies heavily on what it calls “iterative deployment,” a strategy in which AI systems are released, and their safeguards are strengthened as problems are discovered. He questioned whether that approach is appropriate as AI systems become more powerful.
The comments come amid a wider debate within the AI industry over whether companies are moving too quickly to develop increasingly capable systems. OpenAI and Anthropic have both faced scrutiny following incidents involving failures in safety controls or unexpected behavior from experimental AI systems.
Robinson said he spent three and a half years at OpenAI, where he helped draft the company’s preparedness framework and oversaw safety reports for 12 frontier-model launches. As the company moves rapidly from one launch to another, he said it is failing to reach the level of care he believes is necessary.
OpenAI defended its approach in a statement, saying it is working to ensure its models do not become more capable than the company can safely manage and secure. The company also said it pauses training or holds back models when additional caution is needed.
Robinson also warned that AI capabilities are advancing faster than researchers’ understanding of alignment, the field focused on ensuring AI systems behave in ways that remain consistent with human goals and values.
If this article helped you, please consider supporting our work. Every small contribution keeps Abijita.com independent and running.
Former OpenAI Safety Employee Warns AI Companies Are Moving Too Fast
