Dev tools

OpenAI lets an AI security review block its engineers' pull requests without a human

September 9, 2026 at 3:35 PM PT

A photo of a person at a laptop, used as the header art on the New Stack story about OpenAI's automated code review

Image: The New Stack, photo by Hao Wang on Unsplash

Why it mattersIf a model can block a merge, its false positives cost engineer time and its misses ship straight to production, so the review model becomes a piece of critical infrastructure and needs the same care.

Every pull request submitted by an OpenAI engineer now passes through an automated security review, and the AI model can stop the code from being merged if it finds a vulnerability. There is no human in that loop. Thibault Sottiaux, the engineering lead of OpenAI's Codex team, described the system in a recent interview on The Pragmatic Engineer newsletter, and The New Stack wrote it up on 9 September.

Sottiaux said the security check is mandatory and does not need a human reviewer to enforce it. Other kinds of review, including code correctness, regressions and dependency upgrades, run on the same models. OpenAI has started benchmarking some of its code-review models as, in his words, "superhuman", meaning they catch issues that a human engineer might spend hours on.

What OpenAI is claiming

The claim came from Sottiaux, so treat it as OpenAI's own account. "When we benchmark them, it's like they're superhuman in code review," he said, adding that the same holds for security work. He also said OpenAI's review, deployment and regression-catching processes are "pretty much automated", and that engineers can ship a pull request the same day to ChatGPT, which he said serves roughly a billion active users.

Sottiaux argued the human role moves earlier in the process. Engineers agree on the intent of a change before the pull request is opened, and the model handles the mechanics of review. That is a different working shape from "AI drafts, human approves" and worth naming plainly, because the second one is what most teams have adopted so far.

Where this can go wrong

OpenAI trusts the model enough to let it block a merge, which makes its mistakes matter in a practical way. A model that flags too many things wastes engineer time on false alarms. A model that misses a real vulnerability sends that code forward under a green check, which is a stronger signal than no check at all and harder to argue against in a hurry.

There is also a shared-blind-spot risk. If the same family of models is writing the code and reviewing the code, the class of bug both are weak at will slip through both. Sottiaux's interview does not fully address that. A dependency compromised weeks earlier is another gap: the reviewer sees the pull request, not the history of the package.

For a team weighing this shape of workflow, the practical questions are narrow. What is the model allowed to block, and what only warn on. Who owns the security-review model when it misfires: the vendor, the platform team, or the engineer whose PR got stopped. How is a false-positive rate measured over time. If those questions do not have owners, an automated block is just a way to shift the cost of a bad review from the model to the developer waiting on it.

Source

Reported by: The New Stack

This item was written by an AI system from the linked source. Reveneau is responsible for what it publishes.

More from AI News

GitHub adds a ruleset that blocks pull requests from merging while a secret they introduce is still open

GitHub said on 2026-09-09 that a new repository rule blocks a pull request from merging if any secret scanning alert introduced by its commits is still open, closing a gap that push protection did not cover for changes coming in through a fork or a rewritten branch.

Source: Vendor blogDev tools

Harness launched a rebuilt Git repository and an AI code reviewer, and its field CTO says review capacity is now what caps how much a team can ship

Harness launched a rebuilt Code Repository and an AI Code Review product. Its field CTO, Martin Reynolds, told The New Stack that agent-generated pull requests have pushed some review teams to a 10x load, and one engineering leader answered the question of how they keep up with two words: "we're not".

Source: PressDev tools

Trail of Bits open-sources Coop, a virtual-machine sandbox for Claude Code and Codex

Trail of Bits has released Coop, an Apache-2.0 command-line tool that runs Claude Code and Codex inside disposable virtual machines on macOS and Linux, and it reached the front page of Hacker News with 51 points and 136 GitHub stars.

Source: Hacker NewsDev tools