Discussion about this post

User's avatar
State of Play's avatar

The "no deliberate testing" detail is the sharpest part of this. Discovery is turning into a byproduct of ordinary activity rather than a scheduled effort. Google's security agents found more than 100 verified critical flaws in a single 48-hour incident response, and OpenAI's specialist hacking model now completes roughly 95% of attack tasks that its general-purpose sibling completes at 1.5%. Different mechanism than your gym app, same shift: the cost of finding a hole is dropping across the board, not only where someone happened to be poking around.

The uncomfortable half of that is fixing, not finding. Independent testing this year found more than half of AI-generated security patches either fail to close the flaw or introduce a new one. If discovery keeps getting cheaper while remediation still runs on scarce human review, that's where the collision you're describing lands next, not at the obscurity line.

Arshavir Blackwell, PhD🤖's avatar

But the same AIs which can break in (or vibe code) can also (at least in theory) be used by white hats or coders to check those various security holes... at least in theory.

53 more comments...

No posts

Ready for more?