That was the moment that I felt like, okay, these models have now come to a point where they really, truly understand.

Consider the deep anatomy of an individual AI session to understand how this telemetry actually works in practice.

you can run an inferior model for an infinite number of tokens, and it will never realize(*) that the lack of validation of the start window, if put together with the integer overflow, then put together with the fact the branch where the node should never be NULL is entered regardless, will produce the bug.

Meta feels AI models don’t understand how people use computers, so the company needs real-life examples of how meatbags click their way through a working day so it can build agents.

We found weak evidence that Opus 4.0 and 4.1 had partially memorized cal, but no evidence Opus 4.6 had memorized it, despite performing best of all models considered.

5.12 Be cautious about trusting AI without having deep understanding.