AI
Ai2's StateBench: frontier models fall to 13% or lower when they must track changing facts across long documents
The Allen Institute for AI released StateBench, a benchmark that tests whether models can follow variables as they change across up to 64,000 updates. Frontier models handle simple lookups but collapse on the hardest updates, and Ai2's small-model experiments point to an architectural reason.
