Financial Touchstone update compares 20 current models
The updated benchmark contains 2,967 question-context-answer triplets from 495 international annual reports and expands testing from 11 to 20 models; retrieval caused 48.9% of reported failures.
Why it matters: The results suggest that finding the correct evidence remains a larger weakness than interpreting it, even as open-weight models approach proprietary systems on the bounded task.