BrowseComp makes persistent web research measurable with 1,266 hard searches
OpenAI released BrowseComp, a benchmark of 1,266 obscure, multi-hop questions designed to be hard to find but easy to grade with short answers. The dataset and evaluator were added to simple-evals, and OpenAI disclosed that its Deep Research system had been trained on tasks targeting BrowseComp.
Why it matters: BrowseComp tested search strategy and persistence rather than ordinary factual recall, exposing how much agent performance depends on tool use and inference-time effort.