Echoverse makes computer-use outcomes inspectable
Microsoft released four MIT-licensed, resettable application environments with six evaluation splits and 722 tasks. Expected outcomes are grounded in database state, while an LLM judge handles semantic or formatting variation in the final comparison.
Why it matters: Database-backed success checks reveal whether an agent completed the workflow and changed the right state, not merely whether its screenshot or explanation looks plausible.