Technology

action-level evaluation

1 synchronized story carry this tag.

OSGuard finds a gap between isolated safety checks and safe end-to-end computer use

The OSGuard preprint introduces action-level and live OSWorld evaluations containing latent hazards, reporting that guardrails which look strong in isolation can still fail when embedded in complete computer-use trajectories.

Why it matters: Agent safety must be evaluated at the action and trajectory level, where harmless-looking individual steps can combine into a dangerous outcome.

Read storyOriginal source · arxiv.org