What changed

GitHub added computer use in public preview to Copilot CLI and the Copilot app on macOS and Windows. With user approval it can read accessible and visual application context, click, type, scroll and drag across desktop workflows; administrators can disable the feature.

Why it matters

Copilot can now act in legacy and GUI-only software that lacks APIs or MCP, but screen access and input control turn mistaken interpretation and hostile on-screen content into direct action risk.

What to do

Enable computer use only in a test OS account, allow one benign application, deny another, and run a reversible workflow with synthetic data. Verify every approval, always-allow reset, accessibility permission, interruption and audit trail before broader access.

Caveat

This is a public preview with no independent reliability or prompt-injection evaluation. Approval and organization controls reduce risk but do not prove correct perception, intent or recovery, especially across apps containing sensitive data.