Vercel Labs open-sources agent-desktop for computer use

Agent Desktop

Vercel Labs' open-source computer-use layer that lets AI agents read and operate desktop apps on macOS, Windows and Linux through the OS accessibility tree instead of guessing from screenshots. A snapshot returns JSON with a stable ref for every clickable element; the agent acts on a ref and snapshots again to verify, which keeps actions safe to retry, saves tokens by scoping to one app region and lets several agents work in parallel. Rust CLI plus C library, installed with npm install -g agent-desktop. Apache-2.0.