AI tools for browsing the web: computer and desktop control
Agents that see the screen and use the mouse and keyboard, so they can work in desktop apps as well as the browser. Of the 75 tools on our browsing the web page, 15 fit this narrower job. By pricing: 11 open source, 2 free or freemium, 2 pricing on the maker's site. The most-starred open repos here are UI-TARS-desktop (39,297 stars), Cua (29,966 stars), Midscene.js (15,311 stars). Most come from the browser/computer use (14), personal agents (1) categories.
UI-TARS-desktop
ByteDance's open-source multimodal agent stack, including a desktop app and Agent TARS for controlling computers and browsers.
Added
Cua
Open-source infrastructure for computer-use agents: sandboxes, drivers across operating systems and benchmarks.
Added
Midscene.js
Vision-driven UI automation and E2E testing framework where a GUI agent carries out natural-language steps on web, mobile and desktop apps.
Added
RobotGo
Go library for cross-platform desktop automation and AI computer use that controls mouse, keyboard, screen, windows and processes.
Added
UFO
Microsoft's desktop agent framework that operates Windows apps and orchestrates multi-device tasks as task graphs.
Added
Windows-MCP
Lightweight MCP server for computer use on Windows that lets agents navigate files, control apps and interact with the UI.
Added
Peekaboo
macOS CLI, menu-bar app and MCP server for screen capture, accessibility inspection and native UI automation by AI agents.
Added
AstronRPA
iFlytek's open-source enterprise RPA desktop app with a low-code visual designer whose workflows can be called by AI agents.
Added
TuriX CUA
Computer-use agent that operates desktop apps.
Added
Skales
Personal AI agent for desktop and mobile that codes, automates the desktop and browser and runs scheduled tasks with local or cloud models.
Added
Ui.Vision RPA
Browser and desktop automation extension with OCR and image recognition, plus an MCP server so AI agents can create and run macros.
Added
AGI-0 by AGI, Inc.
AGI, Inc.'s small action model and Android agent that sees the screen and acts across any app without APIs.
Added
Anchor Action Index
Shared memory of web workflows for Anchor's cloud browsers: computer-use agents replay proven paths as deterministic code and the model only steps in where a page has changed, exposed as tools on Anchor's MCP server and REST API.
Added
Arro
Arro, a desktop assistant that guides you through tasks on your computer and repeats them for you.
Added
Holo4 (H Company)
Open-weight computer-use models (27B and 35B-A3B) released Oct 1.
Added
GitHub repos (11)
| Repo | GitHub stars | Licence | Last push |
|---|---|---|---|
| UI-TARS-desktop ↗ | 39,297 | Apache License 2.0 | 2026-10-09 |
| Cua ↗ | 29,966 | MIT | 2026-10-18 |
| Midscene.js ↗ | 15,311 | — | — |
| RobotGo ↗ | 10,871 | — | — |
| UFO ↗ | 10,056 | — | — |
| Windows-MCP ↗ | 9,404 | — | — |
| Peekaboo ↗ | 5,335 | — | — |
| AstronRPA ↗ | 5,276 | — | — |
| TuriX CUA ↗ | 3,171 | MIT | 2026-09-14 |
| Skales ↗ | 2,196 | — | — |
| Ui.Vision RPA ↗ | 2,083 | — | — |
11 repos. Stars and licence come from each repo, checked when the listing was last verified.
FAQ
What are the best AI tools for browsing the web focused on computer and desktop control?
We list 15. The first three by GitHub stars and featured status are UI-TARS-desktop: ByteDance's open-source multimodal agent stack, including a desktop app and Agent TARS for controlling computers and browsers.; Cua: Open-source infrastructure for computer-use agents: sandboxes, drivers across operating systems and benchmarks.; Midscene.js: Vision-driven UI automation and E2E testing framework where a GUI agent carries out natural-language steps on web, mobile and desktop apps.
Are there free or open-source options?
Yes: 11 open source, 2 free or freemium, 2 pricing on the maker's site. Pricing is as each maker states it.
More from browsing the web
Tools are grouped by what each says it does. Missing one? Submit it free.