AI tools for evaluating agents: evals and benchmarks
Evaluation tools that score agent outputs, catch regressions and compare prompts and models. Of the 110 tools on our evaluating agents page, 36 fit this narrower job. By pricing: 20 open source, 3 source-available, 5 free or freemium, 2 paid, usage-based or enterprise, 6 pricing on the maker's site. The most-starred open repos here are Cua (29,966 stars), MLflow (28,418 stars), Opik (22,700 stars). Most come from the evals & observability (23), frameworks (5), browser/computer use (2) categories.
Cua
Open-source infrastructure for computer-use agents: sandboxes, drivers across operating systems and benchmarks.
Added
MLflow
Open-source platform for tracing, evaluating and managing agents, LLM apps and ML models.
Added
Opik
Comet's open-source platform for tracing, evaluating and monitoring LLM apps, RAG systems and agent workflows, self-hosted or in the cloud.
Added
Arize Phoenix
Open-source tracing and evaluation for LLM apps.
Added
Oumi
Open platform for fine-tuning, evaluating and deploying open agentic LLMs and VLMs.
Added
Agents CLI
Google's CLI and skills that teach coding assistants to build, evaluate and deploy agents on Google Cloud and the Gemini platform.
Added
SWE-bench
Benchmark that tests whether language models and coding agents can resolve real GitHub issues, with multimodal and verified variants.
Added
Apache Maka
Incubating Apache agent harness and workspace that records everything it does and publishes benchmarked run results.
Added
Kiln
Free desktop app and open-source library for building AI systems with evals, RAG, agents, fine-tuning and synthetic data in one workbench.
Added
Agenta
Open-source LLMOps platform for prompt management, evaluation and observability.
Added
fast-agent
Framework to build, run and evaluate agents with strong MCP, ACP and A2A support.
Added
TruLens
Evaluation and tracking for LLM experiments and AI agents.
Added
EvoAgentX
Framework for building, evaluating and automatically evolving LLM agents and agentic workflows.
Added
OSWorld
Benchmark for multimodal computer-use agents on open-ended tasks in real desktop environments.
Added
OpenLIT
Open-source platform to trace, evaluate and guard agents and LLM apps.
Added
Qwen-UI-Agent
Tongyi foundation GUI agent model that operates mobile, computer and browser interfaces, trained and evaluated on real devices.
Added
MCPJam Inspector
Open-source testing and evals platform for MCP servers, MCP apps and ChatGPT apps across many clients and models.
Added
Future AGI
Open-source platform for evaluating, tracing, simulating and guarding LLM and AI agent applications, self-hostable or cloud.
Added
tRPC-Agent-Go
Go framework for production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation and OpenTelemetry.
Added
AIDE ML
Tree-search agent that drafts, debugs and benchmarks machine-learning code until a target metric is optimized.
Added
BrowserGym
ServiceNow's Gym environment for building, testing and evaluating web agents across browser benchmarks.
Added
Agent Memory Leaderboard
Public leaderboard and open evaluation protocol, run by a group of universities and labs, for comparing long-term memory systems for agents in recurring submission rounds.
Added
FiftyOne MCP Server
Voxel51's MCP server and skills that let AI agents load, explore, curate and evaluate computer vision datasets and run FiftyOne operators and the App from natural language.
Added
Arize AI
Agent observability and evaluation platform with tracing, evals and experiments for improving AI agents.
Added
Braintrust
Evals and observability platform for AI products.
Added
Confident AI
Enterprise platform for AI evals and observability that gives teams one standard for measuring and monitoring AI quality.
Added
CoreWeave Forge
One product to run, observe, evaluate and post-train agents (W&B, OpenPipe, sandboxes).
Added
Coval
Testing and evaluation platform for voice agents, with simulations, production evals and human QA.
Added
Giza
Self-custodial autonomous agents that evaluate markets and execute on-chain capital strategies (Giza World, ARMA).
Added
Hume AI
Voice AI company focused on emotionally intelligent speech, with voice-native evaluation and human judgment tooling for voice agents.
Added
Kore.ai Autoloop
Optimization engine in Kore.ai Agent Platform Artemis that evaluates agents against business goals, diagnoses failures from traces, applies targeted fixes, and re-verifies; GA Oct 2026.
Added
Langfuse
Open-source LLM observability, tracing and evals.
Added
LangSmith
Tracing, evals and monitoring for LLM apps and agents.
Added
Respan
Observability and evaluation platform for LLM apps and agents.
Added
W&B Weave
Weights & Biases toolkit for tracing and evaluating agents.
Added
YRIKKA Text-to-Model
YRIKKA's ORION workflow that turns a plain-language mission description and a few unlabeled images into generated training data, candidate models and an evaluated, selected vision model.
Added
GitHub repos (23)
| Repo | GitHub stars | Licence | Last push |
|---|---|---|---|
| Cua ↗ | 29,966 | MIT | 2026-10-18 |
| MLflow ↗ | 28,418 | Apache License 2.0 | 2026-10-18 |
| Opik ↗ | 22,700 | — | — |
| Arize Phoenix ↗ | 11,828 | Elastic License 2.0 (source-available) | 2026-10-17 |
| Oumi ↗ | 9,400 | Apache License 2.0 | 2026-10-15 |
| Agents CLI ↗ | 6,099 | — | — |
| SWE-bench ↗ | 6,044 | — | — |
| Apache Maka ↗ | 5,842 | — | — |
| Kiln ↗ | 5,195 | — | — |
| Agenta ↗ | 4,840 | MIT License, except ee/ directories (separate licence) | 2026-10-15 |
| fast-agent ↗ | 3,935 | Apache License 2.0 | 2026-10-17 |
| TruLens ↗ | 3,602 | MIT | 2026-10-16 |
| EvoAgentX ↗ | 3,385 | — | — |
| OSWorld ↗ | 3,217 | — | — |
| OpenLIT ↗ | 2,853 | Apache License 2.0 | 2026-10-15 |
Top 15 of 23 by stars. Stars and licence come from each repo, checked when the listing was last verified.
FAQ
What are the best AI tools for evaluating agents focused on evals and benchmarks?
We list 36. The first three by GitHub stars and featured status are Cua: Open-source infrastructure for computer-use agents: sandboxes, drivers across operating systems and benchmarks.; MLflow: Open-source platform for tracing, evaluating and managing agents, LLM apps and ML models.; Opik: Comet's open-source platform for tracing, evaluating and monitoring LLM apps, RAG systems and agent workflows, self-hosted or in the cloud.
Are there free or open-source options?
Yes: 20 open source, 3 source-available, 5 free or freemium, 2 paid, usage-based or enterprise, 6 pricing on the maker's site. Pricing is as each maker states it.
More from evaluating agents
Tools are grouped by what each says it does. Missing one? Submit it free.