Best AI agents for evaluating agents (2026)
Evaluation tools for scoring agent outputs, catching regressions and comparing prompts and models. We list 51 tools for evaluating agents below, each with a link-checked page, pricing as the maker states it and alternatives.
MLflow
Open-source platform for tracing, evaluating and managing agents, LLM apps and ML models.
Arize Phoenix
Open-source tracing and evaluation for LLM apps.
Guardrails AI
Open-source framework for validating LLM inputs and outputs with configurable guardrails.
AI-Infra-Guard
Tencent's AI red-teaming platform that scans agents, skills and MCP servers for risks.
Agent Governance Toolkit
Microsoft toolkit for policy enforcement, identity and sandboxing for AI agents.
Failproof AI
Observability and policy enforcement for AI agent harnesses.
Agenta
Open-source LLMOps platform for prompt management, evaluation and observability.
TruLens
Evaluation and tracking for LLM experiments and AI agents.
Snyk Agent Scan
Snyk's scanner for security risks in MCP servers and agent skills.
OpenLIT
Open-source platform to trace, evaluate and guard agents and LLM apps.
Galileo Agent Leaderboard
Galileo's leaderboard that ranks how well LLMs perform as agents on tool use and multi-step tasks.
AgentOps
Monitoring and session replay for AI agents.
Basalt
Captures customer behavior so your AI agent can learn and improve from real interactions.
Braintrust
Evals and observability platform for AI products.
CoreWeave Forge
One product to run, observe, evaluate and post-train agents (W&B, OpenPipe, sandboxes).
Hamming AI
Testing and QA platform for voice and chat agents that generates scenarios and replays real calls.
Helicone
Open-source LLM observability and gateway.
Kore.ai Autoloop
Optimization engine in Kore.ai Agent Platform Artemis that evaluates agents against business goals, diagnoses failures from traces, applies targeted fixes, and re-verifies; GA Oct 2026.
Langfuse
Open-source LLM observability, tracing and evals.
LangSmith
Tracing, evals and monitoring for LLM apps and agents.
Respan
Observability and evaluation platform for LLM apps and agents.
Token Security
Security for non-human and AI agent identities.
W&B Weave
Weights & Biases toolkit for tracing and evaluating agents.
Zenity
Security and governance for AI agents across enterprise platforms.
Beads
Issue-tracking memory for coding agents so they can keep track of long-running work.
Oumi
Open platform for fine-tuning, evaluating and deploying open agentic LLMs and VLMs.
Yao
Workspace for running and tracking all your agents and tasks across devices.
Unstract
LLM-powered platform for extracting structured data from documents via APIs and ETL pipelines.
Mission Control
Self-hosted control plane for dispatching tasks to agents, reviewing runs and tracking spend.
agentgateway
Proxy for AI agents and MCP servers with security and observability.
Cloudflare MCP Servers
Cloudflare's collection of MCP servers for Workers, observability, DNS analytics and other Cloudflare services.
fast-agent
Framework to build, run and evaluate agents with strong MCP, ACP and A2A support.
abtop
htop-style monitor for Claude Code and Codex sessions and token use.
Accordio AI
Adds time tracking, contract signing, invoicing and payments to Claude through a free MCP connector.
aixbt
Autonomous agent tracking crypto narratives and mindshare from X.
Almanax
AI security agent that finds vulnerabilities in smart contracts.
Blockscope
AI on-chain investigator that decodes transactions, profiles wallets and traces stolen funds across 8 chains.
ChainGPT
Suite of crypto AI tools: chatbot, smart-contract generator and auditor.
Friends & Fables
AI game master for tabletop-style RPGs that plays with groups on Discord and the web, tracking characters, rules and world lore.
Giza
Self-custodial autonomous agents that evaluate markets and execute on-chain capital strategies (Giza World, ARMA).
Laika AI
Web3 browser extension for AI research, token and contract analysis, wallet monitoring and phishing detection.
New Relic MCP
New Relic's MCP server for querying metrics, logs, traces and alerts through an agent.
Nora
Deep-reasoning AI coding agent for building and securing Web3 apps and smart contracts.
NVIDIA Open Agent Safety Platform
Reference stack pairing OpenShell with NVIDIA Sentry on BlueField-4 DPUs for hardware-level agent monitoring.
Octane
Agentic security analysis that finds exploitable vulnerabilities in mission-critical code, including DeFi smart contracts.
Sherlock AI
Sherlock's AI auditor for smart-contract vulnerabilities.
Tavily
Search and extraction API tuned for agents.
TradeOS AI
Build AI trading agents from your own technical-analysis rules that monitor markets 24/7 and flag setups (stocks, forex, commodities; crypto secondary).
Wayfinder
Autonomous agents for cross-chain execution that you deploy, monitor and earn with, no scripting.
Cua
Open-source infrastructure for computer-use agents: sandboxes, drivers across operating systems and benchmarks.
Qodo
AI code review and testing agents that work in the IDE, the terminal and pull requests to catch issues before merge.
Related tasks
Tools are matched to tasks by category, use cases and what each tool says it does. Missing one? Submit it free.