Evals & observability AI agent tools
24 evals & observability tools in the AgentScout directory, each with a link-checked listing.
Guardrails AI
Open-source framework for validating LLM inputs and outputs with configurable guardrails.
Zenity
Security and governance for AI agents across enterprise platforms.
Respan
Observability and evaluation platform for LLM apps and agents.
Token Security
Security for non-human and AI agent identities.
MLflow
Open-source platform for tracing, evaluating and managing agents, LLM apps and ML models.
AI-Infra-Guard
Tencent's AI red-teaming platform that scans agents, skills and MCP servers for risks.
Agent Governance Toolkit
Microsoft toolkit for policy enforcement, identity and sandboxing for AI agents.
Failproof AI
Observability and policy enforcement for AI agent harnesses.
Agenta
Open-source LLMOps platform for prompt management, evaluation and observability.
TruLens
Evaluation and tracking for LLM experiments and AI agents.
OpenLIT
Open-source platform to trace, evaluate and guard agents and LLM apps.
Snyk Agent Scan
Snyk's scanner for security risks in MCP servers and agent skills.
Basalt
Captures customer behavior so your AI agent can learn and improve from real interactions.
Hamming AI
Testing and QA platform for voice and chat agents that generates scenarios and replays real calls.
Galileo Agent Leaderboard
Galileo's leaderboard that ranks how well LLMs perform as agents on tool use and multi-step tasks.
Kore.ai Autoloop
Optimization engine in Kore.ai Agent Platform Artemis that evaluates agents against business goals, diagnoses failures from traces, applies targeted fixes, and re-verifies; GA Oct 2026.
CoreWeave Forge
One product to run, observe, evaluate and post-train agents (W&B, OpenPipe, sandboxes).
LangSmith
Tracing, evals and monitoring for LLM apps and agents.
Langfuse
Open-source LLM observability, tracing and evals.
Braintrust
Evals and observability platform for AI products.
Arize Phoenix
Open-source tracing and evaluation for LLM apps.
W&B Weave
Weights & Biases toolkit for tracing and evaluating agents.
AgentOps
Monitoring and session replay for AI agents.
Helicone
Open-source LLM observability and gateway.
All categories
Facts come from our directory listings; pricing is as each maker states it. Check official sites before you choose.