Guardrail and policy tools for monitoring agents in production
Guardrails, policy engines and permission layers that limit what agents are allowed to do. Of the 58 tools on our monitoring agents in production page, 8 fit this narrower job. By pricing: 7 open source, 1 source-available. The most-starred open repos here are LiteLLM (62,146 stars), Failproof AI (6,765 stars), coucou (6,596 stars). Most come from the agent infra (2), security & governance (2), MCP servers (2) categories.
Updated
LiteLLM
Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.
Added
Failproof AI
Observability and policy enforcement for AI agent harnesses.
Added
coucou
Mac notch and phone companion that monitors your Claude Code, Codex, Cursor and Gemini CLI sessions and lets you approve permissions on the go.
Added
Metorial
Open-source identity and access layer that connects AI agents to 1,200+ integrations via MCP, CLI or API with auth, permissions and observability.
Added
ToolHive
Stacklok platform that runs MCP servers in isolated containers with per-request identity, access policy and observability.
Added
OpenAPPA
OpenAPPA is a deterministic guardrail that sits between an AI agent and its tools and tracks how data flows across tool calls, instead of asking a second model to judge each call. Policies decide whether untrusted or sensitive data may reach a given action, which blocks data exfiltration caused by prompt injection or hallucination while letting agents finish their tasks. It plugs into Claude Code, Pi, OpenCode, kAgent and Archestra, comes with reusable policy "batteries", validation, observability and reporting, and is backed by a NeurIPS workshop paper with published benchmarks. It is in preview as an open RFC.
Added
LightAgent
LightAgent: Lightweight Python framework for OpenAI-compatible agents with tools, memory, guardrails, tracing, lifecycle hooks, multi-agent collaboration, and workflows
Added
NVIDIA Open Agent Safety Platform
Reference stack pairing OpenShell with NVIDIA Sentry on BlueField-4 DPUs for hardware-level agent monitoring.
Added
GitHub repos (7)
| Repo | GitHub stars | Licence | Last push |
|---|---|---|---|
| LiteLLM ↗ | 62,146 | MIT | 2026-10-27 |
| Failproof AI ↗ | 6,765 | MIT | 2026-10-27 |
| coucou ↗ | 6,596 | MIT | 2026-10-23 |
| Metorial ↗ | 3,369 | — | 2026-10-27 |
| ToolHive ↗ | 2,313 | Apache 2.0 | 2026-10-27 |
| OpenAPPA ↗ | 1,608 | — | 2026-10-23 |
| LightAgent ↗ | 1,240 | — | — |
7 repos. Stars and licence come from each repo, checked when the listing was last verified.
FAQ
What are the best AI tools for monitoring agents in production focused on guardrails and policies?
We list 8. The first three by GitHub stars and featured status are LiteLLM: Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.; Failproof AI: Observability and policy enforcement for AI agent harnesses.; coucou: Mac notch and phone companion that monitors your Claude Code, Codex, Cursor and Gemini CLI sessions and lets you approve permissions on the go.
Are there free or open-source options?
Yes: 7 open source, 1 source-available. Pricing is as each maker states it.
More from monitoring agents in production
Tools are grouped by what each says it does. Missing one? Submit it free.