Rogue
Agent evaluator and red-team tool that probes your agent with test conversations and attacks and reports pass or fail against your policies.
Updated
✨ Try AgentScout's free AI image generator →Good for: writing code, evaluating agents, running code safely, agent security and safety, security testing
Use cases
About Rogue
Rogue is listed in our evals & observability category and is aimed at builders. Agent evaluator and red-team tool that probes your agent with test conversations and attacks and reports pass or fail against your policies. Pricing, as the maker states it: Open source. Maturity: Active. We last checked the official link on 2026-10-19.
Rogue at a glance
- Category: Evals & observability
- Built for: Developers and teams building with AI agents
- Pricing: Open source (as the maker states it)
- GitHub: rogue-security/rogue · 1,069 stars (as of Oct 19, 2026)
- Official site: qualifire.ai
- Listed on AgentScout: Oct 19, 2026
Rogue FAQ
What is Rogue?
Agent evaluator and red-team tool that probes your agent with test conversations and attacks and reports pass or fail against your policies.
How much does Rogue cost?
Rogue's pricing, as the maker states it: Open source. Open-source tools are free to use, though you may still pay for model API usage or a hosted plan. Check the official site for current plans.
Where can I find Rogue's source code?
On GitHub at rogue-security/rogue, which had 1,069 stars as of Oct 19, 2026.
What are alternatives to Rogue?
Similar tools include SWE-bench, Latitude, Kore.ai Autoloop, Galileo Agent Leaderboard, Judgeval and MCPJam Inspector.
Facts from our link-checked listing, the GitHub repository and the official site. See something wrong? Suggest an edit.
Rogue ratings and reviews
Rogue alternatives
Other evals & observability tools in our directory. See all evals & observability tools →
SWE-bench
Benchmark that tests whether language models and coding agents can resolve real GitHub issues, with multimodal and verified variants.
Latitude
Observability platform for AI agents that captures traces, groups failures into signals and verifies fixes against real traces.
Kore.ai Autoloop
Optimization engine in Kore.ai Agent Platform Artemis that evaluates agents against business goals, diagnoses failures from traces, applies targeted fixes, and re-verifies; GA Oct 2026.
Galileo Agent Leaderboard
Galileo's leaderboard that ranks how well LLMs perform as agents on tool use and multi-step tasks.
Judgeval
Open-source SDK for tracing agents and scoring them with agent judges, so failures in production can be found and fixes checked.
MCPJam Inspector
Open-source testing and evals platform for MCP servers, MCP apps and ChatGPT apps across many clients and models.
Popular searches with this tool
🏆 Ranked in: Best AI Agent Observability & Eval Tools
🧭 Task guides: Guardrail and policy tools for agent security · AI eval and benchmark tools
Badge for makers
Built Rogue? Add this badge to your README or site. It links back to this page. About badges
