AI agents for QA engineers (2026)

Testing agents, review bots and security scanners that help QA engineers find bugs before users do. We picked the top tools for 4 jobs QA engineers do every day: 19 tools in all, 18 of them free or with a free tier.

Jump to: Test your app · Review pull requests · Security testing · Evaluate AI features

Free tools from AgentScout for QA engineers: Prompt builder

How we picked: each section takes the tools matched to that task in our directory, putting tools whose category and stated use cases fit the task first, then ordering by tracked GitHub stars. No paid placements.

Test your app

Agents that write and run tests, click through your app and report what breaks. All 29 tools →

• Strix Open source + cloud
  Open-source AI agents that run penetration tests on your app to find and help fix security vulnerabilities. · ★ 69,022
• Goose Open source
  Extensible open-source AI agent that installs, runs, edits and tests code on your machine with any LLM and MCP extensions. · ★ 55,347
• PentAGI Open source
  Autonomous multi-agent system for running penetration testing tasks. · ★ 30,728
• Midscene.js Open source
  Vision-driven UI automation and E2E testing framework where a GUI agent carries out natural-language steps on web, mobile and desktop apps. · ★ 15,311
• Qodo Freemium
  AI code review and testing agents that work in the IDE, the terminal and pull requests to catch issues before merge. · ★ 13,415
• MCP Inspector Open source
  Official developer tool for testing and debugging MCP servers through a web UI, CLI or terminal UI. · ★ 11,095

Review pull requests

Agents that read diffs, leave review comments and catch bugs before a pull request is merged. All 13 tools →

• Open Code Review Open source
  Alibaba's AI code review CLI that combines deterministic pipelines with an LLM agent to post line-level comments on Git diffs, using OpenAI or Anthropic models. · ★ 47,560
• GitHub MCP Server Open source
  GitHub's official MCP server for letting agents work with repositories, issues, pull requests and Actions. · ★ 33,663
• Qodo Freemium
  AI code review and testing agents that work in the IDE, the terminal and pull requests to catch issues before merge. · ★ 13,415
• Open SWE Open source
  LangChain's asynchronous coding agent that takes work from GitHub issues, Slack or Linear, implements it in an isolated sandbox and opens a pull request. · ★ 11,034
• Shippie Open source
  Extendable code review and QA agent that reads your diff, explores the codebase and posts focused review comments. · ★ 2,510
• Roomote Freemium
  Cloud coding agent from the Roo Code team that runs your real dev environment, verifies its work, reviews code with a second model and hands back PRs with live previews; works from Slack, Teams, GitHub and Linear, self-hosted or on its cloud. · ★ 288

Security testing

Agents that probe your app, code and smart contracts the way an attacker would: running penetration tests, red-teaming AI systems and flagging vulnerabilities with suggested fixes. All 11 tools →

• Strix Open source + cloud
  Open-source AI agents that run penetration tests on your app to find and help fix security vulnerabilities. · ★ 69,022
• PentAGI Open source
  Autonomous multi-agent system for running penetration testing tasks. · ★ 30,728
• AI-Infra-Guard Open source
  Tencent's AI red-teaming platform that scans agents, skills and MCP servers for risks. · ★ 6,887
• Superagent Open source
  SDK for AI agent safety that blocks prompt injections and unsafe tool calls, redacts PII and secrets, and runs red-team scenarios. · ★ 6,766
• PentestAgent Open source
  Agent framework for black-box security testing and bug bounty work. · ★ 3,188
• Mantis Open source
  Google's toolkit for AI coding agents to autonomously find, reproduce and patch software vulnerabilities in isolated environments. · ★ 2,459

Evaluate AI features

Evaluation tools for scoring agent outputs, catching regressions and comparing prompts and models. All 104 tools →

• MLflow Open source + cloud
  Open-source platform for tracing, evaluating and managing agents, LLM apps and ML models. · ★ 28,418
• Opik Open source + cloud
  Comet's open-source platform for tracing, evaluating and monitoring LLM apps, RAG systems and agent workflows, self-hosted or in the cloud. · ★ 22,700
• Arize Phoenix Source-available
  Open-source tracing and evaluation for LLM apps. · ★ 11,828
• Guardrails AI Open source + cloud
  Open-source framework for validating LLM inputs and outputs with configurable guardrails. · ★ 7,529
• AI-Infra-Guard Open source
  Tencent's AI red-teaming platform that scans agents, skills and MCP servers for risks. · ★ 6,887
• Superagent Open source
  SDK for AI agent safety that blocks prompt injections and unsafe tool calls, redacts PII and secrets, and runs red-team scenarios. · ★ 6,766

Popular searches for QA engineers

AI code review tools for pull requests · Free AI testing agents · AI security testing and pentest agents

Other roles: Developers · AI engineers · Marketers · Sales teams · Customer support teams · Designers · Researchers · Data analysts · Crypto traders · Founders and small businesses · DevOps and SRE engineers · Security engineers · Game developers · Content creators · Data engineers · Product managers · Students · Operations teams · Startup CTOs · Agencies · Open-source maintainers · MCP developers · Automation engineers · E-commerce teams · All roles

Best-of lists for QA engineers: Cursor alternatives · Strix alternatives · All best lists

Facts come from our directory listings; pricing is as each maker states it and can change. Missing a tool? Submit it free.