Free AI testing agents (2026)

AI testing agents that you can use without paying: open-source projects plus tools with a free plan. Here are all 15 from the AgentScout directory.

How we picked and ranked: tools are matched by category, the pricing each maker states and what each tool says it does. They are ranked by GitHub stars as recorded on each listing (link checks 2026-10-18); tools without a tracked repo follow, by listing maturity. No paid placements.

1. S

   1. Strix

   codingOpen source + cloud★ 69,022 GitHub stars

   Open-source AI agents that run penetration tests on your app to find and help fix security vulnerabilities.

   Pricing (as stated): Open source + cloud · Mature

2. G

   2. Goose

   codingOpen source★ 55,347 GitHub stars

   Extensible open-source AI agent that installs, runs, edits and tests code on your machine with any LLM and MCP extensions.

   Pricing (as stated): Open source · Mature

3. P

   3. PentAGI

   codingOpen source★ 30,728 GitHub stars

   Autonomous multi-agent system for running penetration testing tasks.

   Pricing (as stated): Open source · Mature

4. M

   4. Midscene.js

   browser/computer useOpen source★ 15,311 GitHub stars

   Vision-driven UI automation and E2E testing framework where a GUI agent carries out natural-language steps on web, mobile and desktop apps.

   Pricing (as stated): Open source · Mature

5. Q

   5. Qodo

   codingFreemium★ 13,415 GitHub stars

   AI code review and testing agents that work in the IDE, the terminal and pull requests to catch issues before merge.

   Pricing (as stated): Freemium · Mature

6. M

   6. MCP Inspector

   MCP & infraOpen source★ 11,095 GitHub stars

   Official developer tool for testing and debugging MCP servers through a web UI, CLI or terminal UI.

   Pricing (as stated): Open source · Mature

7. M

   7. MobileBuildMCP

   codingOpen source★ 6,488 GitHub stars

   Sentry's MCP server and CLI that gives coding agents build, test and run tools for iOS and macOS projects.

   Pricing (as stated): Open source · Mature

8. S

   8. SWE-bench

   evals & observabilityOpen source★ 6,044 GitHub stars

   Benchmark that tests whether language models and coding agents can resolve real GitHub issues, with multimodal and verified variants.

   Pricing (as stated): Open source · Mature

9. U

   9. Unity MCP

   MCP & infraOpen source★ 4,482 GitHub stars

   MCP tools and CLI that let AI agents develop and test inside the Unity engine.

   Pricing (as stated): Open source · Active

10. P

    10. PentestAgent

    codingOpen source★ 3,188 GitHub stars

    Agent framework for black-box security testing and bug bounty work.

    Pricing (as stated): Open source · Active

11. N

    11. NitroStack

    MCP & infraOpen source + cloud★ 2,524 GitHub stars

    TypeScript framework with decorators and dependency injection for building, testing and deploying MCP servers and MCP apps, with a companion desktop studio.

    Pricing (as stated): Open source + cloud · Active

12. S

    12. Shippie

    codingOpen source★ 2,510 GitHub stars

    Extendable code review and QA agent that reads your diff, explores the codebase and posts focused review comments.

    Pricing (as stated): Open source · Active

13. R

    13. ripwire

    codingOpen source★ 2,455 GitHub stars

    Zero-dependency CLI and MCP server that gives coding agents a ranked call graph, blast radius and tests-to-run before and after edits.

    Pricing (as stated): Open source · Active

14. T

    14. Testkube MCP

    MCP & infraOpen source★ 1,669 GitHub stars

    Testkube MCP server for managing test workflows and executions.

    Pricing (as stated): Open source · Active

15. B

    15. BrowserGym

    evals & observabilityOpen source★ 1,407 GitHub stars

    ServiceNow's Gym environment for building, testing and evaluating web agents across browser benchmarks.

    Pricing (as stated): Open source · Active

FAQ

What are the best free AI testing agents?

Ranked by tracked GitHub stars, the top free AI testing agents in our directory are Strix, Goose, PentAGI, Midscene.js, Qodo. Stars measure popularity, not fit, so compare a few against your own task.

How many free AI testing agents does AgentScout list?

15 tools match. This page shows the top 15. Pricing mix on this page: Open source (12), Open source + cloud (2), Freemium (1).

Are these tools really free?

Pricing is what each maker states on their site. Open-source tools are free to self-host but may need a paid model API key or offer paid cloud plans; freemium tools have a free plan with limits. Check each official site.

Where can I see every tool for testing apps?

Our task page lists all 29 tools we match to testing apps.

Related: All tools for testing apps · coding (8) · MCP & infra (4) · evals & observability (2) · browser/computer use (1)

By role: For QA engineers

All popular searches · AI agents by role · Free tools

Best-of lists: Cursor alternatives · All best lists

Facts come from our directory listings; pricing is as each maker states it and can change. Check official sites before you choose.