Kiln
Free desktop app and open-source library for building AI systems with evals, RAG, agents, fine-tuning and synthetic data in one workbench.
✨ Try AgentScout's free AI image generator →Good for: controlling a computer, building AI agents, data analysis, working with documents, evaluating agents, training and fine-tuning agents
Use cases
About Kiln
Kiln is listed in our evals & observability category and is aimed at builders. Free desktop app and open-source library for building AI systems with evals, RAG, agents, fine-tuning and synthetic data in one workbench. Pricing, as the maker states it: Source-available. Maturity: Mature. We last checked the official link on 2026-10-18.
Kiln ratings and reviews
Kiln alternatives
Other evals & observability tools in our directory. See all evals & observability tools →
Opik
Comet's open-source platform for tracing, evaluating and monitoring LLM apps, RAG systems and agent workflows, self-hosted or in the cloud.
BrowserGym
ServiceNow's Gym environment for building, testing and evaluating web agents across browser benchmarks.
ADR
Uber's Agentic AI Detection and Response system that secures employee and customer-facing AI agents with observability and threat detection.
Agent Memory Leaderboard
Public leaderboard and open evaluation protocol, run by a group of universities and labs, for comparing long-term memory systems for agents in recurring submission rounds.
MCPJam Inspector
Open-source testing and evals platform for MCP servers, MCP apps and ChatGPT apps across many clients and models.
AI-Infra-Guard
Tencent's AI red-teaming platform that scans agents, skills and MCP servers for risks.
Popular searches with this tool
🏆 Ranked in: Best AI Agent Observability & Eval Tools
Badge for makers
Built Kiln? Add this badge to your README or site. It links back to this page. About badges
