AgentScout / Tasks / Research / Rag and documents

AI tools for research: RAG and documents

Retrieval tools that let agents search documents, PDFs and knowledge bases and answer from them (RAG). Of the 147 tools on our research page, 18 fit this narrower job. By pricing: 12 open source, 2 free or freemium, 1 paid, usage-based or enterprise, 3 pricing on the maker's site. The most-starred open repos here are Crawl4AI (85,667 stars), MindsHub (39,800 stars), ScrapeGraphAI (31,882 stars). Most come from the MCP & infra (9), research (4), browser/computer use (2) categories.

Crawl4AI logo

Crawl4AI

browser/computer useOpen source

Open-source crawler that turns websites into clean, LLM-ready Markdown for agents and RAG pipelines.

Added

MindsHub logo

MindsHub

NewproductivityOpen source + cloud

MindsDB's agent workspace for research, analysis, documents and coding, with a model router, a scoped vault for connected data and swappable open-source agent harnesses.

Added

ScrapeGraphAI logo

ScrapeGraphAI

Newbrowser/computer useOpen source + cloud

Python library that uses LLMs and graph logic to build scraping pipelines: describe the data you want and it extracts it from websites or documents.

Added

Chroma logo

Chroma

MCP & infraOpen source + cloud

Open-source search and vector database widely used for agent memory and RAG.

Added

txtai logo

txtai

NewframeworksOpen source

All-in-one Python framework for semantic search, LLM orchestration and agents built on an embeddings database of vector, graph and relational indexes.

Added

LanceDB logo

LanceDB

MCP & infraOpen source + cloud

Open-source multimodal vector database for search, RAG and agent memory.

Added

Activeloop logo

Activeloop

MCP & infraOpen source + cloud

Deep Lake, a multimodal database for AI that stores vectors, images, text and video so agents and RAG apps can search and retrieve them.

Added

LobsterAI logo

LobsterAI

personal agentsOpen source

NetEase Youdao's desktop agent for data analysis, slides, documents and web research.

Added

SimpleMem logo

SimpleMem

NewMCP & infraOpen source

Research-backed lifelong memory library for LLM agents that stores, compresses and retrieves text and multimodal memories, usable over MCP.

Added

seekdb logo

seekdb

MCP & infraOpen source

AI-native search database for agent storage combining vector, text and structured data.

Added

Claude Scientific Writer logo

Claude Scientific Writer

NewresearchOpen source

K-Dense's general-purpose scientific writing agent for Claude that drafts research papers and documents.

Added

MemFree logo

MemFree

NewresearchOpen source + cloud

Hybrid AI search engine that answers from your knowledge base and the web, and generates UI pages.

Added

Ref logo

Ref

MCP & infraFreemium

Token-efficient documentation search for coding agents.

Added

Lucid MCP logo

Lucid MCP

NewMCP & infraSee site

Lucid's MCP connector for creating, searching, editing and sharing Lucidchart and Lucid documents from AI tools.

Added

Altmetric MCP logo

Altmetric MCP

NewMCP & infraSee site

Altmetric's MCP server for tracking research attention across news, policy documents and social media.

Added

Brandfetch MCP logo

Brandfetch MCP

NewMCP & infraSee site

Brandfetch's MCP server for searching brands and retrieving logos, design assets and company data.

Added

Google Deep Review logo

Google Deep Review

NewresearchFreemium

Google Research's multi-agent system that checks research papers, design docs, and legal or financial documents for logical gaps and unsupported claims.

Added

Hebbia logo

Hebbia

researchEnterprise

AI platform for finance and legal teams that runs agents across large document sets.

Added

GitHub repos (14)

RepoGitHub starsLicenceLast push
Crawl4AI ↗85,667Apache License 2.02026-10-15
MindsHub ↗39,800MIT2026-09-10
ScrapeGraphAI ↗31,882——
Chroma ↗29,512Apache License 2.02026-10-17
txtai ↗13,024——
LanceDB ↗11,684Apache License 2.02026-10-16
Activeloop ↗9,252Apache License 2.02026-05-21
LobsterAI ↗6,119MIT2026-10-16
SimpleMem ↗3,836——
seekdb ↗3,157Apache License 2.02026-10-16
Claude Scientific Writer ↗2,491——
MemFree ↗1,515——
Ref ↗1,183MIT2026-09-28
Lucid MCP ↗3——

14 repos. Stars and licence come from each repo, checked when the listing was last verified.

FAQ

What are the best AI tools for research focused on RAG and documents?

We list 18. The first three by GitHub stars and featured status are Crawl4AI: Open-source crawler that turns websites into clean, LLM-ready Markdown for agents and RAG pipelines.; MindsHub: MindsDB's agent workspace for research, analysis, documents and coding, with a model router, a scoped vault for connected data and swappable open-source agent harnesses.; ScrapeGraphAI: Python library that uses LLMs and graph logic to build scraping pipelines: describe the data you want and it extracts it from websites or documents.

Are there free or open-source options?

Yes: 12 open source, 2 free or freemium, 1 paid, usage-based or enterprise, 3 pricing on the maker's site. Pricing is as each maker states it.

More from research

Tools are grouped by what each says it does. Missing one? Submit it free.

Get the best new AI agents, weekly

One short email with new tools, launches and what's worth trying. Free, unsubscribe anytime.