Skip to main content
PromptQuorum
Home/Power Local LLM/Local Knowledge & Retrieval Tools Compared (2026): RAG, Document Chat, Vector Databases, Notes and Search
RAG & Document Chat

Local Knowledge & Retrieval Tools Compared (2026): RAG, Document Chat, Vector Databases, Notes and Search

·11 min read·By Hans Kuepper · Founder of PromptQuorum, multi-model AI dispatch tool · PromptQuorum
Read in:
🇺🇸en🇩🇪de🇫🇷fr🇯🇵ja🇨🇳zh🇪🇸es🇧🇷pt🇸🇦ar🇰🇷ko

The 41 local knowledge and retrieval tools in the PromptQuorum directory split into five kinds that should be compared separately: RAG frameworks and pipelines (13 tools), document and PDF chat apps (13), notes-app integrations (10), local search and research tools (7) and vector databases (4). Among the vector databases, 3 of 4 document hybrid search and 4 of 4 document metadata filtering; among RAG frameworks, 4 document a visual builder and 9 document local-LLM support. Use the comparison table below, and read each tool's own review before you install it.

Tools that let a local model work with your own documents fall into five different kinds — RAG frameworks and pipelines, document and PDF chat apps, vector databases, notes-app integrations, and local search and research tools — and no single feature list compares them fairly. This guide compares 41 free and freemium tools, one kind at a time, using a comparison table generated from the same data as each tool's own PromptQuorum review, so the table and the reviews cannot disagree.

This page contains links to third-party products for reference. PromptQuorum is not enrolled in any affiliate program — these are plain links that earn no commission. Clicking links and your next steps are entirely your own responsibility. These links do not represent any endorsement or verification by PromptQuorum.

Key Takeaways

  • 41 tools, five kinds: RAG frameworks and pipelines (13), document and PDF chat apps (13), notes-app integrations (10), local search and research tools (7) and vector databases (4). Several tools, such as Onyx, Karakeep and Surf, belong to more than one kind and appear in each.
  • The table is generated from each tool's record and checked against its official README or site; a dash means "not stated in the documentation", never "no".
  • GitHub marks the Flowise and h2oGPT repositories as archived (read-only) at the time of writing; check their reviews for the current status before you build on them.
  • Every tool name in the table links to its own PromptQuorum review, which is where installation steps and limits are covered.

📍 In One Sentence

Tools that let a local model work with your own documents are five different kinds — RAG frameworks, document chat apps, vector databases, notes integrations and local search — so the 41 tools in the PromptQuorum directory are compared within each kind, using a table generated from the same tool data as each tool's own review.

💬 In Plain Terms

Some tools are building blocks for developers, some are ready-made apps for chatting with your files, some store the vectors that make search work, and some plug into a notes app you already use. Comparing a database with a notes plugin on the same features makes no sense, so this guide compares like with like.

How We Compared

Each tool's facts — price, license, platforms, hardware needs and category-specific attributes — are stored once, in that tool's directory record. The comparison table below is generated from those records, and the tool's own review draws on the same record, so the two cannot state different values.

Category-specific attributes (for example local-LLM support or hybrid search) were taken from each project's official README or website and checked against the exact wording there. Where the documentation is silent, the table shows a dash rather than guessing; where a claim is qualified (roadmap only, an enterprise edition, a companion project, or a paid tier), the attribute is left out of the table and covered in the tool's review instead.

Only tools with their own PromptQuorum review are in the table. The comparison lists tools that run on your own hardware or that you self-host; it does not rank them, because the right one depends on your constraint.

Comparison Table

Choose a kind of tool below, then read across a row. Click a tool name to open its full PromptQuorum review.

ToolPriceLicensePlatformsRunsHardwareVersionVisual / drag-and-drop builderWorks with local LLMsAgent supportSeveral vector storesDocker / self-hostingLocal API serverReviewproduct link · disclosed
cogneeFreeApache-2.0—HybridCPU is enough——Yes——YesYesRead review →cognee
DifyFreemiumModified Apache 2.0Web, LinuxHybridCPU is enough—YesYesYes—YesYesRead review →Dify
FlowiseFreemiumApache-2.0WebHybrid——Yes—YesYesYesYesRead review →Flowise
HaystackFreeApache-2.0macOS, Windows, LinuxHybrid———YesYes—Yes—Read review →Haystack
Langchain-ChatchatFreeApache-2.0Linux, macOS, WindowsHybridVaries by modelv0.3.1—YesYesYesYesYesRead review →Langchain-Chatchat
LangflowFreeMITWebHybridCPU is enough—Yes—YesYesYesYesRead review →Langflow
LlamaIndexFreeMITmacOS, Windows, LinuxHybrid———YesYesYes——Read review →LlamaIndex
LongMemoryFreeApache-2.0macOS, Windows, LinuxHybridCPU is enoughv1.2.3——Yes—YesYesRead review →LongMemory
MaxKBFreemiumGPL-3.0Web, LinuxHybridCPU is enough——YesYes—Yes—Read review →MaxKB
OnyxFreemiumMIT (core) + Enterprise Edition proprietary …Web, LinuxHybrid———YesYes—YesYesRead review →Onyx
Self-hosted AI Starter KitFreeApache-2.0—LocalVaries by model—YesYesYes—Yes—Read review →Self-hosted AI Starter Kit
txtaiFreeApache-2.0macOS, Windows, LinuxLocalCPU is enough——YesYes—YesYesRead review →txtai
Vane (formerly Perplexica)FreeMITmacOS, Windows, LinuxHybridCPU is enough——Yes——YesYesRead review →Vane (formerly Perplexica)

"—" means the project's own documentation does not state it, not that the feature is missing. Values come from each project's official README or site and are re-checked when a tool's review is updated.

RAG Frameworks: What Differs

Document and PDF Chat: What Differs

Vector Databases: What Differs

  • Hybrid search. Milvus, Qdrant and Weaviate document hybrid keyword and vector search.
  • Metadata filtering. Chroma, Milvus, Qdrant and Weaviate document filtering by metadata.
  • Distributed deployment. Milvus, Qdrant and Weaviate document distributed or clustered deployment.
  • Docker and self-hosting. Milvus, Qdrant and Weaviate document Docker or self-hosted deployment.
  • Managed cloud. Chroma, Milvus, Qdrant and Weaviate document a hosted cloud offering as well as self-hosting.
  • License. Chroma, Milvus and Qdrant are Apache-2.0 and Weaviate's core is BSD-3-Clause, with some gated features under its own Weaviate License — see each tool's review for the details.

Notes Integrations: What Differs

Local Search and Research: What Differs

What This Comparison Cannot Tell You

  • It compares documented capabilities, not quality. It says nothing about how accurate the answers are, how fast indexing is, or how well a tool scales — PromptQuorum has not measured these for the listed tools.
  • Dashes are gaps in the documentation we checked, not negative findings. Some tools may support a feature their README does not mention.
  • Project status matters: GitHub marks the Flowise and h2oGPT repositories as archived (read-only) at the time of writing, which means no further development there. Check each tool's review before choosing it for a new project.
  • Tools change quickly. Each tool's review states the version it was checked against, and this guide is refreshed when a review is.

Frequently Asked Questions

What is the difference between a RAG framework, a document chat app and a vector database?

A RAG framework is a developer toolkit for building retrieval-augmented pipelines. A document chat app is a ready-made application for asking questions about your files. A vector database stores the numeric embeddings that make similarity search work and is usually one component inside the other two. They do different jobs, so they are compared separately.

What does a dash in the comparison table mean?

It means the project's own documentation does not state that attribute. It does not mean the feature is missing; check the tool's review or its repository.

Why does a tool appear more than once?

Some tools do more than one job — for example a search tool that also plugs into a notes app — so they are listed under each kind they belong to, with the attributes that apply to that kind.

Do any of these tools have an affiliate link?

No. PromptQuorum has no affiliate relationship with any tool in this comparison at the time of writing, and no link here earns a commission.

How often is this comparison updated?

It is refreshed twice a year and whenever one of the listed tools' reviews is updated, because the table is generated from the same data as those reviews.

Sources

  • Each tool's official README or website, listed in that tool's PromptQuorum review (linked from the comparison table).
  • PromptQuorum local AI app directory — the record each row of the table is generated from.
  • GitHub repository status (archived or active) for each listed project, checked when this guide was written.

← Back to Power Local LLM