Skip to main content
PromptQuorum
Home/Power Local LLM/Langchain-Chatchat Review 2026: Self-Hosted RAG and Agent Framework
RAG & Document Chat

Langchain-Chatchat Review 2026: Self-Hosted RAG and Agent Framework

Β·11 min readΒ·By Hans Kuepper Β· Founder of PromptQuorum, multi-model AI dispatch tool Β· PromptQuorum
Read in:
πŸ‡ΊπŸ‡ΈenπŸ‡©πŸ‡ͺdeπŸ‡«πŸ‡·frπŸ‡―πŸ‡΅jaπŸ‡¨πŸ‡³zhπŸ‡ͺπŸ‡ΈesπŸ‡§πŸ‡·ptπŸ‡ΈπŸ‡¦arπŸ‡°πŸ‡·ko

Langchain-Chatchat (formerly langchain-ChatGLM) is a free, open-source, self-hosted RAG and Agent application built on the LangChain framework, letting you run local knowledge-base question-answering against models like ChatGLM, Qwen, and Llama, or against cloud APIs. Developed by the chatchat-space GitHub organization and licensed under Apache-2.0, it has no paid tier β€” you install it yourself via pip or Docker and run it on your own hardware or server, choosing which model backend to connect. The project has over 38,600 GitHub stars, though its release cadence has slowed since its most recent tagged version, v0.3.1, shipped in July 2024.

Langchain-Chatchat (github.com/chatchat-space/Langchain-Chatchat) is a free, open-source, self-hosted RAG and Agent application built on the LangChain framework, formerly named langchain-ChatGLM before its August 2023 rename. It runs local knowledge-base question-answering against models such as ChatGLM, Qwen, and Llama through pluggable backends, or against cloud APIs, and has over 38,600 GitHub stars. This review covers what it does, its version history, how to install it, and how it compares to other self-hosted RAG tools.

Key Takeaways

  • Langchain-Chatchat (github.com/chatchat-space/Langchain-Chatchat) is a free, open-source, self-hosted RAG and Agent application built on the LangChain framework β€” not a downloadable end-user app
  • Formerly named langchain-ChatGLM; renamed to Langchain-Chatchat in August 2023 as its model support broadened beyond ChatGLM
  • Apache-2.0 licensed, confirmed via the GitHub repository's LICENSE file
  • Supports ChatGLM, Qwen, Llama, and other models through pluggable backends β€” Xinference, Ollama, LocalAI, FastChat, One API β€” or cloud APIs
  • Over 38,600 GitHub stars and 6,200+ forks, 26 open issues, as of this review (2026-09-18); the repository is not archived
  • Latest tagged GitHub release is v0.3.1 (July 12, 2024); most recent repository push was November 10, 2025 β€” a real gap between the newest commit activity and the latest version tag

πŸ“ In One Sentence

Langchain-Chatchat is a free, open-source, self-hosted RAG and Agent framework built on LangChain, formerly named langchain-ChatGLM, that runs local knowledge-base question-answering against models like ChatGLM, Qwen, and Llama, or against cloud APIs, with no paid tier.

πŸ’¬ In Plain Terms

Instead of paying for a hosted document-chat service, Langchain-Chatchat lets you install a free tool on your own server that reads your documents, breaks them into searchable chunks, and answers questions about them using an AI model you choose β€” a local one running on your own hardware, or a cloud API you connect with your own key.

πŸ“ŒNote: This review is the companion to Langchain-Chatchat's entry in the Local LLM Software Directory β€” see that page for how it compares at a glance to dozens of other local AI tools.

What Is Langchain-Chatchat?

Langchain-Chatchat is a free, open-source, self-hosted application for local knowledge-base retrieval-augmented generation (RAG) and Agent workflows, built on the LangChain framework. Its GitHub repository description states it is a RAG and Agent application based on LangChain and models including ChatGLM, Qwen, and Llama. It was originally released as langchain-ChatGLM around April 2023, built specifically around the ChatGLM-6B model, and renamed to Langchain-Chatchat in August 2023 as its model support broadened.

  • Product type: a self-hosted web application (Streamlit-based UI) plus a Python package and Docker image β€” not a downloadable end-user binary
  • Developer: the chatchat-space GitHub organization
  • Repository: github.com/chatchat-space/Langchain-Chatchat, created March 31, 2023
  • License: Apache-2.0, confirmed via the repository's LICENSE file
  • Scale: over 38,600 GitHub stars and 6,200+ forks, 26 open issues, as of this review (2026-09-18); the repository is not archived
  • Origin: a Chinese-origin open-source project with a bilingual (Chinese/English) README, originally built around the ChatGLM model family and now supporting Qwen, Llama, and other models via pluggable backends

Langchain-Chatchat's Project History and Version Milestones

Langchain-Chatchat has shipped through several architecture changes since its original ChatGLM-6B-only release in 2023, though its release cadence has slowed markedly since mid-2024.

  1. 1
    v0.1.0 β€” around April 2023: Original release as langchain-ChatGLM
    Why it matters: The project's starting point: a single-model, ChatGLM-6B-specific local knowledge-base question-answering application.
  2. 2
    Renamed to Langchain-Chatchat β€” August 2023, with v0.2.0 shipping FastChat integration
    Why it matters: Marked the project's shift from a ChatGLM-only tool to a broader, multi-model-backend framework.
  3. 3
    v0.2.5 β€” October 2023: Added Agent features
    Why it matters: Introduced agent-style, tool-using workflows alongside the original RAG question-answering pipeline.
  4. 4
    v0.2.8 β€” December 1, 2023
    Why it matters: Incremental tagged release in the v0.2.x line.
  5. 5
    v0.2.9 β€” December 31, 2023
    Why it matters: Incremental tagged release closing out 2023.
  6. 6
    v0.2.10 β€” January 25, 2024
    Why it matters: Final release in the v0.2.x line before the v0.3.0 architecture change.
  7. 7
    v0.3.0 β€” June 20, 2024: Described in the project's own changelog as a "new architecture"
    Why it matters: A significant internal rework of the application's architecture.
  8. 8
    v0.3.1 β€” July 12, 2024: The most recent tagged GitHub release found by this review
    Why it matters: This is the newest version tag as of this review β€” no newer tagged release has been found.

What Does Langchain-Chatchat Actually Do?

Langchain-Chatchat's core feature is a local knowledge-base RAG pipeline: it splits your documents into chunks, converts them into vector embeddings, retrieves the most relevant chunks for a given question by similarity search, and passes them to an LLM to generate an answer.

  • Local knowledge-base RAG pipeline: text splitting β†’ vectorization β†’ similarity matching β†’ LLM response generation
  • Agent support, particularly optimized for ChatGLM3 and Qwen models, for tool-using and multi-step workflows
  • Multiple pluggable model-serving backends: Xinference, Ollama, LocalAI, FastChat, and "One API" integration, so you can choose which inference server runs your model
  • Multimodal support: image dialogue and text-to-image capabilities
  • Database/SQL dialogue ("chat with your database") functionality for querying structured data in natural language
  • Web UI built with Streamlit, supporting multiple simultaneous conversations

Usage Examples: Three Ways to Use Langchain-Chatchat

These are concrete workflows built from Langchain-Chatchat's documented features above β€” not hypothetical use cases.

Is Langchain-Chatchat Free?

Yes β€” Langchain-Chatchat is free and open source, with no separate paid tier found by this review. It is licensed under Apache-2.0, confirmed via the repository's LICENSE file, and this review found no vendor-run hosted/cloud version of the tool β€” you install and run it yourself.

  • No subscription, license fee, or usage cap imposed by Langchain-Chatchat itself
  • Self-hosted: you provide your own server/hardware and pay only for that infrastructure, plus any cloud model API costs if you choose a cloud backend instead of a local model
  • Apache-2.0 license permits commercial use, modification, and redistribution, subject to the license's standard attribution and notice terms

Langchain-Chatchat vs. RAGFlow

Langchain-Chatchat and RAGFlow are both self-hosted, open-source RAG applications, but they take different approaches to how they process and answer questions about your documents.

Primary focus

Langchain-Chatchat:
Local knowledge-base RAG and Agent workflows built directly on the LangChain framework
RAGFlow:
Document understanding-focused RAG β€” see the dedicated RAGFlow review for verified details

Model backend flexibility

Langchain-Chatchat:
Pluggable backends: Xinference, Ollama, LocalAI, FastChat, One API, or cloud APIs
RAGFlow:
See the RAGFlow review for its own backend support

Multimodal support

Langchain-Chatchat:
Image dialogue and text-to-image capabilities
RAGFlow:
See the RAGFlow review for details

SQL/database chat

Langchain-Chatchat:
Yes β€” dedicated chat-with-your-database functionality
RAGFlow:
See the RAGFlow review for details

Maintenance cadence

Langchain-Chatchat:
Latest tagged release v0.3.1 (July 2024); most recent repository push November 2025
RAGFlow:
See the RAGFlow review for its current release cadence

License

Langchain-Chatchat:
Apache-2.0
RAGFlow:
See the RAGFlow review for its license

This table reflects Langchain-Chatchat's own verified facts; for RAGFlow's specific claims, read the RAGFlow review directly rather than relying on this summary alone.

Who Should Use Langchain-Chatchat?

Whether Langchain-Chatchat fits depends on whether you want a free, self-hosted RAG and Agent framework built on LangChain, and whether its slower recent release cadence is acceptable for your use case.

Competitors and Alternatives

Langchain-Chatchat sits in the self-hosted RAG and document-chat segment alongside RAGFlow, LlamaIndex, Haystack, and MaxKB.

RAGFlow

Best known for:
Self-hosted RAG with deep, layout-aware document understanding
Link:
RAGFlow review
Articles about RAGFlow (4)

Also mentioned in:

Haystack (deepset)

Best known for:
Open-source RAG and search-pipeline framework from deepset
Link:
Haystack review

MaxKB

Best known for:
Self-hosted knowledge-base Q&A platform, also Chinese-origin
Link:
MaxKB review
Articles about MaxKB (3)

Also mentioned in:

This list reflects tools commonly compared to Langchain-Chatchat in the self-hosted RAG/document-chat segment, not an independent PromptQuorum ranking β€” see the Local LLM Software Directory for the full catalog, and verify each tool's current feature set and license before choosing.

Common Mistakes When Evaluating Langchain-Chatchat

Most confusion about Langchain-Chatchat comes from its naming history, assumptions about its release cadence, or its relationship to the LangChain framework it is built on.

Frequently Asked Questions

What is Langchain-Chatchat?

Langchain-Chatchat (github.com/chatchat-space/Langchain-Chatchat) is a free, open-source, self-hosted RAG and Agent application built on the LangChain framework, formerly named langchain-ChatGLM before its August 2023 rename.

Is Langchain-Chatchat free?

Yes. It is licensed under Apache-2.0, and this review found no separate paid tier, managed cloud offering, or commercial support plan.

How do I install Langchain-Chatchat?

Via pip (pip install langchain-chatchat -U, or `pip install "langchain-chatchat[xinference]" -U for the Xinference backend) or Docker (docker pull chatimage/chatchat`). The project's own documentation strongly recommends docker-compose deployment for production use.

What license does Langchain-Chatchat use?

Apache-2.0, confirmed via the GitHub repository's LICENSE file.

What models and backends does Langchain-Chatchat support?

ChatGLM, Qwen, Llama, and other models through pluggable backends β€” Xinference, Ollama, LocalAI, FastChat, and "One API" integration β€” or cloud APIs.

Is Langchain-Chatchat actively maintained?

This review found a gap between its most recent tagged release (v0.3.1, July 12, 2024) and its most recent repository push (November 10, 2025), roughly 16 months apart. There is ongoing commit activity, but the release cadence has slowed substantially since mid-2024 β€” verify current status directly on GitHub.

What is the difference between Langchain-Chatchat and LangChain itself?

Langchain-Chatchat is built on top of the LangChain framework but is a separate, standalone RAG and Agent application with its own repository, UI, and feature set β€” not the general-purpose LangChain library itself.

Does Langchain-Chatchat support Chinese language and ChatGLM?

Yes. The project was originally built around the ChatGLM model family (under the earlier name langchain-ChatGLM), has a bilingual Chinese/English README, and remains a Chinese-origin open-source project.

Does Langchain-Chatchat support SQL/database chat?

Yes, it includes a dedicated chat-with-your-database functionality for querying structured data in natural language.

Who maintains Langchain-Chatchat?

The chatchat-space GitHub organization maintains the project's canonical repository.

Sources

← Back to Power Local LLM