Key Takeaways
- Langfuse โ 33.9k GitHub stars, the largest open-source footprint here. Cloud Hobby is free with 50,000 units a month, 30 days of data access and 2 users; Core is $29/mo with 100,000 units and unlimited users; Pro is $199/mo with three years of retention; Enterprise is $2,499/mo. Self-hosting the open-source core is free and unlimited.
- A correction worth making: Langfuse is widely described as MIT-licensed with no feature gate. Its own README says the repository is "MIT licensed, except for the `ee` folders", and its self-host page lists nine Enterprise-only features โ server-side data masking, project-level RBAC, data retention management, SCIM, audit logs and more. Core observability and evals are genuinely free; governance features are not.
- Langfuse was acquired by ClickHouse, Inc. on 16 January 2026, announced alongside ClickHouse's $400M Series D. The repository LICENSE now reads "Copyright (c) 2023-2026 ClickHouse, Inc." That is not a reason to avoid it, but it is a roadmap consideration worth five minutes before you standardise on it.
- LangSmith โ Developer is free with up to 5,000 base traces a month and one seat. Plus is $39 per seat per month with up to 10,000 base traces, then usage-based billing at $1.50 per compute unit and $1.00 per storage unit. Enterprise is custom with self-hosted and hybrid options.
- Helicone โ a proxy rather than an SDK, so integration is one line and it captures every call without instrumentation. Hobby is free with 10,000 requests, 1 GB and 7-day retention; Pro is $79/mo with unlimited seats and 1-month retention; Team is $799/mo with SOC-2 and HIPAA and 3-month retention.
- Helicone is also open source, under Apache-2.0 with 6.1k stars โ a fact most comparisons miss. The nuance is that its pricing page sells on-prem only at Enterprise and documents no supported free self-host path, so the code being open does not mean the vendor supports you running it.
- PromptLayer โ the narrowest of the four. Free gives 2,500 requests a month, 5 users and 10 prompts; Pro is $49/mo with $0.003 per transaction overage; Team is $500/mo with 100,000+ requests and 25 users. Self-hosting on GCP, AWS or Azure is Enterprise-only.
- None of the four publishes a public affiliate or referral programme. LangChain runs a Partner Network, but that is a technology-integration programme, not a commission scheme. Every link on this page is unpaid.
๐ Best choice for your situation
The structural question is whether you instrument your code or put a proxy in front of it, and that decides what you can see. Read down and stop at the first line that describes you.
- You want flexibility and the option to self-host later โ Langfuse. Broadest integrations, free self-hosted core, and the lowest switching cost if your needs change โ but read the Enterprise feature list before assuming governance features are included.
- Your stack is LangChain or LangGraph โ LangSmith. Tracing is native and zero-config there, which no other tool matches for that specific ecosystem.
- You want observability today with no SDK rewrite โ Helicone. A proxy means one line of code, and cost data on every request by default.
- Cost sprawl across many keys and models is your actual pain โ Helicone. Per-request cost breakdowns are its core product, not a reporting tab bolted onto tracing.
- You only need prompt versioning and request logs โ PromptLayer. Free for 2,500 requests a month, and honest about being narrower than the other three.
- You are pre-production, a few dozen calls a day โ none of them. Provider dashboards and logs cover this, and you will reconfigure whatever you pick once real traffic arrives.
What LLM observability actually is
LLM observability captures and stores traces of your model calls โ prompts, completions, latency, token usage and cost โ so you can debug failures, spot quality regressions and watch spend in production. It is ordinary application observability extended to behaviour that is non-deterministic, where the same input can produce a different output and "it broke" often means "the output got worse", not "it threw".
That is a different job from evaluation. Observability watches what your system does after it ships; evaluation tells you whether a change is safe to ship in the first place. Many teams run both, and several of these tools do both, but the questions are distinct. For the pre-release half, see the best LLM evaluation tools.
๐ In One Sentence
LLM observability is the practice of capturing traces of model calls โ prompts, completions, latency, token usage and cost โ so teams can debug failures, detect quality regressions and monitor spend in production.
๐ฌ In Plain Terms
It is logging for something that answers differently each time. You are not just recording that a call happened; you are recording what went in, what came out, what it cost, and how long it took, so you can work out why quality moved.
Langfuse vs LangSmith vs Helicone vs PromptLayer
Each tool optimises a different point in the stack rather than competing feature for feature. Prices were read from each vendor's own pricing page on 28 August 2026, and repository figures from the GitHub API the same day.
| Criterion | Langfuse | LangSmith | Helicone | PromptLayer |
|---|---|---|---|---|
| Model | SDK tracer | SDK tracer | Proxy | SDK and REST logging |
| GitHub stars | 33.9k | Not open source | 6.1k | 0.8k (client lib) |
| Licence | MIT except ee/ folders | Commercial | Apache-2.0 | Commercial |
| Free tier | 50,000 units/mo, 30-day access | 5,000 traces/mo, 1 seat | 10,000 requests, 7-day | 2,500 requests, 10 prompts |
| Paid entry | Core $29/mo | Plus $39/seat/mo + usage | Pro $79/mo | Pro $49/mo |
| Free self-hosting | Yes, core features | No, Enterprise only | Code is open, not sold | No, Enterprise only |
| Compliance tier | Pro adds SOC2, ISO27001, BAA | Enterprise | Team $799 adds SOC-2, HIPAA | Enterprise |
| Affiliate programme | None found | None found | None found | None found |
โ ๏ธWarning: Comparisons routinely call Langfuse "the only open-source option here". Helicone is Apache-2.0 with 6.1k stars, so that is not accurate. What is accurate is that Langfuse documents and supports a free self-hosted deployment, while Helicone sells on-prem only at Enterprise and describes no supported free self-host path on its pricing page.
Langfuse: the flexible choice
Langfuse is the default recommendation because it has the broadest integration list, a genuinely free self-hosted core, and the lowest switching cost if you change your mind. It is also the one with the most caveats, and they are worth knowing before you commit.
Langfuse โ best overall
33.9k stars, free self-hosted core, broadest framework coverage
Langfuse covers observability, evals, prompt management and datasets in one product, and its integration list is the longest of the four: OpenAI SDK, LangChain, LlamaIndex, Haystack, LiteLLM, Vercel AI SDK, Ollama and Amazon Bedrock natively, with community integrations beyond that. For a mixed stack โ some LangChain, some raw SDK calls, LlamaIndex for retrieval โ that breadth means you instrument once rather than per framework. Cloud pricing is Hobby free with 50,000 units a month and 30 days of data access, Core at $29/mo with 100,000 units and unlimited users, Pro at $199/mo with three years of retention plus SOC2, ISO27001 and a BAA for HIPAA, and Enterprise at $2,499/mo. Overage is graduated, from $8 per 100,000 units down to $6 at volume. Self-hosting the open-source core is free and genuinely unlimited in usage.
Pros
- +Broadest native framework coverage of the four, so a mixed stack instruments once
- +Free self-hosted core with unlimited usage, deployable via Docker Compose, Kubernetes or cloud templates
- +Evals, datasets and prompt management included rather than sold separately
- +Lowest switching cost here, since the core is open and you can move your own deployment
Cons
- โNine features are Enterprise-only, including RBAC, audit logs and data masking โ see the self-hosting section
- โSelf-hosting means owning a Postgres plus self-managed ClickHouse deployment, which is real engineering time
- โNow owned by ClickHouse, which is a roadmap consideration even though the open-source commitment is public
LangSmith: the LangChain choice
If your application is built on LangChain or LangGraph, LangSmith traces it with no configuration at all, and nothing else matches that. Outside that ecosystem the argument weakens considerably.
LangSmith โ best for LangChain and LangGraph teams
Native zero-config tracing, $39/seat/mo plus usage-based units
LangSmith comes from the LangChain team, and inside LangChain or LangGraph the tracing is automatic โ you get step-level visibility into an agent run without writing instrumentation. Outside that ecosystem you use a `traceable()` wrapper around OpenAI or Anthropic SDK calls, which works but removes the main advantage. Pricing is a Developer tier at $0 per seat with up to 5,000 base traces a month and a single seat, Plus at $39 per seat per month with up to 10,000 base traces and one free small serverless deployment, and custom Enterprise with self-hosted and hybrid options. Beyond the included allowance, billing is usage-based at $1.50 per LangChain Compute Unit and $1.00 per Storage Unit. That is the part to model before committing: the bill scales with agent complexity and trace volume, not with headcount, so a team that adds LangGraph steps can see cost move independently of seats.
Pros
- +Zero-config tracing inside LangChain and LangGraph, unmatched for that stack
- +Mature dataset-driven evaluation and experiment tooling
- +Free Developer tier is enough for a solo developer prototyping
- +Enterprise offers self-hosted and hybrid deployment
Cons
- โUsage-based LCU and LSU billing makes the bill hard to predict as agent complexity grows
- โSelf-hosting is Enterprise-only with custom pricing
- โMuch weaker value proposition if you are not on LangChain
Helicone: the proxy choice
Helicone is structurally different from the other three: it sits in front of your API call as a proxy rather than inside your code as an SDK. That single decision explains both its biggest advantage and its main limitation.
Helicone โ fastest to adopt, best for cost visibility
One-line proxy integration, Apache-2.0, free for 10,000 requests then $79/mo
Because Helicone is a proxy, adopting it is a change of base URL rather than an instrumentation project, and it captures cost and request data on every call by default without you deciding what to trace. That makes it the fastest of the four to get value from, and it is why cost tracking is its strongest surface: per-request cost breakdowns and spend visibility across many keys and models are the core product rather than a reporting view layered on tracing. Hobby is free with 10,000 requests, 1 GB of storage and 7 days of retention; Pro is $79 a month with unlimited seats and one month of retention; Team is $799 a month adding SOC-2 and HIPAA compliance and three months of retention; Enterprise adds on-prem deployment, SAML SSO and unlimited retention. The code is Apache-2.0 with 6.1k stars, though the pricing page markets on-prem only at Enterprise.
Pros
- +One line to integrate โ no SDK rewrite, works with any OpenAI-compatible endpoint
- +Cost tracking is the core product, not a secondary reporting tab
- +Apache-2.0 licensed, which most comparisons of this category miss
- +Unlimited seats from the $79 Pro tier upward
Cons
- โA proxy sees requests and responses, not the internal steps of a multi-agent run
- โFree tier retains data only 7 days, the shortest here
- โOn-prem is sold at Enterprise despite the code being open source
PromptLayer: the lightweight choice
PromptLayer is narrower than the other three, and that is the point rather than a flaw. It does prompt versioning and request logging, and it does not pretend to be a full observability platform.
PromptLayer โ best when you only need prompt versioning
Free for 2,500 requests a month, Pro $49/mo
PromptLayer focuses on keeping a versioned history of your prompts alongside a log of the requests that used them, which is a real need that arrives before full observability does. The free tier gives 2,500 requests a month, 5 users and 10 prompts. Pro is $49 a month with 5 users and overage at $0.003 per transaction. Team is $500 a month with 100,000+ requests, 25 users and cheaper overage at $0.002. Self-hosting on GCP, AWS or Azure exists only on custom Enterprise. It is the only one of the four with no meaningful open-source presence: the public repository is a client library at 0.8k stars, not the platform. Treat it as a prompt management tool that logs, rather than an observability platform that also manages prompts.
Pros
- +Simplest of the four to understand and adopt
- +Prompt versioning is first-class rather than a feature of a bigger product
- +Free tier is workable for genuinely small workloads
- +Cheaper overage on Team at $0.002 per transaction
Cons
- โNo open-source platform โ the public repo is a client library only
- โSelf-hosting is Enterprise-only
- โThinnest framework integration list; lighter eval and dataset tooling than Langfuse or LangSmith
What the ClickHouse acquisition means for Langfuse
ClickHouse, Inc. acquired Langfuse on 16 January 2026, announced alongside ClickHouse's $400 million Series D led by Dragoneer. The acquisition was reported at the time by SiliconANGLE and confirmed on ClickHouse's own blog, in a Langfuse GitHub discussion, and by the law firm that advised on the deal.
The clearest evidence is in the repository itself: the LICENSE file now opens with "Copyright (c) 2023-2026 ClickHouse, Inc." The project remains actively developed and was pushed the day this page was checked.
There is a coherent logic to it. Langfuse already stored traces in ClickHouse, so the acquirer owns the database underneath the product rather than being an unrelated buyer. That is a better setup than most acquisitions in this category. The consideration is still worth naming: roadmap priorities after an acquisition follow the acquirer's commercial interest, and Langfuse self-hosted now depends on a company that also sells ClickHouse Cloud. The Enterprise self-hosted tier is explicitly bundled with ClickHouse Cloud or BYOC, with those costs additive.
๐Note: This is not a reason to avoid Langfuse โ the open-source core is MIT, actively maintained, and you can run it yourself. It is a reason to read the acquisition post before standardising a production stack on it, and to know that the paid self-hosted path routes through ClickHouse commercial plans.
Self-hosting and the Enterprise feature gate
Langfuse is the only one of the four that documents and supports a free self-hosted deployment โ but the widely repeated claim that there is no feature gate between free and paid is wrong. Langfuse's own self-host page lists nine capabilities as Enterprise-only: server-side data masking, project-level RBAC, data retention management, SCIM user provisioning, organization creators, UI customisation, audit logs, admin and instance management APIs, and protected deployment labels.
Read that list against who self-hosting is usually for. Teams choose to self-host because of data residency or regulatory pressure, and RBAC, audit logs and data masking are exactly what a regulated team needs. The free tier genuinely covers observability, evals, prompt management, datasets, tracing and cost tracking with unlimited usage. It does not cover governance.
The other three are more straightforward. LangSmith restricts self-hosting to Enterprise with custom pricing. PromptLayer offers single-tenant self-hosting on GCP, AWS or Azure at Enterprise only. Helicone is the interesting case: the code is Apache-2.0 and public, but the pricing page sells on-prem only at Enterprise and documents no supported free self-host path, so open source and supported self-hosting are not the same thing here.
โ ๏ธWarning: If you are self-hosting Langfuse specifically to satisfy a compliance requirement, check the Enterprise list before you build. Audit logs and project-level RBAC are frequently non-negotiable for the regulated teams most attracted to self-hosting, and both are gated.
How the pricing compares
All four bill on a hybrid model โ a seat or platform fee plus metered usage beyond an included quota โ so two teams on the same tier can get very different invoices. Volume drives the bill more than headcount does, with LangSmith the clearest example.
| Tier | Langfuse | LangSmith | Helicone | PromptLayer |
|---|---|---|---|---|
| Free | Hobby: 50,000 units, 2 users | Developer: 5,000 traces, 1 seat | Hobby: 10,000 requests | Free: 2,500 requests, 5 users |
| Free retention | 30 days data access | Not stated on pricing page | 7 days | Not stated on pricing page |
| Entry paid | Core $29/mo | Plus $39/seat/mo | Pro $79/mo | Pro $49/mo |
| Usage billing | $8 per 100,000 units, graduated | $1.50/LCU, $1.00/LSU | Usage-based beyond free quota | $0.003 per transaction |
| Mid tier | Pro $199/mo, 3-year retention | Enterprise custom | Team $799/mo | Team $500/mo |
| Compliance | Pro: SOC2, ISO27001, BAA | Enterprise | Team: SOC-2, HIPAA | Enterprise |
| Self-host cost | Free for core features | Enterprise only | Enterprise only | Enterprise only |
For a small team under roughly 50,000 to 100,000 events a month, expect either $0 on Langfuse self-hosted or Hobby, or $29 to $79 on Langfuse Core or Helicone Pro. Budget separately from your model token spend, which is usually larger.
๐กTip: Compare retention windows, not just free-tier size. Helicone keeps free data 7 days and Langfuse Hobby gives 30 days of access. A tool that looks generous on request volume can still force an upgrade the first time you need to investigate something from last month.
Which tool is best for cost tracking
Helicone is built around cost visibility, and the proxy architecture is why. Because every call passes through it, cost and token data are captured by default on every request without anyone deciding what to instrument โ so there are no blind spots from a service someone forgot to wrap.
Langfuse and LangSmith both track token usage and cost per trace as part of their broader observability data, which is sufficient for most teams. Neither presents cost management as a standalone product surface the way Helicone does. PromptLayer records cost per request but reports it through its logging views rather than a dedicated cost dashboard.
The honest framing is that this is a difference of emphasis, not capability. If you want to answer "which model and which key is burning our budget across twelve services", Helicone answers it fastest. If you want to answer "why did this agent run cost eleven dollars", an SDK tracer that sees the individual steps will serve you better.
Who should use what
Stack, data-residency requirements and team size decide this. Six profiles cover most readers.
- Solo developer prototyping on LangChain โ LangSmith Developer. The free 5,000 traces a month is plenty and tracing needs no setup.
- Small team wanting data residency control โ Langfuse self-hosted, with the Enterprise feature list checked first if RBAC or audit logs are required.
- Team running 10,000+ calls a day, not on LangChain โ Langfuse Cloud or Helicone. LangSmith's advantage does not apply to you and its usage billing will.
- Team whose pain is API cost sprawl โ Helicone Pro at $79/mo, where cost tracking is the product.
- Regulated industry needing SOC-2 or HIPAA โ Helicone Team at $799/mo or Langfuse Pro at $199/mo, which includes SOC2, ISO27001 and a BAA.
- Team that only needs prompt version control โ PromptLayer free or Pro, and revisit when regression testing becomes the need.
Observability in the EU, Japan and China
Observability traces contain the full prompt and completion, which means they contain whatever your users typed. That makes the hosted-versus-self-hosted decision a data-protection question in three major markets.
Common mistakes when choosing an observability tool
- 1Believing Langfuse self-hosted has no feature gate
Why it matters: Langfuse's own self-host page lists nine Enterprise-only features including project-level RBAC, audit logs and server-side data masking. Teams that self-host specifically for compliance often need exactly those, and discover the gap after the deployment is built. - 2Calling Langfuse the only open-source option
Why it matters: Helicone is Apache-2.0 with 6.1k stars. The accurate distinction is that Langfuse documents a supported free self-hosted deployment while Helicone sells on-prem at Enterprise, not that one is open and the other is not. - 3Reading LangSmith's $39 seat price as the whole bill
Why it matters: Plus adds usage-based billing at $1.50 per compute unit and $1.00 per storage unit on top of the seat. The bill scales with agent complexity and trace volume rather than headcount, so LangGraph-heavy teams can see cost move sharply without adding people. - 4Treating Helicone's proxy as equivalent to SDK tracing
Why it matters: A proxy captures the request and response but not the internal steps of a multi-agent run. If you need to see why an agent took a particular path, pair Helicone with a framework-native tracer rather than expecting it to cover both. - 5Comparing free tiers without comparing retention
Why it matters: Helicone's free tier keeps data 7 days and Langfuse Hobby gives 30 days of access. A generous request quota with a short window still forces an upgrade the first time you investigate a regression from last month.
Skip this ifโฆ
If you are still prototyping โ a few dozen manual calls a day, no production traffic, nobody else who needs to see the traces โ skip all four and use the provider dashboards. The OpenAI usage page and the Anthropic console already show you spend and request volume, and print statements cover the rest at that scale.
The threshold worth waiting for is concrete: real users generating traffic you did not personally trigger, or a second person who needs to answer "what did it do" without asking you. Both are visibility problems, and that is what these tools sell. Adopting one before then means configuring a platform against usage patterns you have not discovered yet, and most teams reconfigure it once real traffic arrives anyway.
๐กTip: A useful trigger: adopt observability the first time you cannot answer "why did that response look wrong" from memory or logs. That question is the product, and it only starts being asked once traffic is real.
Frequently asked questions
What is LLM observability?
It is the practice of capturing and analysing traces of LLM calls โ prompts, completions, latency, token usage and cost โ so teams can debug failures, detect quality regressions and monitor spend in production. It extends ordinary application observability to behaviour that is non-deterministic, where the same input can produce different output and failure often means degraded quality rather than an error.
Is Langfuse really free to self-host?
Yes for the core product, with an important caveat. The self-hosted core is MIT-licensed with unlimited usage and covers observability, evals, prompt management, datasets and cost tracking. But Langfuse's own self-host page lists nine Enterprise-only features, including project-level RBAC, audit logs, server-side data masking, data retention management and SCIM. Core functionality is free; governance features are not.
Was Langfuse acquired by ClickHouse?
Yes, on 16 January 2026, announced alongside ClickHouse's $400 million Series D led by Dragoneer. The repository LICENSE now reads "Copyright (c) 2023-2026 ClickHouse, Inc." The project remains actively developed and MIT-licensed at its core. There is some logic to the pairing, since Langfuse already stored traces in ClickHouse.
How much does LangSmith cost?
The Developer tier is free with up to 5,000 base traces a month and one seat. Plus is $39 per seat per month with up to 10,000 base traces and one free small serverless deployment. Beyond that it is usage-based at $1.50 per LangChain Compute Unit and $1.00 per Storage Unit. Enterprise is custom-priced with self-hosted and hybrid options.
LangSmith or Langfuse if I already use LangChain?
LangSmith if you want the most seamless zero-config experience inside LangChain and LangGraph specifically and managed hosting is fine. Langfuse if you are on LangChain today but want the option to self-host later, or if you also use LlamaIndex, Haystack or raw SDK calls โ its LangChain integration is a first-class SDK, not a fallback.
Is Helicone open source?
Yes, under Apache-2.0 with about 6,100 GitHub stars, which many comparisons of this category miss. The nuance is that Helicone's pricing page sells on-prem deployment only at the Enterprise tier and documents no supported free self-hosted path, so the code being open does not mean the vendor supports you running it yourself.
Do any of these have affiliate programmes?
We found no public affiliate or referral programme on any of the four vendors' own sites. LangChain runs a Partner Network, but that is a technology and integration partner programme rather than a commission scheme, and there is a separate LangSmith for Startups credit programme. PromptQuorum earns nothing from any link on this page.
What is the difference between observability and evaluation?
Observability watches live traffic after release and tells you what the system is doing now. Evaluation runs a fixed dataset before you ship and tells you whether a change improved or regressed quality. Several of these tools do both, but the questions are distinct โ see the best LLM evaluation tools for the pre-release half.
Final verdict
- Use Langfuse if you want the broadest integrations and the option to self-host โ next step: start on the free Hobby tier or a Docker Compose deployment, and check the Enterprise feature list if you need RBAC or audit logs.
- Use LangSmith if your stack is LangChain or LangGraph โ next step: start on the free Developer tier and model your compute and storage unit usage before upgrading to Plus, since the seat price is not the whole bill.
- Use Helicone if cost visibility is the pain and you want it working today โ next step: point one service at the proxy on the free tier and confirm the cost data matches your provider invoice.
- Use PromptLayer if prompt versioning is the actual requirement โ next step: use the free tier and move to Langfuse or LangSmith when you need dataset-driven regression testing.
- Skip all four if you are pre-production โ next step: use provider dashboards and revisit when someone other than you needs to see what the system did.