Skip to main content
PromptQuorumBuilt for humans. Structured for AI.
Home/Local LLMs
Best Models

Qwen3.8-27B vs Llama 4 vs Mistral: Local LLM Comparison 2026

·9 min readBy · Founder of PromptQuorum · Discovery engine for open-weight & open-source AI

In this comparison, Qwen3.8-27B is the strongest all-rounder on consumer hardware: 61.7 SWE-bench Pro (best dense model), fits 24 GB at Q4. Llama 4 Scout adds 10M context and multimodal input but needs ~55 GB VRAM; Mistral Small 3.1 24B fits 14 GB.

Key Takeaways

  • Coding: Qwen3.8-27B leads SWE-bench (61.7% real-world, best dense model). For agentic coding: Mistral Devstral Small 2. For IDE autocomplete: Mistral Codestral 22B.
  • General reasoning: Llama 3.x is generally regarded as stronger in English and Qwen in multilingual tasks; compare the model cards for your use case.
  • Efficiency (quality per GB of RAM): Mistral Small 3.1 24B delivers near-70B quality at 14 GB RAM -- unchanged since April.
  • Languages beyond English: Qwen3 supports 29 languages natively; Llama and Mistral are primarily English-optimized.
  • MoE long-context (new in 2026): Llama 4 Scout (17B active / 109B total, 16 experts, multimodal) offers a 10M token context but needs ~55 GB VRAM at Q4 -- it does not fit a 24 GB consumer GPU at normal quants (only at 1.78-bit, ~20 tok/s).
  • Legacy models still relevant: Mistral Small 24B, Qwen3 14B, and Llama 3.1 8B remain widely deployed. The "Legacy Benchmark Reference" section below covers when to upgrade vs when to stay.

📍 In One Sentence

Qwen3.8-27B wins for coding on consumer hardware (61.7 SWE-bench Pro, fits 24 GB at Q4); Llama 4 Scout leads on long context and multimodal (10M context, MoE, ~55 GB at Q4).

💬 In Plain Terms

These are three of the most popular open-weights AI model families you can run locally. Qwen3 (by Alibaba) excels at coding, Llama 4 (by Meta) handles very long documents and images, and Mistral (French AI) offers efficient smaller models. All are free to download and run offline.

Qwen3.8-27B is the best overall on consumer hardware: 61.7 SWE-bench Pro (best dense model), fits 24 GB at Q4. Llama 4 Scout 17B (MoE, 10M context, multimodal) is the long-context / multimodal pick but needs ~55 GB VRAM at Q4; Mistral Small 3.1 24B still delivers the best quality-per-RAM ratio at 14 GB. Qwen3 excels at coding and 29 languages; Llama 4 Scout leads on context length (10M tokens) and multimodal; Mistral maximizes quality on constrained hardware. All three run on consumer hardware via Ollama.

Slide Deck: Qwen3.8-27B vs Llama 4 vs Mistral: Local LLM Comparison 2026

The slide deck below covers: Qwen3.8-27B vs Llama 4 Scout vs Mistral benchmark comparison (SWE-bench, MoE VRAM realities), which model wins by task (best overall on 24 GB, coding, multilingual, long-context, RAM efficiency), size-by-size comparison including MoE tier, Devstral for agentic coding, Codestral for IDE, and Ollama quick-start commands. Download the PDF as a local LLM model selection reference card.

Browse the slides below or download as PDF for offline reference. Download Reference Card (PDF)

Qwen3.8-27B vs Llama 4 vs Mistral: Local LLM Comparison 2026

•Info: 📌 Looking for the older comparison? Jump to Mistral 24B vs Qwen3 14B vs Llama 3.1 8B Legacy Benchmarks below.

Which Open-Weight Model Family Should You Choose?

Previous generation models (Qwen3, Llama 3.3) remain available on Ollama and are still widely used. This comparison focuses on current-generation models. Ready to run one? Full Qwen local setup guide →

Family
Developer
Current Releases
Licence
Qwen3AlibabaQwen3 (April 2025), Qwen 3.5 (multimodal), Qwen3.8-27B (SWE-bench 61.7%)Apache 2.0 (most sizes)
Llama 4MetaScout (17B active/109B MoE, 16 experts, 10M ctx, multimodal, ~55 GB VRAM Q4), Maverick (17B active/400B MoE), Legacy: 3.3 70BLlama Community (custom)
MistralMistral AISmall 3.1 (24B), Devstral Small 2 (agentic), Codestral 22B (FIM/IDE)Apache 2.0 (most sizes)

How Do These Models Compare on Benchmarks?

SWE-bench (real-world GitHub issue resolution) is the primary 2026 coding benchmark for practical coding evaluation. It tests multi-file changes, codebase understanding, and test writing. HumanEval (single-function Python) remains useful for comparison but is secondary. MMLU and MATH evaluate general knowledge and reasoning. Llama 4 Scout benchmarks are limited due to recent release and MoE complexity. Dashes indicate benchmarks not yet published or not applicable. Figures are indicative values reported by the vendors; check each model card. They are not PromptQuorum measurements. SWE-bench Pro and Verified are different variants and should not be compared directly.

Model
MMLU
SWE-bench
MATH
RAM (Q4_K_M)
Qwen3.8-27B—61.7 (Pro)—18 GB (24 GB card)
Llama 4 Scout 17B (MoE)———~55 GB
Llama 3.3 70B (legacy)82%—77%40 GB
Mistral Small 3.1 24B79%—65%14 GB
Devstral Small 2—65.8% (Verified)—15 GB
Qwen3 8B~75%—~55%5 GB
Mistral Small v0.364%—28%4.5 GB
Benchmark comparison: Qwen3.8-27B (61.7 SWE-bench Pro) leads dense coding and fits 24 GB at Q4. SWE-bench (real-world multi-file coding) is now more relevant than HumanEval for evaluating coding models. Llama 4 Scout uses a 16-expert MoE architecture (17B active / 109B total) but needs ~55 GB VRAM at Q4.
Benchmark comparison: Qwen3.8-27B (61.7 SWE-bench Pro) leads dense coding and fits 24 GB at Q4. SWE-bench (real-world multi-file coding) is now more relevant than HumanEval for evaluating coding models. Llama 4 Scout uses a 16-expert MoE architecture (17B active / 109B total) but needs ~55 GB VRAM at Q4.

Which Tasks Does Qwen3 / Qwen3.8-27B Excel At?

Qwen3 (April 2025) and Qwen3.8-27B (August 2026) from Alibaba lead on coding benchmarks. Qwen reports 61.7 SWE-bench Pro and 89.2% GPQA Diamond for Qwen3.8-27B — the strongest dense coding result among the models compared here, and unlike the earlier Qwen 3.6 27B it superseded, it is a native vision-language model (understands images and video, not text-only). The Qwen3 family includes both dense models and MoE variants (30B-A3B, 235B-A22B).

Strengths: coding (Python, JavaScript, SQL, SWE-bench leading), mathematical reasoning, 29-language native support, JSON mode, function calling, 128K context window across all sizes.

Weaknesses: English instruction-following style can feel less natural than Llama or Mistral; some users report less fluent creative writing in English. The Alibaba origin raises data-handling concerns for some enterprise users despite open weights.

Qwen3 multilingual support: 29 native languages (Chinese, Japanese, Korean, Arabic, German, French + more) versus Llama 3.x and Mistral as English-primary local LLMs.
Qwen3 multilingual support: 29 native languages (Chinese, Japanese, Korean, Arabic, German, French + more) versus Llama 3.x and Mistral as English-primary local LLMs.

Why Is Llama 4 Scout the Long-Context Pick?

Llama 4 (April 2025) introduced MoE architecture to the Llama family. Scout (17B active / 109B total, 16 experts, multimodal) offers a 10M token context window — the largest context of any locally-runnable model — but needs ~55 GB VRAM at Q4 and does not fit a 24 GB consumer GPU at normal quants (only at 1.78-bit, ~20 tok/s). Maverick (17B active / 400B total) targets multi-GPU setups. Llama 3.3 70B remains the most battle-tested dense model. For best overall on consumer hardware, Qwen3.8-27B (fits 24 GB at Q4) outperforms Scout; choose Scout when you need its 10M context or multimodal input.

Strengths: 10M context window (Scout), multimodal input, strongest English instruction-following and creative writing, ecosystem support remains widest of any open-weights family, Llama 3.3 70B still widely fine-tuned.

Weaknesses: high VRAM demand (~55 GB at Q4) puts Scout out of reach for a single 24 GB consumer GPU at normal quants; no native multilingual support (Qwen3 still leads for non-English by a wide margin); Llama 4 Scout benchmarks still emerging. Llama 3.3 70B and Llama 3.1 8B remain available and are still the most widely fine-tuned base models.

What's Mistral's Biggest Advantage?

Mistral AI produces the most parameter-efficient models in this comparison and now offers specialized variants. Mistral Small 3.1 at 24B delivers benchmark scores close to the 70B class while requiring only 14 GB RAM -- the best quality-per-RAM ratio. Devstral Small 2 (Mistral AI, 2026) is purpose-built for agentic coding — multi-file edits, tool calling, and debugging loops. Codestral 22B is Mistral's FIM-optimized model for IDE autocomplete — the recommended model for Continue.dev and Cursor integrations.

Strengths: best quality-to-RAM ratio (Small 3.1), Devstral for agentic coding, Codestral for IDE/FIM, strong function calling and tool use, Apache 2.0 licence on several models (check each model's licence before commercial use), European provenance (France).

Weaknesses: Mistral Small v0.3 is now outperformed on benchmarks by Qwen3 8B and Llama 3.1 8B; fewer size options at the frontier than Qwen or Llama (though specialization partially offsets this).

Mistral Small 3.1 efficiency: 14 GB RAM at Q4_K_M versus about 40 GB for Llama 3.3 70B -- strong quality per GB of RAM. Plus: Devstral (agentic) and Codestral (IDE autocomplete).
Mistral Small 3.1 efficiency: 14 GB RAM at Q4_K_M versus about 40 GB for Llama 3.3 70B -- strong quality per GB of RAM. Plus: Devstral (agentic) and Codestral (IDE autocomplete).

Tool Calling and Reasoning Comparison

Tool calling (function calling) allows a model to invoke external APIs and tools in agentic workflows. All three families support it natively.

Model
Tool Calling
Reasoning (MATH)
Best For
Llama 3.3 70B✅ Native77%English-first agent workflows
Mistral Small 3.1 24B✅ Native, well-tested65%Production tool use at 16 GB
Qwen3 14B✅ Native70%Cost-effective tool calling
Llama 3.2 3B✅ Native51%Lightweight agents
Mistral Small v0.3⚠️ Limited28%Not recommended for tool use

For reasoning-heavy tasks (math, logic, code review): DeepSeek-R1 (MIT licence, 7B-32B) outperforms all three families on MATH benchmarks. Consider it alongside these three for analytical workflows. (DeepSeek has since released DeepSeek-V4 — Flash/Pro — as a newer open-weight generation; R1/V3 remain valid to run locally.)

Which Model Family Wins by Task?

Model choice is step one; prompt design is step two. The same prompt can produce vastly different results across Qwen, Llama, and Mistral. For systematic techniques to get consistent results from any model family, see the prompt engineering guide.

Task
Winner
Why
Python / JavaScript coding (generation)Qwen3.8-27B61.7 SWE-bench Pro — best dense coding model
Agentic coding (multi-file, debugging)Mistral (Devstral)Purpose-built for agentic workflows
IDE autocomplete (FIM)Mistral (Codestral)FIM-optimized, Continue.dev/Cursor support
General Q&A (English)Llama 3.xStrong English instruction-following; Llama 3.3 70B reports ~82% MMLU (indicative; check the model card)
Mathematical reasoningQwen3Generally strong on math per Qwen reports; check the model cards for your use case
Non-English languagesQwen329 native languages; Llama and Mistral are English-primary
Creative writing (English)Llama 3.x/4More natural English generation style
Quality on 16 GB RAMMistral Small 3.1Near-70B quality at 14 GB RAM — unchanged
Long-context tasks (10M+ tokens)Llama 4 Scout10M token context window — no competitor matches
Beginner first modelLlama 3.2 3BBest documented, most community support — unchanged
Task winner matrix: Qwen3.8-27B wins dense coding (61.7 SWE-bench Pro); Devstral wins agentic; Codestral wins IDE autocomplete; Llama 4 Scout dominates long-context; Mistral Small 3.1 best quality-per-GB.
Task winner matrix: Qwen3.8-27B wins dense coding (61.7 SWE-bench Pro); Devstral wins agentic; Codestral wins IDE autocomplete; Llama 4 Scout dominates long-context; Mistral Small 3.1 best quality-per-GB.

How Do Models Compare at the Same Scale?

3B-4B class: Qwen3 4B and Phi-4 Mini 3.8B outperform Llama 3.2 3B on coding and math. For general English use, Llama 3.2 3B is more reliable.

7B-8B class: Qwen3 8B (~5 GB) and Llama 3.1 8B (~5.5 GB) both significantly outperform Mistral Small v0.3. Qwen3 8B leads on coding; Llama 3.1 8B leads on English instruction-following.

14B-24B class: Qwen3 14B and Mistral Small 3.1 24B are the primary options. Mistral Small 3.1 is stronger overall despite requiring more RAM. Devstral Small 2 is the best choice for developers doing agentic coding at this tier.

MoE class (new in 2025-2026): Llama 4 Scout (17B active / 109B total, 16 experts) and Qwen3.6-35B-A3B (3B active / 35B total, 73.4 SWE-bench) use Mixture-of-Experts architecture — only a fraction of parameters activate per token. Scout needs ~55 GB VRAM at Q4 (it fits a 24 GB GPU only at 1.78-bit, ~20 tok/s), so it is a long-context / multimodal pick rather than a consumer-VRAM efficiency play; the smaller MoE variants are far more VRAM-friendly. gpt-oss:20b (21B total / 3.6B active MoE) also runs in 16 GB at ~o3-mini level with adjustable reasoning.

70B class: Llama 3.3 70B is the best-known locally-runnable dense model at this size and a good choice for English-first general tasks. For coding and multilingual work, compare Qwen3 32B or Qwen3.8-27B first, which need far less RAM.

Qwen, Llama, and Mistral cover the open-source landscape. For a comparison that includes commercial alternatives — GPT-5.6, Claude Opus 5, and Gemini 3.5 — and when to choose proprietary over open-source, see how to pick the right AI model.

Five local LLM classes: 3-4B (Llama 3.2 3B, ~2 GB), 7-8B (Qwen3 8B, ~5 GB), MoE long-context (Llama 4 Scout, ~55 GB at Q4), 14-24B (Mistral Small 3.1, ~14 GB), 70B (Llama 3.3 70B, ~40-42 GB at Q4) -- all runnable via Ollama.
Five local LLM classes: 3-4B (Llama 3.2 3B, ~2 GB), 7-8B (Qwen3 8B, ~5 GB), MoE long-context (Llama 4 Scout, ~55 GB at Q4), 14-24B (Mistral Small 3.1, ~14 GB), 70B (Llama 3.3 70B, ~40-42 GB at Q4) -- all runnable via Ollama.

Mistral Small 24B vs Qwen3 14B vs Llama 3.1 8B: Legacy Benchmark Reference

Many developers still run the previous generation: Mistral Small 24B (2024), Qwen3 14B (2024), and Llama 3.1 8B (2024). These models remain available on Ollama and are widely deployed in production. This section compares them directly for teams who haven't upgraded yet, and explains when upgrading to Qwen 3, Llama 4, or current Mistral makes sense.

  • Mistral Small 24B delivers the highest absolute benchmarks of the three but requires 14 GB RAM. Best for 16 GB+ machines where quality matters more than headroom.
  • Qwen3 14B is the strongest coding model in this legacy tier, scoring 71% HumanEval at 8 GB RAM. Best for developers on 12-16 GB RAM machines who prioritize code generation.
  • Llama 3.1 8B has the broadest ecosystem support — most fine-tunes, most tutorials, most community help. Best for first-time users or teams that need broad community resources.
  • When to upgrade Mistral Small 24B → Mistral Small 3.1 24B: if you need agentic coding (use Devstral Small 2), IDE autocomplete (use Codestral 22B), or incremental quality improvements at same RAM footprint.
  • When to upgrade Qwen3 14B → Qwen3.8-27B: if you need SWE-bench performance (Qwen reports 61.7 SWE-bench Pro for Qwen3.8-27B, the strongest dense coding result in this comparison), already on 16 GB RAM, or need 29-language native support (Qwen 3 expanded multilingual coverage).
  • When to upgrade Llama 3.1 8B → Llama 4 Scout: only if you have ~55 GB+ VRAM at Q4 (Scout's 16-expert MoE activates 17B/109B params but needs ~55 GB at Q4; it fits a 24 GB GPU only at 1.78-bit, ~20 tok/s) and you need its 10M-token context (vs Llama 3.3's 128K) or multimodal input. On a single 24 GB consumer GPU, Qwen3.8-27B (fits 24 GB at Q4) is the better upgrade.
  • Stay on legacy models if: your fine-tunes are built on Llama 3.1 8B or Qwen 3 (migration cost > benefit), production stability matters more than benchmarks (legacy models are battle-tested), or your workload doesn't require the new capabilities (general chat, summarization, basic Q&A).
  • Quick decision matrix for legacy users:
  • • Have 8 GB RAM, doing general chat: Stay on Llama 3.1 8B or Mistral Small v0.3.
  • • Have 12-16 GB RAM, doing coding: Stay on Qwen3 14B or step up to Devstral Small 2 (15 GB); Qwen3.8-27B needs a 24 GB card.
  • • Have 16+ GB RAM, want best quality: Upgrade Mistral 24B → Mistral Small 3.1 24B (general) or Devstral 24B (agentic coding).
  • • Have 24 GB VRAM: Use Qwen3.8-27B (fits 24 GB at Q4) for the best overall on consumer hardware. Reserve Llama 4 Scout (MoE, 10M context, ~55 GB at Q4) for multi-GPU or workstation rigs that need its long context or multimodal input.
Model
Parameters
RAM (Q4_K_M)
MMLU
HumanEval
Best For
Mistral Small 24B24B dense14 GB79%73%Best quality per RAM (legacy tier)
Qwen3 14B14B dense8 GB73%71%Coding on mid-range hardware
Llama 3.1 8B8B dense5 GB68%65%Most documented, easiest start

Regional Context: Which Family for EU, Japan, China

EU and GDPR: All three model families (Qwen3, Llama 3.x/4, Mistral) can run fully on your own hardware, which keeps inference data away from external providers. That removes one data-transfer question, but it does not by itself make a deployment GDPR-compliant: lawful basis, technical and organisational measures and, where relevant, a data protection impact assessment still apply. Mistral AI is French-origin; Devstral Small 2 is listed under Apache 2.0, while for Codestral 22B you should check the licence terms before commercial use. Qwen3 (Apache 2.0) can also be used in the EU. Llama 4 multimodal models carry territorial restrictions under the Llama licence; check the licence before EU use. Check the EU AI Act obligations that apply to your deployment before commercial use. This is general information, not legal advice.

Japan and METI: METI's AI governance guidelines for business encourage documenting model provenance and performance for enterprise deployments, and Qwen3, Llama 3.x/4 and Mistral all publish model cards or technical reports you can cite. Running a model on private infrastructure keeps data inside your own network, but whether any reporting or other obligations apply depends on your use case, so verify with your legal advisers. Qwen3 has native Japanese tokenization among its 29 languages, which makes it a natural candidate for Japanese-language workloads.

China and CAC: China's 2023 Interim Measures for generative AI services, administered by the Cyberspace Administration of China (CAC), mainly concern services offered to the public in China; whether a given deployment is covered depends on how it is offered, so confirm with local counsel. Qwen3 (Alibaba) is built with Chinese-language use in mind across its 29 native languages. Kimi K2.6 (Moonshot AI, 1T total / 32B active MoE, Modified MIT license, 58.6 SWE-Bench Pro as reported by Moonshot) is also Chinese-origin, but Ollama lists it only as a cloud tag and local runs need server-class hardware (300+ GB). If you process data in China, check data-residency and cross-border-transfer requirements before using cloud APIs.

Common Mistakes When Choosing Model Families

  • Comparing models at different parameter counts -- Qwen 32B vs Llama 70B is not an apples-to-apples test.
  • Misreading MoE VRAM. Llama 4 Scout has 109B total parameters but only 17B active per token — yet at Q4 it still needs ~55 GB VRAM (all experts must be resident), not the ~14 GB a 17B dense model would use. It does not fit a 24 GB consumer GPU at normal quants (only at 1.78-bit, ~20 tok/s). Compare by actual VRAM footprint and benchmark, not active-parameter count.
  • Staying on older Qwen3 sizes when your hardware can run Qwen3.8-27B. Qwen3.8 currently ships only as a 27B model (18 GB on Ollama), so Qwen3 8B and 14B remain right for smaller machines; with a 24 GB card or 32 GB Mac, move to Qwen3.8-27B unless a fine-tune ties you to Qwen3.
  • Not considering task-specific Mistral models. Mistral now has three distinct model lines: Small 3.1 (general), Devstral (agentic coding), Codestral (IDE autocomplete). Picking "Mistral" without specifying which model for which task wastes the family's main advantage — specialization.
  • Ignoring multilingual benchmarks when choosing between models if your workload is multilingual.
  • Mistral Small 3.1 overlooked: Many users skip Small 3.1 (24B) thinking it requires 30+ GB RAM. It fits at Q5 quantization with 22 GB, outperforming Llama 3.1 8B on many tasks.

Frequently Asked Questions

Is Qwen or Llama better for my use case?

Best overall on consumer hardware: Qwen3.8-27B (61.7 SWE-bench Pro, fits 24 GB at Q4). For coding and multilingual tasks: Qwen3.8-27B or Qwen3 8B. For long-context (10M tokens) or multimodal input: Llama 4 Scout (needs ~55 GB VRAM at Q4). For maximum quality per GB of RAM: Mistral Small 3.1. Test with sample prompts from your actual workload.

What is Llama 4 Scout and how is it different from Llama 3.3?

Llama 4 Scout uses a 16-expert Mixture-of-Experts (MoE) architecture — 17B parameters are active per token out of 109B total, and it is multimodal. All experts must stay resident, so at Q4 it needs ~55 GB VRAM (not the ~14 GB a 17B dense model would use) and does not fit a 24 GB consumer GPU at normal quants — only at 1.78-bit (~20 tok/s). Its draw is the 10M token context window — the largest of any locally-runnable model. Llama 3.3 70B is a dense model requiring 40 GB VRAM. On a single 24 GB GPU, Qwen3.8-27B is the better overall pick; choose Scout when you need its long context or multimodal input and have the VRAM.

Should I stay on Qwen3 or move to Qwen3.8?

Move to Qwen3.8-27B (61.7 SWE-bench Pro as reported by Qwen) if you have a 24 GB GPU or a 32 GB Mac; it is the best dense coding model in this comparison. Qwen3.8 currently ships only as a 27B model on Ollama (18 GB), so Qwen3 8B and 14B remain the right Qwen picks for 8–16 GB machines. Stay on Qwen3 only if an existing fine-tune or workflow depends on its specific behavior.

How fast is Mistral on consumer hardware?

There is no single speed figure: tokens per second depend on model size, quantization, GPU or CPU, and runtime. Smaller models usually run faster than larger ones on the same hardware, so a 24B model such as Mistral Small 3.1 will generally be slower than an 8B model. Measure on your own system (for example with `ollama run <model> --verbose`) before relying on any number. Codestral 22B is optimized for FIM (fill-in-the-middle) in IDE autocomplete workflows.

Can all three run on 8 GB VRAM?

Yes, all can run 7B models at Q4 quantization on 8 GB. Qwen3 8B uses ~5 GB, Llama 3.1 8B uses ~5.5 GB, Mistral Small uses ~4.5 GB at Q4_K_M. Llama 4 Scout (MoE) does NOT fit 8 GB — it needs ~55 GB VRAM at Q4.

Do I need an RTX 5090 to run these?

No, not for the consumer picks. RTX 5070 (12 GB) runs 7B models comfortably. A 24 GB GPU runs Qwen3.8-27B at Q4 (the best overall on consumer hardware). Llama 4 Scout needs ~55 GB at Q4 — a multi-GPU or workstation rig, not a single consumer card. RTX 5090 is overkill unless running 70B+ dense models.

What quantization should I use?

Start with Q4_K_M (4-bit) -- good balance of quality and speed on all hardware. Use Q5_K_M if you have VRAM headroom and need higher quality. Q3_K_S for constrained devices.

Which is best for coding?

Qwen3 8B (~76% HumanEval) for 8GB tier. Qwen3.8-27B (61.7 SWE-bench Pro) for best dense coding. Devstral Small 2 for agentic multi-file workflows. Codestral 22B for IDE autocomplete (FIM).

Which model should I use on 16 GB RAM?

Mistral Small 3.1 24B at Q4_K_M (14 GB) -- best overall quality at 16 GB RAM (79% MMLU). Alternatively: Qwen3 14B at Q4_K_M (9 GB) for coding with headroom to spare. Qwen3.8-27B (best dense coding, 61.7 SWE-bench Pro) needs ~24 GB and does not fit 16 GB. Avoid Llama 3.3 70B on 16 GB -- it requires 40 GB.

Is Qwen better than Llama for reasoning?

Qwen models are generally regarded as strong on math and multilingual reasoning, while Llama 3.x is regarded as stronger at English instruction-following. Published scores differ by model size and benchmark version, so compare the model cards (for example Qwen3 32B or Qwen3.8-27B against Llama 3.3 70B) on the tasks you care about.

What changed for Qwen, Llama and Mistral since September?

Qwen3.8 currently ships on Ollama only as a 27B model (18 GB at Q4_K_M, 256K context), so Qwen3 8B and 14B remain the smaller Qwen options. Devstral Small 2 (Mistral AI, 24B, 15 GB, 65.8% SWE-bench Verified as reported by Mistral, Apache 2.0) is the current Devstral tag, and Mistral Large 4 (1.05T total / 52B active parameters, per its Ollama listing) arrived as a data-centre-scale model that does not fit consumer hardware. Llama 4 Scout (about 55 GB at Q4) remains the long-context entry in this comparison. The consumer-hardware ranking above is unchanged.

Sources

Update Log

  • 2026-10-17: Refreshed against current Ollama listings: Devstral Small 2 size and benchmark corrected, Qwen3.8-27B size clarified (18 GB download), removed month stamps, added a FAQ on recent releases.
  • 2026-05-17: Added Legacy Benchmark Reference section comparing Mistral Small 24B, Qwen3 14B, and Llama 3.1 8B. Updated title to bridge legacy and current model searches.

Decided on a model? Here's how to run Qwen locally, step by step.

Run Qwen Locally — Full Setup Guide →

A Note on Third-Party Facts

This article references third-party AI models, benchmarks, prices, and licenses. The AI landscape changes rapidly. Benchmark scores, license terms, model names, and API prices can shift between the time of writing and the time you read this. Before making deployment or compliance decisions based on this article, verify current figures on each provider’s official source: Hugging Face model cards for licenses and benchmarks, provider websites for API pricing, and EUR-Lex for current GDPR and EU AI Act text.

Run PromptQuorum with a local LLM, your own API keys, or both — you pick the backend.

Download the PromptQuorum Beta →

← Back to Local LLMs

MCP