Best Beginner Local LLMs 2026: 4GB & 8GB RAM Models (Llama, Phi, Gemma, Qwen)

1. Install Ollama (1 minute)

Download from ollama.com and run the installer. No configuration needed.

2. Run Llama 3.2 3B (2 minutes)

Open your terminal and run: `ollama run llama3.2:3b`

Ollama downloads the model (~2 GB) on first run. This is the recommended first model for most users.

3. Start chatting (immediate)

Once the model loads, type your question or prompt and press Enter. You'll see responses at 25-45 tokens/second on a typical laptop.

That's it. No manual configuration, no GPU required. If you have 8 GB+ RAM, you're ready to go. If you have 4-6 GB, use `ollama run gemma3:2b` instead (faster, uses 1.7 GB RAM).

Before downloading your first model, answer these three questions:

1. Do you have 8+ GB of RAM? (If no, cloud APIs are faster to get started.)

2. Do you need your data to stay private? (If no, cloud APIs offer better quality.)

3. Can you tolerate 20–40 minute setup? (If no, cloud APIs are ready in 5 minutes.)

If you answered "no" to two or more questions, **read the full local vs cloud comparison** to see if a cloud API is a better fit for your hardware and timeline. Beginners often assume local LLMs are always better — they're not. The right choice depends on your specific constraints.

Model selection for local LLMs depends on three constraints: available RAM, inference speed, and task type -- in that order of priority.

The parameter count (3B, 7B, 13B) is the primary driver of RAM requirements. At 4-bit quantization -- the default for most local inference tools -- multiply the parameter count by ~0.5 to estimate GB of RAM needed. A 7B model at Q4_K_M requires approximately 4.5 GB of RAM.

For most beginners, 7B models at Q4_K_M quantization offer the best balance of quality, speed, and RAM use on machines with 8 GB or more. On machines with 4-6 GB RAM, 3B models are the practical ceiling.

Meta Llama 3.2 3B is the best starting point for most users. It downloads in under 5 minutes, runs on any machine with 4 GB RAM, and produces noticeably better instruction-following than previous 3B models. It uses a 128K context window -- far larger than comparable-size models.

In our testing on an 8-core laptop CPU, Llama 3.2 3B generates 25-45 tokens/sec. On Apple M3 Pro, it reaches 70-90 tokens/sec. Quality is adequate for summarization, Q&A, and simple coding tasks, but falls short of 7B models on multi-step reasoning.

Phi-4 Mini is Microsoft's compact model optimized for reasoning and coding tasks at small scale. It achieves 68% MMLU and 70% HumanEval -- scores that exceed many 7B models from 2024 -- due to training on high-quality synthetic data focused on problem-solving.

It is the recommended model for machines with 4-6 GB RAM where quality matters. Phi-4 Mini uses 2.5 GB RAM (down from Phi-3.5 Mini's 3 GB), making it more accessible on 4 GB machines.

Gemma 3 2B is Google's updated 2B model and the fastest option for CPU-only inference. It generates 40-60 tokens/sec on a mid-range laptop CPU -- roughly double the speed of Llama 3.2 3B at the same hardware. Gemma 3 significantly improves on its predecessor: the context window expands from 8K (Gemma 2) to 128K tokens, removing a major limitation for document tasks.

Gemma 3 2B is a good choice when response speed matters most, on machines with ≤4 GB RAM, or as a testing model to verify your local LLM setup before downloading larger models.

Meta Llama 3.3 8B is the current general-purpose all-rounder at this size, scoring 72% on HumanEval and offering solid English reasoning. It replaces Mistral Small v0.3 as this list's 7B/8B pick -- Mistral Small v0.3 was the community standard in 2023-2024, but is now outperformed at the same RAM tier and is better treated as a legacy option (see Common Mistakes below for why we no longer recommend it as a default).

For machines with 8 GB RAM, Llama 3.3 8B is a natural step up from 3B models. It handles longer text, more complex instructions, and multi-turn conversations more reliably than any 3B model, with a 128K context window.

Qwen3 8B (8.2B parameters) scores 57.3% on HumanEval, matches or beats Llama 3.1 8B on MMLU, and natively supports 29+ languages including Chinese, Japanese, Korean, Arabic, and all major European languages. It is the recommended choice for non-English workflows or coding-heavy use cases, and replaces the earlier Qwen2.5 7B as this list's multilingual pick.

Qwen3 8B uses a 32K context window (extendable to 131K with YaRN) and supports structured output with JSON mode, plus an optional "thinking mode" for harder reasoning tasks (slower, but more accurate). The model is available in instruct and base variants -- for chat use, always use the instruct version. See the Qwen vs Llama vs Mistral benchmark comparison for detailed benchmark data.

EU / GDPR: For EU organizations processing personal data locally, model provenance matters for compliance documentation. German BSI guidelines require documenting model origin and licence type for AI systems used in professional contexts. Llama (Meta/USA), Gemma (Google/USA), and Qwen (Alibaba/China) are all technically usable under GDPR for local inference -- for the cleanest EU-provenance narrative, Mistral AI (France) offers Apache 2.0-licensed models, though current Mistral Small releases (24B+) exceed this page's 4-8 GB beginner RAM range; see the hardware guide for the GPU tier needed to run them.

Japan (METI): For Japanese-language workflows, Qwen3 8B is the correct first model -- native Japanese tokenization produces better token efficiency on Japanese text than Llama. Run: `ollama run qwen3:8b`. METI AI Governance Guidelines require documenting the model name and version -- all five models here have versioned Ollama tags satisfying this.

China: Qwen3 8B (Alibaba) is the natural first model for Chinese-language workflows. Native Chinese tokenization and 29+-language support make it the standard for Mandarin-first workflows. For Chinese enterprise deployment under China's Data Security Law (数据安全法), Qwen3 running locally via Ollama satisfies data localization requirements.

Korea: Among these five beginner-tier picks, Qwen3 8B has the strongest native Korean tokenization. For dedicated Korean-language local models beyond this beginner tier, see Best Korean Language Models for Local Use.

All five models install with a single Ollama command -- no manual configuration required. See How to Install Ollama for setup, then Run Your First Local LLM for a step-by-step first-run walkthrough. If you are running on a laptop with limited RAM, How to Run Local LLMs on a Laptop covers quantization and performance tuning for constrained hardware.

Once your first model is running, the next step is learning how to prompt it effectively. Start with the prompt engineering fundamentals — 16 guides covering the building blocks every prompt needs, from temperature settings to output formatting.