Skip to main content
PromptQuorumBuilt for humans. Structured for AI.
Home/Local LLMs
Getting Started

Download & Install Ollama on macOS, Windows & Linux

·8 min readBy · Founder of PromptQuorum · Discovery engine for open-weight & open-source AI

Download Ollama from ollama.com/download and install it in under 2 minutes on macOS, Windows or Linux, with one command per system listed below. Then one ollama run command downloads and runs models that fit your hardware, with no Python setup and no GPU required to start.

Key Takeaways

  • Official download: ollama.com/download (the app is free and open-source under the MIT licence; cloud models may need sign-in and paid plans, and each model has its own licence). macOS: `brew install ollama`; Windows: `irm https://ollama.com/install.ps1 | iex`; Linux: `curl -fsSL https://ollama.com/install.sh | sh`.
  • macOS: download the .dmg from ollama.com or run `brew install ollama` -- then `ollama run llama3.2` to start chatting.
  • Windows: download the installer from ollama.com/download. Ollama runs as a background service in the system tray.
  • Linux: one curl command installs everything -- `curl -fsSL https://ollama.com/install.sh | sh`.
  • Minimum requirements: 4 GB RAM for a 3B model, 8 GB RAM for a 7B model. No GPU needed to start.
  • Ollama exposes an OpenAI-compatible API at `http://localhost:11434/v1` -- point an existing OpenAI SDK app at that `base_url` with any non-empty `api_key` and it works unchanged. The native Ollama REST API is separate, at `http://localhost:11434/api/...`.
  • 👉 Before installing, confirm local is right for your use case — see Local LLM vs Cloud API for when cloud outperforms local inference.

📍 In One Sentence

Ollama installs in under 2 minutes on macOS, Windows, and Linux via a downloadable installer or one curl command, and one `ollama run <model>` command afterward downloads and runs models from its library that fit your hardware, with no Python environment or GPU required.

💬 In Plain Terms

Ollama is a simple way to run AI models on your own computer. Download it (or run one install command on Linux), then type a single command like `ollama run llama3.2` and it downloads the model and starts a chat -- no coding, no configuration files, and it works fine on a laptop without a graphics card.

Download Ollama from the official site, ollama.com/download, and install it in under 2 minutes on macOS, Windows or Linux. After installation, one command downloads and runs any model from the Ollama library -- no Python environment, no configuration files, and no GPU required to get started. To choose a model that fits your graphics card, see the GPU table below.

Download & Install Ollama on macOS, Windows & Linux

Where Do You Download Ollama?

Download Ollama from the official site, ollama.com/download. The app is free and open-source under the MIT licence (source and licence); signing in is only needed for Ollama's cloud models, which can have paid plans, not for local ones. Each model has its own licence. Requirements: macOS 14 (Sonoma) or newer, Windows 10 22H2 or newer, or Linux (x86-64 or ARM64). The Windows one-liner `irm … | iex` runs the downloaded script with your user's privileges, so you can download and read `install.ps1` first if you prefer. Pick your system:

System
Installer file
Command line
macOSOllama.dmgbrew install ollama
WindowsOllamaSetup.exeirm https://ollama.com/install.ps1 | iex
LinuxNone (script only)curl -fsSL https://ollama.com/install.sh | sh

Before You Install: Is Local LLM Right for Your Use Case?

Installing Ollama takes 5 minutes, but running your first model well can take 20–40 minutes if you hit GPU detection issues, driver mismatches, or RAM constraints.

If you're unsure whether local inference is the right choice for you, compare the full local vs cloud trade-offs first — you may find that starting with a cloud API (ready in 5 minutes, no troubleshooting) is the smarter path. Many users discover this after installation; better to decide now.

For users committed to local, continue below. For users evaluating cloud first, see the full comparison.

What Is Ollama and Why Use It?

Ollama is an open-source inference engine that runs large language models locally. It packages model management, the llama.cpp inference backend, and an OpenAI-compatible REST API into a single lightweight application. No Python, no conda environment, and no manual CUDA installation is required (an NVIDIA GPU still needs a current NVIDIA driver).

Ollama maintains a curated model library (ollama.com/library) with one-command downloads for Meta Llama 3.3, Microsoft Phi-4-mini, Google Gemma 4, Mistral, Qwen3, and other models. A model is downloaded once and cached on disk -- subsequent runs skip the download and load straight from disk, though Ollama unloads an idle model from memory after its keep-alive window (5 minutes by default), so a cold reload still takes as long as loading the model fresh.

For alternatives to Ollama, see Local LLM One-Click Installers. To compare Ollama with LM Studio, see How to Install LM Studio.

How Do You Install Ollama on macOS?

There are two methods. The installer download is faster; Homebrew is better if you manage software with brew. Ollama needs macOS 14 (Sonoma) or newer: Apple Silicon Macs use the GPU, Intel Macs run on the CPU only.

  1. 1
    Go to ollama.com/download and click "Download for macOS".
  2. 2
    Open the downloaded Ollama.dmg file and drag Ollama to your Applications folder.
  3. 3
    Launch Ollama from Applications. A llama icon appears in your menu bar -- Ollama is now running as a background service.
  4. 4
    Open Terminal and run your first model: `ollama run llama3.2`
  5. 5
    The model downloads (~2 GB for llama3.2:3b) and a chat prompt appears. Type a message and press Enter.

Install Ollama on macOS with Homebrew

bash
brew install ollama

# Start the Ollama service
ollama serve &

# Pull and run a model
ollama run llama3.2

How Do You Install Ollama on Windows?

  1. 1
    Go to ollama.com/download and click "Download for Windows".
  2. 2
    Run the downloaded OllamaSetup.exe installer. Ollama installs to %LOCALAPPDATA%\Programs\Ollama.
  3. 3
    Ollama starts automatically and appears as a system tray icon.
  4. 4
    Open PowerShell or Command Prompt and run: `ollama run llama3.2`
  5. 5
    The model downloads on first run. Subsequent runs use the cached model.

GPU Support on Windows

Ollama on Windows requires Windows 10 22H2 or newer and detects supported GPUs automatically: NVIDIA cards with driver 551.61 or newer, and AMD cards through a ROCm v7-capable driver or, on some RX 6000 cards, Vulkan. No manual configuration is needed. The installer does not require Administrator rights and needs about 4 GB of disk space for the binaries; to install elsewhere, run `OllamaSetup.exe /DIR="d:\some\location"`. To verify the GPU is used, run `ollama run llama3.2` and check Task Manager → GPU.

How Do You Install Ollama on Linux?

A single command installs Ollama on any Linux distribution. Piping a script into `sh` runs it with your user's privileges, so you can download and read `install.sh` first if you prefer:

bash
curl -fsSL https://ollama.com/install.sh | sh

Run Ollama as a systemd Service on Linux

The install script automatically registers Ollama as a systemd service. To manage it:

bash
# Check service status
systemctl status ollama

# Start / stop / restart
systemctl start ollama
systemctl stop ollama
systemctl restart ollama

# View logs
journalctl -u ollama -f
Four-step flow for running Ollama as a systemd service on Linux: install with `curl -fsSL https://ollama.com/install.sh | sh`, check status with `systemctl status ollama`, control it with `start`/`stop`/`restart`, and tail logs with `journalctl -u ollama -f`.
Four-step flow for running Ollama as a systemd service on Linux: install with `curl -fsSL https://ollama.com/install.sh | sh`, check status with `systemctl status ollama`, control it with `start`/`stop`/`restart`, and tail logs with `journalctl -u ollama -f`.

How Do You Pull and Run Your First Model in Ollama?

After installing Ollama, run this command to download and start a model:

bash
# Pull a model (downloads to ~/.ollama/models)
ollama pull llama3.2

# Run it interactively
ollama run llama3.2

# Or pull and run in one step
ollama run llama3.2

Which Model Should You Start With?

For a first run, these three models cover different hardware profiles:

Model
Download Size
RAM Required
Best For
Llama 3.2 3B~2 GB4 GBFirst test -- any machine
Llama 3.1 8B~4.7 GB8 GBGeneral use on most laptops
phi4-mini~2.3 GB4 GBFast responses, low RAM

Which Model Fits Your GPU?

After installing, pick the model by VRAM, not by name: the model plus its context cache has to fit in GPU memory, otherwise Ollama offloads layers to the CPU and runs several times slower. This table maps common VRAM sizes to a model and its Ollama command (weights at Q4_K_M, figures from the local LLM hardware guide). For 12, 16 and 24 GB cards, including context limits, see 12, 16 and 24 GB VRAM GPUs.

GPU VRAM
Model
Ollama command
Weights (Q4_K_M)
8 GBLlama 3.1 8Bollama run llama3.1:8b~4.7 GB
12 GBQwen3 14Bollama run qwen3:14b~9 GB
16 GBMistral Small 3.1 24Bollama run mistral-small3.1~14 GB
24 GBQwen3 32Bollama run qwen3:32b~19 GB

Sizes are the weights only; the context cache adds 25-100% on top. Speeds vary by setup.

How Do You Verify Ollama Is Working?

Test the REST API directly to confirm Ollama is running and accessible:

bash
# Check Ollama is running
curl http://localhost:11434
# Expected: "Ollama is running"

# List downloaded models
ollama list

# Send a prompt via API (OpenAI-compatible)
curl http://localhost:11434/api/generate -d '{
  "model": "llama3.2",
  "prompt": "What is 2+2?",
  "stream": false
}'

Useful Ollama Commands

Command
What It Does
ollama listShow all downloaded models and their sizes
ollama pull <model>Download a model without running it
ollama rm <model>Delete a model from disk
ollama psShow models currently loaded in memory
ollama show <model>Show model details (parameters, template, licence)
ollama serveStart the Ollama server manually (if not running as service)

Troubleshooting Common Ollama Installation Issues

Reference table of 5 common Ollama installation errors -- service not running, stalled 2-47 GB downloads, out-of-memory errors, undetected GPUs, and prompts truncated at 4096 tokens -- each mapped to its fix command.
Reference table of 5 common Ollama installation errors -- service not running, stalled 2-47 GB downloads, out-of-memory errors, undetected GPUs, and prompts truncated at 4096 tokens -- each mapped to its fix command.

Ollama says "could not connect to ollama app, is it running?"

Ollama is not running as a background service. On macOS: open the Ollama app from Applications. On Linux: run `systemctl start ollama` or `ollama serve` in a terminal. On Windows: launch Ollama from the Start menu.

The model download is very slow or stalled

Model downloads are large (2-47 GB). If the download stalls, press Ctrl+C and re-run `ollama pull <model>` -- Ollama resumes partial downloads. For faster downloads, use a wired connection instead of Wi-Fi.

I get "error: model requires more system memory" when running a model

The model is too large for your available RAM. Try a smaller quantization: `ollama run llama3.2:3b-instruct-q4_0` instead of the default Q4_K_M. Or switch to a smaller model like `llama3.2:3b`. See Best Beginner Local LLM Models for RAM-matched recommendations.

Ollama is running but my GPU is not being used

For a native install (not Docker), you need the NVIDIA driver and CUDA runtime -- check with `nvidia-smi`, which should print your GPU and driver version. Ollama offloads layers to GPU automatically when VRAM is available; run `ollama ps` and check the PROCESSOR column reads 100% GPU. Only if you're running Ollama inside a Docker container do you additionally need the NVIDIA Container Toolkit on the host, plus `--gpus=all` on the container.

My prompt or document gets cut off partway through

Ollama's context window defaults to 4096 tokens on most consumer GPUs (it scales up automatically to 32K or 256K on higher-VRAM cards). Anything longer than the active window is silently truncated. Raise it per session with `/set parameter num_ctx 8192` in `ollama run`, per API call with `"options": {"num_ctx": 8192}`, or for every model with the `OLLAMA_CONTEXT_LENGTH` environment variable before starting the server. A larger context window uses more memory, so watch VRAM if you raise it a lot.

Where are Ollama model files stored?

Models are stored at ~/.ollama/models on macOS and Linux. On Windows, the default path is C:\Users\<username>\.ollama\models. You can change the storage location by setting the OLLAMA_MODELS environment variable before starting the service.

How do I install Ollama on macOS?

Download the .dmg from ollama.com, drag to Applications, launch, then run ollama run llama3.2 in Terminal. Alternatively: brew install ollama && ollama serve.

How do I install Ollama on Windows?

Download OllamaSetup.exe from ollama.com/download and run it. Ollama installs as a background service. Open Command Prompt and run ollama run llama3.2.

How do I install Ollama on Linux?

Run: curl -fsSL https://ollama.com/install.sh | sh. This installs Ollama as a systemd service. Then: ollama pull llama3.2 to download your first model.

What is the minimum RAM required for Ollama?

Minimum 4GB RAM for a 3B model, 8GB for a 7B model at Q4 quantization. No GPU is required -- Ollama falls back to CPU inference automatically.

Can I run Ollama without a GPU?

Yes. Ollama runs on CPU with no GPU. Inference is noticeably slower than on a GPU, and speed depends on the model size and your hardware, but it is functional. Use small models like llama3.2:3b or phi3.5 on CPU-only systems.

How do I pull a new model with Ollama?

Run: ollama pull modelname. For example: ollama pull mistral or ollama pull qwen2.5:7b. Models are stored in ~/.ollama/models. List downloaded models with ollama list.

What port does Ollama use?

Ollama serves its API on port 11434 by default. Access it at http://localhost:11434. Change the port with the OLLAMA_HOST environment variable, for example OLLAMA_HOST=127.0.0.1:11435. Binding to 0.0.0.0 makes the API, which has no authentication, reachable from every device on your network; only do that behind a firewall or reverse proxy.

Is Ollama API compatible with the OpenAI API?

Yes. Ollama supports the OpenAI chat completions endpoint at /v1/chat/completions. Most apps built on the OpenAI SDK work after you set base_url to http://localhost:11434/v1, but compatibility is partial, so test the features you rely on.

How do I see which models are installed in Ollama?

Run: ollama list. This shows all downloaded models, their sizes, and quantization levels. Remove a model with ollama rm modelname.

How do I update Ollama to the latest version?

macOS/Windows: Ollama downloads updates automatically; restart it from the menu bar or tray icon to apply the update, or install the latest version from ollama.com. Linux: re-run curl -fsSL https://ollama.com/install.sh | sh to update in place.

What to Do After Installing Ollama?

Once Ollama is running, the next step is Run Your First Local LLM to understand prompting, context length, and what to expect from local inference speed. To pick the best model for your hardware, see Best Beginner Local LLM Models. If you prefer a graphical chat interface over the terminal, How to Install LM Studio covers the desktop app alternative.

Sources

Common Mistakes When Installing Ollama

  • Not checking that Ollama is running as a background service before expecting the API to respond.
  • Attempting to run models larger than available RAM without checking memory requirements first.
  • Ignoring GPU detection -- Ollama supports NVIDIA and AMD but requires up-to-date drivers.

A Note on Third-Party Facts

This article references third-party AI models, benchmarks, prices, and licenses. The AI landscape changes rapidly. Benchmark scores, license terms, model names, and API prices can shift between the time of writing and the time you read this. Before making deployment or compliance decisions based on this article, verify current figures on each provider’s official source: Hugging Face model cards for licenses and benchmarks, provider websites for API pricing, and EUR-Lex for current GDPR and EU AI Act text.

Run PromptQuorum with a local LLM, your own API keys, or both — you pick the backend.

Download the PromptQuorum Beta →

← Back to Local LLMs

MCP