Skip to main content
PromptQuorumPromptQuorum

Strix Halo (Ryzen AI Max) + Ollama Vulkan: Setup and Performance

Read in:
🇺🇸en🇩🇪de🇫🇷fr🇯🇵ja🇨🇳zh🇪🇸es🇧🇷pt🇸🇦ar🇰🇷ko

This page contains links to third-party products for reference. PromptQuorum is not enrolled in any affiliate program — these are plain links that earn no commission. Clicking links and your next steps are entirely your own responsibility. These links do not represent any endorsement or verification by PromptQuorum.

Quick Answer

Yes — Ryzen AI Max (Strix Halo, RDNA 3.5) runs Ollama via Vulkan on Linux. With 96 GB unified memory on the MAX 395, it fits Qwen 32B and even Llama 70B Q4_K_M — models no single desktop GPU can hold.

  • ▸Linux: Ollama detects Strix Halo Vulkan automatically; set OLLAMA_FLASH_ATTENTION=1 for long context sessions
  • ▸Ryzen AI Max 395 (96 GB): fits Llama 70B Q4_K_M (~41 GB) and Qwen 32B Q4_K_M (~19 GB) simultaneously in memory
  • ▸Context: no hard 64K cap — num_ctx sets it; 64K–96K is comfortable on a 30B model, 128K+ is memory-bound and slower on Vulkan
  • ▸Windows Vulkan path for Strix Halo is experimental; Linux is the stable platform for GPU-accelerated Ollama

Updated: 2026-07

Hardware-SpecificIntermediate

Key Takeaways

  • ✓Ryzen AI Max 395 (Strix Halo, 40 RDNA 3.5 CUs, 96 GB LPDDR5X) uses the Vulkan backend in Ollama on Linux — the correct GPU path when ROCm iGPU support is unavailable
  • ✓The 96 GB unified memory pool is the key advantage: it fits Llama 70B Q4_K_M (~41 GB) — a model that requires multiple desktop GPUs in other setups
  • ✓Speed on Ryzen AI Max 395: Llama 3.3 8B ~22 tok/s, Qwen 3 14B ~13 tok/s, Qwen 3 32B ~7 tok/s via Vulkan
  • ✓Windows support for Strix Halo in Ollama is maturing; Linux via Vulkan is the stable path as of mid-2026

How to Run Ollama with Vulkan on Strix Halo

On Linux, installing the standard Ollama binary is sufficient — it uses llama.cpp with the Vulkan backend, which supports RDNA 3.5 (gfx1150) out of the box. No additional ROCm installation is required for the Vulkan path. Run `curl -fsSL https://ollama.com/install.sh | sh` as usual.

After installation, set the flash attention flag for better memory efficiency on long sessions: `OLLAMA_FLASH_ATTENTION=1 ollama run qwen2.5:14b`. This reduces KV-cache memory usage and is particularly important when running 32B+ models that approach the full 96 GB pool.

To verify that Ollama is using the GPU (not CPU), run `ollama ps` while a model is active. The output shows "GPU" in the PROCESSOR column and a non-zero VRAM value. If you see "CPU", the Vulkan backend did not initialize — check that the `vulkan-icd-loader` package is installed on your Linux distribution.

ModelVRAM at Q4_K_MSpeed (MAX 395 Vulkan)Fits 96 GB?
Llama 3.3 8B4.9 GB~22 tok/s✓
Qwen 3 14B9.3 GB~13 tok/s✓
Qwen 3 32B19.4 GB~7 tok/s✓
Llama 3.3 70B~41 GB~3 tok/s✓
Qwen 3 72B~43 GB~3 tok/s✓
Check Minisforum AI370-G price on Amazonproduct link · disclosedCheck ASUS ROG NUC price on Amazonproduct link · disclosed

Strix Halo vs RTX 4090: Memory Wins, Speed Loses

The Ryzen AI Max 395 trades GPU speed for memory capacity. An RTX 4090 runs Llama 3.3 8B at ~45 tok/s versus ~22 tok/s on Strix Halo Vulkan. For 7B and 14B models, the RTX 4090 is faster. But the RTX 4090 is capped at 24 GB VRAM — Strix Halo MAX 395 holds 96 GB, enabling model sizes that are simply impossible on a desktop GPU.

The practical use case for Strix Halo is running 32B–70B models locally without cloud APIs. Qwen 3 32B at Q4_K_M (~19 GB) runs at ~7 tok/s — slow for interactive chat but fine for batch summarization, document processing, or overnight fine-tuning jobs. Llama 3.3 70B at Q4_K_M (~41 GB) is achievable at ~3 tok/s, suitable for high-quality single queries.

On Windows, Ollama for Strix Halo falls back to CPU inference by default as of mid-2026, since ROCm iGPU support for gfx1150 is not yet complete in the official Ollama Windows build. The Vulkan path requires building llama.cpp from source with `-DGGML_VULKAN=ON`. Linux is recommended for GPU-accelerated Strix Halo inference until the Windows ROCm path matures.

For comparison with other Apple Silicon APU hardware, see the Mac Mini M4 for local LLMs bite, which covers the alternative unified-memory approach on macOS.

Related Reading

Quick Answers About Strix Halo and Ollama Vulkan

Does AMD Strix Halo support ROCm in Ollama?▾
Not fully as of mid-2026. ROCm support for gfx1150 (RDNA 3.5) is in progress but not yet stable in the official Ollama builds. The Vulkan backend is the currently reliable GPU acceleration path on Linux. Check the Ollama GitHub releases page for updates on ROCm iGPU support.
Can I use Ollama with Strix Halo Vulkan on Windows?▾
Experimentally, yes. The official Ollama Windows build does not expose the Vulkan backend by default for Strix Halo — it falls back to CPU. You can build llama.cpp from source with -DGGML_VULKAN=ON on Windows to enable it, but this requires a manual build process. Linux is the recommended platform for Strix Halo Vulkan inference.
What is the largest model that fits on Ryzen AI Max 395?▾
With 96 GB of unified memory, the Ryzen AI Max 395 fits Llama 3.3 70B at Q4_K_M (~41 GB) or Qwen 3 72B at Q4_K_M (~43 GB), each with memory to spare. For very large models, Qwen 3 72B at Q5_K_M (~55 GB) also fits, though speed drops to approximately 2 tok/s. Models requiring over 90 GB (e.g., 70B at Q8_0) exceed the available pool.
What context window can Strix Halo handle in Ollama — is there a 64K limit?▾
There is no hard 64K-token limit; the ceiling is your unified memory. On a 96 GB Ryzen AI Max 395, a 30B model at Q4_K_M comfortably runs a 64K–96K context (roughly 36–45 GB total for weights plus KV cache). Set the size with Ollama's num_ctx parameter (or the OLLAMA_CONTEXT_LENGTH environment variable), and keep OLLAMA_FLASH_ATTENTION=1 to reduce KV-cache memory. You can push 128K–200K, but it becomes memory-bound (~50–70 GB) and prompt processing slows on the Vulkan/RADV backend — a tuned ROCm build is roughly 3× faster at very long context (about 51 vs 17 tok/s prompt processing past ~130K).
How does Strix Halo compare to Mac Studio M4 Ultra for Ollama?▾
Mac Studio M4 Ultra has 192 GB unified memory and uses Metal acceleration via llama.cpp — significantly faster than Strix Halo Vulkan on a per-token basis (~12 tok/s on 70B Q4_K_M vs ~3 tok/s on Strix Halo). For large-model inference quality and speed, M4 Ultra wins. Strix Halo is competitive only in the 8B–32B range and runs a standard Linux workflow.

Want the full breakdown?

Read the complete guide →

Related Prompt Bites

← Back to Prompt Bites