What can a Radeon RX 9070 XT run locally?
- Page updated
- Answers from each model's own checker
- Card memory from AMD
What runs on a Radeon RX 9070 XT? Every answer below is the one RigCheck's own checker for that model gives for this card, with 32 GB or 64 GB of system RAM. Nothing on this page is judged separately.
With 64 GB of system RAM, the checkers have an answer for a Radeon RX 9070 XT (16 GB of VRAM) for 10 of the 13 models, sizes and routes they cover: 8 without caveats (Qwen3.8-Flash-Next in the Strata engine, Qwen3.8-27B in llama.cpp, Gemma 4 31B, Gemma 4 26B-A4B, Gemma 4 12B, Gemma 4 E4B, Gemma 4 E2B, LFM2.5-24B-A2B in llama.cpp); Nemotron 3.5 Bolt 74B-A9B, Nemotron 3.5 Super VL 120B-A12B with caveats (part in system RAM, an experimental path, a planning budget, an unmeasured peak or a memory-capacity-only estimate). With 32 GB, 7 without caveats (Qwen3.8-27B in llama.cpp, Gemma 4 31B, Gemma 4 26B-A4B, Gemma 4 12B, Gemma 4 E4B, Gemma 4 E2B, LFM2.5-24B-A2B in llama.cpp). The llama.cpp language-model answers are capacity estimates and the Nemotron 3.5, GLM-5.3-Flash and DeepSeek V4.1 Flash answers are published route matches, not measured setups.
Radeon RX 9070 XT: model by model
Language models
| Model (checker) | With 32 GB RAM | With 64 GB RAM |
|---|---|---|
| Qwen3.8-Flash-Next in the Strata engine | ! Runs, with caveats IQ2_XS No measured speed for this hardware and setup yet. Your RAM cannot hold this size's experts (about 46 GB of RAM), so Strata switches to low-RAM mode by itself and reads the experts the card does not hold from the SSD while it answers. Strata: slower, and much slower with a small graphics card; RigCheck has no matching speed for this. For code, the Coder (IQ1_M) runs here with its experts copied into RAM at start; Strata: it is weaker outside code and in languages other than English. | ✓ Runs IQ3_S No measured speed for this hardware and setup yet. Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. |
| Qwen3.8-27B in llama.cpp | ✓ Fits (capacity estimate) UD-IQ3_XXS · GPU memory (input embeddings in system RAM) No measured speed for this hardware and setup yet. On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run qwen3.8:27b, 18 GB) is a different file from the one checked here, so compare its size with your memory first. RigCheck capacity estimate, not a measured setup. | ✓ Fits (capacity estimate) UD-IQ3_XXS · GPU memory (input embeddings in system RAM) No measured speed for this hardware and setup yet. On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run qwen3.8:27b, 18 GB) is a different file from the one checked here, so compare its size with your memory first. RigCheck capacity estimate, not a measured setup. |
| Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp | ✓ Best size: fits (capacity estimate) Gemma 4 31B: fits (capacity estimate) (UD-IQ2_XXS, GPU memory (input embeddings in system RAM)); Gemma 4 26B-A4B: fits (capacity estimate) (UD-IQ3_XXS, GPU memory (input embeddings in system RAM)); Gemma 4 12B: fits (capacity estimate) (Q6_K, GPU memory (input embeddings in system RAM)); Gemma 4 E4B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); Gemma 4 E2B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)) No measured speed for this hardware and setup yet. On this Radeon card these are capacity estimates only: we found no source for Gemma 4 with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default packages (gemma4:31b 19–20 GB, gemma4:26b 16–19 GB, gemma4:12b 7.7–8.0 GB, gemma4:e4b 6.6–9.5 GB, gemma4:e2b 4.6–7.5 GB) are different files from the ones checked here. RigCheck capacity estimate, not a measured setup. | ✓ Best size: fits (capacity estimate) Gemma 4 31B: fits (capacity estimate) (UD-IQ2_XXS, GPU memory (input embeddings in system RAM)); Gemma 4 26B-A4B: fits (capacity estimate) (UD-IQ3_XXS, GPU memory (input embeddings in system RAM)); Gemma 4 12B: fits (capacity estimate) (Q6_K, GPU memory (input embeddings in system RAM)); Gemma 4 E4B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); Gemma 4 E2B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)) No measured speed for this hardware and setup yet. On this Radeon card these are capacity estimates only: we found no source for Gemma 4 with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default packages (gemma4:31b 19–20 GB, gemma4:26b 16–19 GB, gemma4:12b 7.7–8.0 GB, gemma4:e4b 6.6–9.5 GB, gemma4:e2b 4.6–7.5 GB) are different files from the ones checked here. RigCheck capacity estimate, not a measured setup. |
| LFM2.5-24B-A2B in llama.cpp | ✓ Fits (capacity estimate) UD-Q3_K_XL · GPU memory (input embeddings in system RAM) No measured speed for this hardware and setup yet. On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run lfm2.5:24b, 15 GB) is a different file from the one checked here, so compare its size with your memory first. RigCheck capacity estimate, not a measured setup. | ✓ Fits (capacity estimate) UD-Q3_K_XL · GPU memory (input embeddings in system RAM) No measured speed for this hardware and setup yet. On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run lfm2.5:24b, 15 GB) is a different file from the one checked here, so compare its size with your memory first. RigCheck capacity estimate, not a measured setup. |
| Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B) | ! Best size: a published route or recipe matches, with caveats Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: does not fit Nemotron 3.5 Bolt 74B-A9B: We found no source covering AMD GPUs for this model, so only system RAM is counted here. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 32 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: We found no source covering AMD or Intel GPUs for this model, so only system RAM is counted. Unsloth plans at least 64 GB of RAM or unified memory for its smallest GGUF (UD-IQ1_M, 46.1 GB); llama.cpp can split the model across RAM and VRAM. This setup counts 32 GB of RAM = 32 GB. | ! Best size: a published route or recipe matches, with caveats Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 64 GB budget: UD-IQ1_M (46.1 GB) or UD-IQ2_XXS (51.1 GB)) Nemotron 3.5 Bolt 74B-A9B: We found no source covering AMD GPUs for this model, so only system RAM is counted here. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: We found no source covering AMD or Intel GPUs for this model, so only system RAM is counted. Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 64 GB of RAM = 64 GB. Longer contexts and video need more. |
No answer here: Qwen3.8-Flash-Next in llama.cpp, Mistral Medium 3.5 in llama.cpp, Mistral Large 4, Kolibri-1 (official FP8 route), GLM-5.3-Flash (Unsloth GGUF), DeepSeek V4.1 Flash (September release, 1017 update)
| Model (checker) | With 32 GB RAM | With 64 GB RAM |
|---|---|---|
| Qwen3.8-Flash-Next in llama.cpp | ✕ Does not fit Even the smallest file (UD-IQ1_S, 72.5 GB) needs about 76.1 GB in system RAM. This checker does not cover your graphics card, so it is not counted; its memory could change the answer. | ✕ Does not fit Even the smallest file (UD-IQ1_S, 72.5 GB) needs about 76.1 GB in system RAM. This checker does not cover your graphics card, so it is not counted; its memory could change the answer. |
| Mistral Medium 3.5 in llama.cpp | – Not covered | – Not covered |
| Mistral Large 4 | ✕ Does not fit Even the smallest file, UD-IQ1_S (233 GB), is larger than this setup's 48 GB of memory (VRAM + system RAM). | ✕ Does not fit Even the smallest file, UD-IQ1_S (233 GB), is larger than this setup's 80 GB of memory (VRAM + system RAM). |
| Kolibri-1 (official FP8 route) | – Not covered | – Not covered |
| GLM-5.3-Flash (Unsloth GGUF) | ✕ Does not fit Unsloth's table puts the 1-bit GGUF (93.1–97.6 GB) at 100 GB of total memory, RAM + VRAM or unified memory. This setup counts 32 GB of RAM (this card is not counted: Unsloth names CUDA, CPU-only and Metal builds, no AMD or Intel GPU build). | ✕ Does not fit Unsloth's table puts the 1-bit GGUF (93.1–97.6 GB) at 100 GB of total memory, RAM + VRAM or unified memory. This setup counts 64 GB of RAM (this card is not counted: Unsloth names CUDA, CPU-only and Metal builds, no AMD or Intel GPU build). |
| DeepSeek V4.1 Flash (September release, 1017 update) | – Not covered | – Not covered |
Image models
No answer in this setup: Qwen-Image-2.1 (image generation), FLUX 3 Image Klein (int8, ComfyUI)
| Model (checker) | With 32 GB RAM | With 64 GB RAM |
|---|---|---|
| Qwen-Image-2.1 (image generation) | – Not covered | – Not covered |
| FLUX 3 Image Klein (int8, ComfyUI) | – Not covered | – Not covered |
Video models
No answer in this setup: MiniMax H3 (video + audio)
| Model (checker) | With 32 GB RAM | With 64 GB RAM |
|---|---|---|
| MiniMax H3 (video + audio) | – Not covered | – Not covered |
Quick setup, as in the home page finder: one Radeon RX 9070 XT, a 32K context and no image input for the llama.cpp capacity estimates (Nemotron 3.5, GLM-5.3-Flash and DeepSeek V4.1 Flash are matched against published recipes, memory tables and routes at their own context instead (NVIDIA's 64K / 256K recipes; Unsloth's GLM table states no context length; DwarfStar's routes per DeepSeek checkpoint (documented on Macs and the DGX Spark, experimental on Strix Halo for the September weights) and, for 1017 only, Strata's route on an RTX 30/40/50 card with 12 GB or more, a Radeon AI PRO R9700 or a 128 GB Strix Halo under Windows (on a PC the selected RAM at least 46 GB; an NVMe SSD, 8K context by default), not llama.cpp).), the better of Windows and Linux for Strata, an NVMe SSD; for the image and video rows, Qwen-Image (a planning budget): base model, INT8, 512×512, batch one, no reference images; Kolibri-1: the official FP8 route at a 32K context; MiniMax H3: local H3-Base FL2VA recipes, assuming an NVMe drive; Nemotron 3.5: Bolt and Super VL on one card with the RAM given; FLUX 3 Image Klein: Black Forest Labs' int8 ComfyUI route on the card. "With caveats" means part of the model sits in system RAM (slower), an unmeasured peak, or a route the checker marks conditional. Speeds appear only where they were measured on this very card in this setup; official estimates and runs on other setups are left out (the full checkers show them, labeled). Pick this card in a checker for your exact setup.
What more RAM would change
- Qwen3.8-Flash-Next in llama.cpp: with 96 GB of RAM, fits with caveats (capacity estimate) (UD-IQ3_XXS, system RAM, CPU only).
- Mistral Large 4: with 256 GB of RAM, fits by memory capacity only, with caveats (UD-IQ1_S (233 GB), GPU and system RAM (most experts in RAM)). Leaves at least 10% of the memory for the KV cache, the OS and buffers. llama.cpp added Mistral Large 4 on its main branch on October 29, 2026; no numbered release included it when RigCheck checked (October 30): use a build of its main branch, or the Llama App (Hugging Face) or Unsloth Desktop that the GGUF makers name. RigCheck capacity estimate from the real file size, not a measured setup.
Measured a local model on your own hardware, or tried and it failed? Send us the numbers: paste the benchmark output or log into the form (or email it). After checking it we add it to this page, labeled as a community report and shared under CC BY 4.0.
About the Radeon RX 9070 XT
Radeon RX 9070 XT: 16 GB GDDR6 of video memory (AMD Radeon RX 9070 XT specifications). For the large mixture-of-experts models here, system RAM matters as much as VRAM: the parts that do not fit on the card are kept in RAM.
This page is the Radeon RX 9070 XT, 16 GB of GDDR6 (memory read from AMD's specification page on November 2, 2026). The RX 9070 also has 16 GB but can get different answers; check it in the home page finder.
FAQ
Can a Radeon RX 9070 XT run Qwen3.8-Flash-Next in the Strata engine?
Yes, with 64 GB of system RAM in RigCheck's quick setup: IQ3_S; No measured speed for this hardware and setup yet; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. The full checker takes your exact setup (RAM, disk, operating system, processor) and gives the install steps.
Can a Radeon RX 9070 XT run Qwen3.8-27B in llama.cpp?
Yes, by RigCheck's capacity estimate, with 64 GB of system RAM in RigCheck's quick setup: UD-IQ3_XXS · GPU memory (input embeddings in system RAM); No measured speed for this hardware and setup yet; On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run qwen3.8:27b, 18 GB) is a different file from the one checked here, so compare its size with your memory first; RigCheck capacity estimate, not a measured setup. The full checker takes your exact setup (context length, RAM, image input) and gives the command to start it.
Can a Radeon RX 9070 XT run Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp?
Yes, by RigCheck's capacity estimate, with 64 GB of system RAM in RigCheck's quick setup: Gemma 4 31B: fits (capacity estimate) (UD-IQ2_XXS, GPU memory (input embeddings in system RAM)); Gemma 4 26B-A4B: fits (capacity estimate) (UD-IQ3_XXS, GPU memory (input embeddings in system RAM)); Gemma 4 12B: fits (capacity estimate) (Q6_K, GPU memory (input embeddings in system RAM)); Gemma 4 E4B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); Gemma 4 E2B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); No measured speed for this hardware and setup yet; On this Radeon card these are capacity estimates only: we found no source for Gemma 4 with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default packages (gemma4:31b 19–20 GB, gemma4:26b 16–19 GB, gemma4:12b 7.7–8.0 GB, gemma4:e4b 6.6–9.5 GB, gemma4:e2b 4.6–7.5 GB) are different files from the ones checked here; RigCheck capacity estimate, not a measured setup. The full checker takes your exact setup (context length, RAM, image input) and gives the command to start it.
Can a Radeon RX 9070 XT run LFM2.5-24B-A2B in llama.cpp?
Yes, by RigCheck's capacity estimate, with 64 GB of system RAM in RigCheck's quick setup: UD-Q3_K_XL · GPU memory (input embeddings in system RAM); No measured speed for this hardware and setup yet; On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run lfm2.5:24b, 15 GB) is a different file from the one checked here, so compare its size with your memory first; RigCheck capacity estimate, not a measured setup. The full checker takes your exact setup (context length, RAM) and gives the command to start it.
Can a Radeon RX 9070 XT run Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B)?
A published route or recipe matches, with caveats, with 64 GB of system RAM in RigCheck's quick setup: Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 64 GB budget: UD-IQ1_M (46.1 GB) or UD-IQ2_XXS (51.1 GB)); Nemotron 3.5 Bolt 74B-A9B: We found no source covering AMD GPUs for this model, so only system RAM is counted here. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: We found no source covering AMD or Intel GPUs for this model, so only system RAM is counted. Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 64 GB of RAM = 64 GB. Longer contexts and video need more. The full checker lets you change the route or recipe settings and lists the files and the published recipe.
Other graphics cards
RTX 4060 Ti 16 GB · Radeon VII / Instinct MI50 16 GB · RTX 3060 12 GB · RTX 4070 Ti · RTX 3090 · RTX 4090 · Every 16 GB card · All graphics cards · Any other card or Mac
Sources
- AMD Radeon RX 9070 XT specifications: memory size
- DeepSeek V4.1 Flash (September release, 1017 update): the checker, its sources and assumptions
- FLUX 3 Image Klein (int8, ComfyUI): the checker, its sources and assumptions
- Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp: the checker, its sources and assumptions
- GLM-5.3-Flash (Unsloth GGUF): the checker, its sources and assumptions
- Kolibri-1 (official FP8 route): the checker, its sources and assumptions
- LFM2.5-24B-A2B in llama.cpp: the checker, its sources and assumptions
- MiniMax H3 (video + audio): the checker, its sources and assumptions
- Mistral Large 4: the checker, its sources and assumptions
- Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B): the checker, its sources and assumptions
- Qwen3.8-27B in llama.cpp: the checker, its sources and assumptions
- Qwen3.8-Flash-Next in llama.cpp: the checker, its sources and assumptions
- Qwen-Image-2.1 (image generation): the checker, its sources and assumptions
- Qwen3.8-Flash-Next in the Strata engine: the checker, its sources and assumptions