What can a 24 GB graphics card run locally?
- Page updated
- Answers from each model's own checker
- Card by card, no formula
- Card memory from the vendors
What can a 24 GB graphics card run locally? Every answer below is the one RigCheck's own checker for that model gives for each 24 GB card in the finder, with 64 GB of system RAM. Nothing on this page is judged separately, and no answer is a formula from the memory size alone.
With 64 GB of system RAM, across the 7 graphics cards with 24 GB of VRAM in RigCheck's finder, the checkers have an answer for 14 of the 16 models, sizes and routes they cover on at least one of them. Placed wholly or partly on the card, by RigCheck's llama.cpp capacity estimates: Qwen3.8-Flash-Next in llama.cpp (3 of 7), Mistral Medium 3.5 in llama.cpp (3 of 7), Qwen3.8-27B in llama.cpp (5 of 7, without caveats or conditions on 4), Gemma 4 31B (5 of 7, without caveats or conditions on 4), Gemma 4 26B-A4B (5 of 7, without caveats or conditions on 4), Gemma 4 12B (5 of 7, without caveats or conditions on 4), Gemma 4 E4B (5 of 7, without caveats or conditions on 4), Gemma 4 E2B (5 of 7, without caveats or conditions on 4). On the processor in system RAM alone, the card unused: Qwen3.8-27B in llama.cpp (2 of 7), Gemma 4 31B (2 of 7), Gemma 4 26B-A4B (2 of 7), Gemma 4 12B (2 of 7), Gemma 4 E4B (2 of 7), Gemma 4 E2B (2 of 7). Answers that name no placement (Strata's published requirements, published route and recipe matches, planning budgets; some rest on system RAM alone, as the table says): Qwen3.8-Flash-Next in the Strata engine (all 7), Qwen-Image-2.1 (image generation) (3 of 7), MiniMax H3 (video + audio) (3 of 7), Nemotron 3.5 Bolt 74B-A9B (5 of 7), Nemotron 3.5 Super VL 120B-A12B (5 of 7), FLUX 3 Image Klein (int8, ComfyUI) (4 of 7). Which cards get an answer, and which answer, depends on the card and not only on its memory: the table lists them card by card. The llama.cpp language-model answers are capacity estimates and the Nemotron 3.5, GLM-5.3-Flash and DeepSeek V4.1 Flash answers are published route matches, not measured setups.
24 GB of VRAM: model by model
Language models
| Model (checker) | With 64 GB RAM, card by card |
|---|---|
| Qwen3.8-Flash-Next in the Strata engine | ✓ Runs IQ3_S Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti ✓ Runs IQ3_S Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Laptop GPUs run at lower power than desktop cards; expect lower speeds. On 1 of 7 cards: GeForce RTX 5090 Laptop ✓ Runs IQ3_S Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. The maintainers have no RX 7000 card; RX 7900 XTX, XT and GRE owners ran it (Linux and Windows). On 1 of 7 cards: Radeon RX 7900 XTX ! Experimental path IQ3_S Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Pascal / Volta cards use Strata's separate CUDA 12 engine (the cuda12 app on Windows or Linux, or a Linux build), covered by the community "Older GPUs" guide. On 1 of 7 cards: Tesla P40 ! Experimental path IQ3_S Linux only Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Intel Arc runs through Strata's experimental Intel (SYCL) engine, which you build from source on Linux (the app and the release zips have no Intel engine). One B60 measured ~12 tok/s (Coder) in the community report. On 1 of 7 cards: Intel Arc Pro B60 |
| Qwen3.8-Flash-Next in llama.cpp | ! Fits with caveats (capacity estimate) UD-IQ1_S · GPU and system RAM (54 GB in RAM) Flash-Next uses combined memory totals; per-card layer placement is not modeled. Close fits are uncertain until runtime allocation is checked. RigCheck capacity estimate, not a measured setup. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti ✕ Does not fit Even the smallest file (UD-IQ1_S, 72.5 GB) needs about 76.1 GB in system RAM. This checker does not cover your graphics card, so it is not counted; its memory could change the answer. On 4 of 7 cards: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60 |
| Mistral Medium 3.5 in llama.cpp | ! Fits with caveats (capacity estimate) Q3_K_M · GPU and system RAM (22 of 88 layers on the GPU): a dense model runs slowly from RAM RigCheck capacity estimate, not a measured setup. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti – Not covered On 4 of 7 cards: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60 |
| Qwen3.8-27B in llama.cpp | ✓ Fits (capacity estimate) UD-Q4_K_XL · GPU memory (input embeddings in system RAM) RigCheck capacity estimate, not a measured setup. On 4 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti, GeForce RTX 5090 Laptop ✓ Fits (capacity estimate) UD-Q4_K_XL · GPU memory (input embeddings in system RAM) On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run qwen3.8:27b, 18 GB) is a different file from the one checked here, so compare its size with your memory first. RigCheck capacity estimate, not a measured setup. On 1 of 7 cards: Radeon RX 7900 XTX ! Fits with caveats (capacity estimate) Q8_0 · system RAM, CPU only RigCheck capacity estimate, not a measured setup. On 2 of 7 cards: Tesla P40, Intel Arc Pro B60 |
| Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp | ✓ Best size: fits (capacity estimate) Gemma 4 31B: fits (capacity estimate) (IQ4_XS, GPU memory (input embeddings in system RAM)); Gemma 4 26B-A4B: fits (capacity estimate) (UD-Q4_K_XL, GPU memory (input embeddings in system RAM)); Gemma 4 12B: fits (capacity estimate) (Q8_0, GPU memory (input embeddings in system RAM)); Gemma 4 E4B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); Gemma 4 E2B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)) RigCheck capacity estimate, not a measured setup. On 4 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti, GeForce RTX 5090 Laptop ✓ Best size: fits (capacity estimate) Gemma 4 31B: fits (capacity estimate) (IQ4_XS, GPU memory (input embeddings in system RAM)); Gemma 4 26B-A4B: fits (capacity estimate) (UD-Q4_K_XL, GPU memory (input embeddings in system RAM)); Gemma 4 12B: fits (capacity estimate) (Q8_0, GPU memory (input embeddings in system RAM)); Gemma 4 E4B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); Gemma 4 E2B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)) On this Radeon card these are capacity estimates only: we found no source for Gemma 4 with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default packages (gemma4:31b 19–20 GB, gemma4:26b 16–19 GB, gemma4:12b 7.7–8.0 GB, gemma4:e4b 6.6–9.5 GB, gemma4:e2b 4.6–7.5 GB) are different files from the ones checked here. RigCheck capacity estimate, not a measured setup. On 1 of 7 cards: Radeon RX 7900 XTX ! Best size: fits with caveats (capacity estimate) Gemma 4 31B: fits with caveats (capacity estimate) (Q8_0, system RAM, CPU only); Gemma 4 26B-A4B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 12B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 E4B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 E2B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only) RigCheck capacity estimate, not a measured setup. On 2 of 7 cards: Tesla P40, Intel Arc Pro B60 |
| Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B) | ! Best size: a published route or recipe matches, with caveats Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 80 GB budget: UD-IQ2_M, UD-Q2_K_XL or UD-IQ3_XXS (55.9–59.8 GB)) Nemotron 3.5 Bolt 74B-A9B: NVIDIA publishes no recipe for a 24 GB card; its discrete-GPU recipes start at 32 GB. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 24 GB of VRAM + 64 GB of RAM = 88 GB. Longer contexts and video need more. On 2 of 7 cards: GeForce RTX 4090, GeForce RTX 5090 Laptop ! Best size: a published route or recipe matches, with caveats Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 80 GB budget: UD-IQ2_M, UD-Q2_K_XL or UD-IQ3_XXS (55.9–59.8 GB)) Nemotron 3.5 Bolt 74B-A9B: This card is outside the architectures NVIDIA's GGUF card lists (Ada Lovelace, Blackwell), and NVIDIA publishes no recipe for it. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 24 GB of VRAM + 64 GB of RAM = 88 GB. Longer contexts and video need more. On 2 of 7 cards: GeForce RTX 3090 / 3090 Ti ! Best size: a published route or recipe matches, with caveats Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 64 GB budget: UD-IQ1_M (46.1 GB) or UD-IQ2_XXS (51.1 GB)) Nemotron 3.5 Bolt 74B-A9B: We found no source covering AMD GPUs for this model, so only system RAM is counted here. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: We found no source covering AMD or Intel GPUs for this model, so only system RAM is counted. Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 64 GB of RAM = 64 GB. Longer contexts and video need more. On 1 of 7 cards: Radeon RX 7900 XTX – Not covered On 2 of 7 cards: Tesla P40, Intel Arc Pro B60 |
No answer on any of these cards: Mistral Large 4, Kolibri-1 (official FP8 route), GLM-5.3-Flash (Unsloth GGUF), DeepSeek V4.1 Flash (September release, 1017 update) in DwarfStar
| Model (checker) | With 64 GB RAM, card by card |
|---|---|
| Mistral Large 4 | … Weights not released smallest estimate ~210 GB vs 88 GB of memory (VRAM + RAM, or a Mac's unified memory) On all 7 cards |
| Kolibri-1 (official FP8 route) | – Not covered On all 7 cards |
| GLM-5.3-Flash (Unsloth GGUF) | ✕ Does not fit Unsloth's table puts the 1-bit GGUF (93.1–97.6 GB) at 100 GB of total memory, RAM + VRAM or unified memory. This setup counts 24 GB of VRAM + 64 GB of RAM = 88 GB. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti ✕ Does not fit Unsloth's table puts the 1-bit GGUF (93.1–97.6 GB) at 100 GB of total memory, RAM + VRAM or unified memory. This setup counts 64 GB of RAM (this card is not counted: Unsloth names CUDA, CPU-only and Metal builds, no AMD or Intel GPU build). On 1 of 7 cards: Radeon RX 7900 XTX – Not covered On 3 of 7 cards: GeForce RTX 5090 Laptop, Tesla P40, Intel Arc Pro B60 |
| DeepSeek V4.1 Flash (September release, 1017 update) in DwarfStar | – Best size: not covered DeepSeek V4.1 Flash September release: not covered; DeepSeek V4.1 Flash 1017 update: not covered On 4 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti, Radeon RX 7900 XTX – Not covered On 3 of 7 cards: GeForce RTX 5090 Laptop, Tesla P40, Intel Arc Pro B60 |
Image models
| Model (checker) | With 64 GB RAM, card by card |
|---|---|
| Qwen-Image-2.1 (image generation) | ! Planning estimate only Above the all-components-resident planning budget; offload peak unverified Uncalibrated allowances, not a minimum or a guarantee. Full checkpoint files are counted in host RAM even when mmap or sequential loading can use less. Actual peak depends on attention, prefix caches, VAE tiling, reference sizes and backend. No speed prediction. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti – Not covered On 4 of 7 cards: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60 |
| FLUX 3 Image Klein (int8, ComfyUI) | ! A published route or recipe matches, with caveats Matches BFL's 8 GB guidance: the int8 files in ComfyUI BFL: the int8 ComfyUI files run on 8 GB GPUs such as the RTX 3070. Image model, int8 text encoder and VAE together are 11.0 GB; by our reading, on a card smaller than that ComfyUI keeps them on the GPU one at a time and needs system RAM for the rest. BFL gives no RAM figure. The prompt upsampler BFL says not to skip is a 9B model (6.72 GB w4a8, 9.75 GB int8 or 18.8 GB BF16 in ComfyUI); BFL does not say whether its 8 GB figure includes it. When it does not fit with the image model, run it on its own first (BFL's README) or switch it off in the ComfyUI template, with weaker results. On 4 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti, GeForce RTX 5090 Laptop – Not covered On 3 of 7 cards: Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60 |
Video models
| Model (checker) | With 64 GB RAM, card by card |
|---|---|
| MiniMax H3 (video + audio) | ! A published route or recipe matches, with caveats Hardware memory matches a published video recipe; exact clip peak unverified H3-Base FL2VA, source recipe canvases only. Disk-streaming routes assume an NVMe drive. Host-RAM and lab assumptions remain in the full checker; full 2K needs an API. Matching recipes: SGLang, one 24 GB card (measured): one card, DiT and text encoder streamed layer by layer; GPU peak about 18 GB; RTX 4090 D: 1344×768, 107 frames, 20 steps in 405.6 s at BF16, 303.3 s with convrot_int8 (host RAM not stated for this run; we require the 32 GB of the cookbook's smallest recipe (RigCheck assumption); a 4090 on a 32 GB host has not been measured) | SGLang Recipe A (lab): one card, DiT, text encoder and VAE streamed from the checkpoint file on an NVMe drive (Recipe A), BF16; measured at 864×480 (at the native 768P the cookbook says to use video_vae=24 if the decode runs out of memory, not measured); lab run with VRAM capped at 12 GiB and a simulated 32 GB host: shows the memory fits, not your card's speed; a real 32 GB machine re-reads the weights from disk on every step On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti – Not covered On 4 of 7 cards: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60 |
Quick setup, as in the home page finder: one card, a 32K context and no image input for the llama.cpp capacity estimates (Nemotron 3.5, GLM-5.3-Flash and DeepSeek V4.1 Flash are matched against published recipes, memory tables and routes at their own context instead (NVIDIA's 64K / 256K recipes; Unsloth's GLM table states no context length; DwarfStar's routes per DeepSeek checkpoint (documented for the September weights, experimental for 1017), not llama.cpp).), the better of Windows and Linux for Strata, an NVMe SSD, 64 GB of system RAM; for the image and video rows, Qwen-Image (a planning budget): base model, INT8, 512×512, batch one, no reference images; Kolibri-1: the official FP8 route at a 32K context; MiniMax H3: local H3-Base FL2VA recipes, assuming an NVMe drive; Nemotron 3.5: Bolt and Super VL on one card with the RAM given; FLUX 3 Image Klein: Black Forest Labs' int8 ComfyUI route on the card. "With caveats" means part of the model sits in system RAM (slower), an unmeasured peak, or a route the checker marks conditional. Cards with the same answer, word for word, share a line; "RTX 3070 / 3070 Ti" is two cards the checkers treat alike. There is no speed line, because speeds differ between cards with the same memory; where a checker's own conditions mention a speed, they name the hardware it was measured on. Each card's page and the full checkers show measured speeds, labeled. Pick your card in a checker for your exact setup.
What system RAM changes
The checkers' own answers for the same cards with 32 GB instead of 64 GB of system RAM, and, for 64 GB, the smallest larger RAM size for which a checker gives a better answer. Parts of a large model that do not fit on the card are kept in system RAM, so RAM matters as much as VRAM for the big mixture-of-experts models.
With 32 GB of RAM
- Qwen3.8-Flash-Next in the Strata engine. With 32 GB: ! Runs, with caveats; IQ2_XS; Runs in low-RAM mode: the 24 GB+ card holds part of the experts and the rest are copied from a file on the SSD into RAM at start. Your card was not benchmarked; this is the closest published card. Less memory bandwidth or VRAM means lower speed. The estimate assumes 64 GB of RAM; with 32 GB your PC runs it in low-RAM mode, which is slower. For code, the Coder (IQ1_M) runs here with its experts copied into RAM at start; Strata: it is weaker outside code and in languages other than English. Strata's installer pre-selects IQ3_XXS for 56 GB of RAM + VRAM, which would read experts from the SSD in low-RAM mode here (slower); RigCheck picks IQ2_XS, whose experts Strata copies into RAM at start on this PC. With 64 GB: ✓ Runs; IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. On 1 of 7 cards: GeForce RTX 4090.
- Qwen3.8-Flash-Next in the Strata engine. With 32 GB: ! Runs, with caveats; IQ2_XS; Runs in low-RAM mode: the 24 GB+ card holds part of the experts and the rest are copied from a file on the SSD into RAM at start. The estimate assumes 64 GB of RAM; with 32 GB your PC runs it in low-RAM mode, which is slower. For code, the Coder (IQ1_M) runs here with its experts copied into RAM at start; Strata: it is weaker outside code and in languages other than English. Strata's installer pre-selects IQ3_XXS for 56 GB of RAM + VRAM, which would read experts from the SSD in low-RAM mode here (slower); RigCheck picks IQ2_XS, whose experts Strata copies into RAM at start on this PC. With 64 GB: ✓ Runs; IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. On 2 of 7 cards: GeForce RTX 3090 / 3090 Ti.
- Qwen3.8-Flash-Next in the Strata engine. With 32 GB: ! Runs, with caveats; IQ2_XS; Runs in low-RAM mode: the 24 GB+ card holds part of the experts and the rest are copied from a file on the SSD into RAM at start. Your card was not benchmarked; this is the closest published card. Less memory bandwidth or VRAM means lower speed. The estimate assumes 64 GB of RAM; with 32 GB your PC runs it in low-RAM mode, which is slower. For code, the Coder (IQ1_M) runs here with its experts copied into RAM at start; Strata: it is weaker outside code and in languages other than English. Strata's installer pre-selects IQ3_XXS for 56 GB of RAM + VRAM, which would read experts from the SSD in low-RAM mode here (slower); RigCheck picks IQ2_XS, whose experts Strata copies into RAM at start on this PC. Laptop GPUs run at lower power than desktop cards; expect lower speeds. With 64 GB: ✓ Runs; IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Laptop GPUs run at lower power than desktop cards; expect lower speeds. On 1 of 7 cards: GeForce RTX 5090 Laptop.
- Qwen3.8-Flash-Next in the Strata engine. With 32 GB: ! Experimental path; IQ2_XS; Runs in low-RAM mode: the 24 GB+ card holds part of the experts and the rest are copied from a file on the SSD into RAM at start. For code, the Coder (IQ1_M) runs here with its experts copied into RAM at start; Strata: it is weaker outside code and in languages other than English. Strata's installer pre-selects IQ3_XXS for 56 GB of RAM + VRAM, which would read experts from the SSD in low-RAM mode here (slower); RigCheck picks IQ2_XS, whose experts Strata copies into RAM at start on this PC. Pascal / Volta cards use Strata's separate CUDA 12 engine (the cuda12 app on Windows or Linux, or a Linux build), covered by the community "Older GPUs" guide. With 64 GB: ! Experimental path; IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Pascal / Volta cards use Strata's separate CUDA 12 engine (the cuda12 app on Windows or Linux, or a Linux build), covered by the community "Older GPUs" guide. On 1 of 7 cards: Tesla P40.
- Qwen3.8-Flash-Next in the Strata engine. With 32 GB: ! Runs, with caveats; IQ2_XS; Runs in low-RAM mode: the 24 GB+ card holds part of the experts and the rest are copied from a file on the SSD into RAM at start. For code, the Coder (IQ1_M) runs here with its experts copied into RAM at start; Strata: it is weaker outside code and in languages other than English. Strata's installer pre-selects IQ3_XXS for 56 GB of RAM + VRAM, which would read experts from the SSD in low-RAM mode here (slower); RigCheck picks IQ2_XS, whose experts Strata copies into RAM at start on this PC. The maintainers have no RX 7000 card; RX 7900 XTX, XT and GRE owners ran it (Linux and Windows). With 64 GB: ✓ Runs; IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. The maintainers have no RX 7000 card; RX 7900 XTX, XT and GRE owners ran it (Linux and Windows). On 1 of 7 cards: Radeon RX 7900 XTX.
- Qwen3.8-Flash-Next in the Strata engine. With 32 GB: ! Experimental path; IQ3_XXS; Linux only; With the xe driver, Strata's Intel port streams the experts into VRAM and keeps the rest in a pinned copy in RAM, so the NVIDIA / AMD RAM rule does not apply (INTEL.md); it will not start if an expert is in neither. RigCheck assumes the experts plus ~12 GB must fit in VRAM and RAM together; no run at this memory is published. With the i915 driver (Arc A-series) every expert stays in RAM. For code, the Coder (IQ1_M) runs here with its experts in RAM; Strata: it is weaker outside code and in languages other than English. Intel Arc runs through Strata's experimental Intel (SYCL) engine, which you build from source on Linux (the app and the release zips have no Intel engine). One B60 measured ~12 tok/s (Coder) in the community report. With 64 GB: ! Experimental path; IQ3_S; Linux only; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Intel Arc runs through Strata's experimental Intel (SYCL) engine, which you build from source on Linux (the app and the release zips have no Intel engine). One B60 measured ~12 tok/s (Coder) in the community report. On 1 of 7 cards: Intel Arc Pro B60.
- Qwen3.8-Flash-Next in llama.cpp. With 32 GB: ✕ Does not fit; Even the smallest file (UD-IQ1_S, 72.5 GB) needs about 76.1 GB. With 64 GB: ! Fits with caveats (capacity estimate); UD-IQ1_S · GPU and system RAM (54 GB in RAM); Flash-Next uses combined memory totals; per-card layer placement is not modeled. Close fits are uncertain until runtime allocation is checked.; RigCheck capacity estimate, not a measured setup. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti.
- Mistral Medium 3.5 in llama.cpp. With 32 GB: ✕ Does not fit; Even the smallest file (UD-IQ2_XXS, 34.9 GB) needs about 49 GB. With 64 GB: ! Fits with caveats (capacity estimate); Q3_K_M · GPU and system RAM (22 of 88 layers on the GPU): a dense model runs slowly from RAM; RigCheck capacity estimate, not a measured setup. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti.
- Qwen3.8-27B in llama.cpp. With 32 GB: ! Fits with caveats (capacity estimate); UD-Q4_K_XL · system RAM, CPU only; RigCheck capacity estimate, not a measured setup. With 64 GB: ! Fits with caveats (capacity estimate); Q8_0 · system RAM, CPU only; RigCheck capacity estimate, not a measured setup. On 2 of 7 cards: Tesla P40, Intel Arc Pro B60.
- Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp. With 32 GB: ! Best size: fits with caveats (capacity estimate); Gemma 4 31B: fits with caveats (capacity estimate) (IQ4_XS, system RAM, CPU only); Gemma 4 26B-A4B: fits with caveats (capacity estimate) (UD-Q4_K_XL, system RAM, CPU only); Gemma 4 12B: fits with caveats (capacity estimate) (Q8_0, system RAM, CPU only); Gemma 4 E4B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 E2B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); RigCheck capacity estimate, not a measured setup. With 64 GB: ! Best size: fits with caveats (capacity estimate); Gemma 4 31B: fits with caveats (capacity estimate) (Q8_0, system RAM, CPU only); Gemma 4 26B-A4B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 12B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 E4B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 E2B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); RigCheck capacity estimate, not a measured setup. On 2 of 7 cards: Tesla P40, Intel Arc Pro B60.
- Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B). With 32 GB: ! Best size: a published route or recipe matches, with caveats; Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: does not fit; Nemotron 3.5 Bolt 74B-A9B: NVIDIA publishes no recipe for a 24 GB card; its discrete-GPU recipes start at 32 GB. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 32 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth plans at least 64 GB of RAM or unified memory for its smallest GGUF (UD-IQ1_M, 46.1 GB); llama.cpp can split the model across RAM and VRAM. This setup counts 24 GB of VRAM + 32 GB of RAM = 56 GB. With 64 GB: ! Best size: a published route or recipe matches, with caveats; Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 80 GB budget: UD-IQ2_M, UD-Q2_K_XL or UD-IQ3_XXS (55.9–59.8 GB)); Nemotron 3.5 Bolt 74B-A9B: NVIDIA publishes no recipe for a 24 GB card; its discrete-GPU recipes start at 32 GB. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 24 GB of VRAM + 64 GB of RAM = 88 GB. Longer contexts and video need more. On 2 of 7 cards: GeForce RTX 4090, GeForce RTX 5090 Laptop.
- Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B). With 32 GB: ! Best size: a published route or recipe matches, with caveats; Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: does not fit; Nemotron 3.5 Bolt 74B-A9B: This card is outside the architectures NVIDIA's GGUF card lists (Ada Lovelace, Blackwell), and NVIDIA publishes no recipe for it. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 32 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth plans at least 64 GB of RAM or unified memory for its smallest GGUF (UD-IQ1_M, 46.1 GB); llama.cpp can split the model across RAM and VRAM. This setup counts 24 GB of VRAM + 32 GB of RAM = 56 GB. With 64 GB: ! Best size: a published route or recipe matches, with caveats; Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 80 GB budget: UD-IQ2_M, UD-Q2_K_XL or UD-IQ3_XXS (55.9–59.8 GB)); Nemotron 3.5 Bolt 74B-A9B: This card is outside the architectures NVIDIA's GGUF card lists (Ada Lovelace, Blackwell), and NVIDIA publishes no recipe for it. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 24 GB of VRAM + 64 GB of RAM = 88 GB. Longer contexts and video need more. On 2 of 7 cards: GeForce RTX 3090 / 3090 Ti.
- Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B). With 32 GB: ! Best size: a published route or recipe matches, with caveats; Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: does not fit; Nemotron 3.5 Bolt 74B-A9B: We found no source covering AMD GPUs for this model, so only system RAM is counted here. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 32 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: We found no source covering AMD or Intel GPUs for this model, so only system RAM is counted. Unsloth plans at least 64 GB of RAM or unified memory for its smallest GGUF (UD-IQ1_M, 46.1 GB); llama.cpp can split the model across RAM and VRAM. This setup counts 32 GB of RAM = 32 GB. With 64 GB: ! Best size: a published route or recipe matches, with caveats; Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 64 GB budget: UD-IQ1_M (46.1 GB) or UD-IQ2_XXS (51.1 GB)); Nemotron 3.5 Bolt 74B-A9B: We found no source covering AMD GPUs for this model, so only system RAM is counted here. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: We found no source covering AMD or Intel GPUs for this model, so only system RAM is counted. Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 64 GB of RAM = 64 GB. Longer contexts and video need more. On 1 of 7 cards: Radeon RX 7900 XTX.
With more than 64 GB of RAM
- Qwen3.8-Flash-Next in llama.cpp: with 96 GB of RAM, fits with caveats (capacity estimate) (UD-IQ3_XXS, system RAM, CPU only). On 4 of 7 cards: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60.
The 24 GB cards on this page
7 cards in 6 finder entries; an entry such as "RTX 3070 / 3070 Ti" is two cards the checkers treat alike. Each card's memory as its vendor states it (read 2026-10-18):
- GeForce RTX 4090: 24 GB GDDR6X (NVIDIA GeForce RTX 4090 specifications)
- GeForce RTX 3090 / 3090 Ti: 24 GB GDDR6X (RTX 3090 Ti) / 24 GB GDDR6X (RTX 3090) (NVIDIA GeForce RTX 3090 family specifications)
- GeForce RTX 5090 Laptop: 24 GB GDDR7 (NVIDIA GeForce RTX 50 Series laptop specifications)
- Tesla P40: GPU Memory 24 GB (NVIDIA Tesla P40 datasheet (PDF))
- Radeon RX 7900 XTX: 24 GB GDDR6 (AMD Radeon RX 7900 XTX specifications)
- Intel Arc Pro B60: Dedicated Memory 24GB of GDDR6 (Intel Arc Pro B60 GPU datasheet (PDF))
A Mac with 24 GB of unified memory is a different machine: its memory is shared by the graphics and the processor, see its own page.
FAQ
Can a 24 GB graphics card run Qwen3.8-Flash-Next in the Strata engine?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on all 7 24 GB cards in the finder. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti: Yes: IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. On 1 of 7 cards: GeForce RTX 5090 Laptop: Yes: IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Laptop GPUs run at lower power than desktop cards; expect lower speeds. On 1 of 7 cards: Radeon RX 7900 XTX: Yes: IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. The maintainers have no RX 7000 card; RX 7900 XTX, XT and GRE owners ran it (Linux and Windows). On 1 of 7 cards: Tesla P40: Only on an experimental path: IQ3_S; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Pascal / Volta cards use Strata's separate CUDA 12 engine (the cuda12 app on Windows or Linux, or a Linux build), covered by the community "Older GPUs" guide. On 1 of 7 cards: Intel Arc Pro B60: Only on an experimental path: IQ3_S; Linux only; Fits by the docs' rule (experts + ~10 GB), with little room to spare: close the browser while it runs. Intel Arc runs through Strata's experimental Intel (SYCL) engine, which you build from source on Linux (the app and the release zips have no Intel engine). One B60 measured ~12 tok/s (Coder) in the community report. The full checker takes your exact setup (RAM, disk, operating system, processor) and gives the install steps.
Can a 24 GB graphics card run Qwen3.8-Flash-Next in llama.cpp?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on 3 of the 7 24 GB cards in the finder: on 3 of them the model is placed wholly or partly on the card. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti: With caveats, by RigCheck's capacity estimate: UD-IQ1_S · GPU and system RAM (54 GB in RAM); Flash-Next uses combined memory totals; per-card layer placement is not modeled. Close fits are uncertain until runtime allocation is checked; RigCheck capacity estimate, not a measured setup. No answer on: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60. The full checker takes your exact setup (context length, RAM, image input) and gives the command to start it.
Can a 24 GB graphics card run Mistral Medium 3.5 in llama.cpp?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on 3 of the 7 24 GB cards in the finder: on 3 of them the model is placed wholly or partly on the card. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti: With caveats, by RigCheck's capacity estimate: Q3_K_M · GPU and system RAM (22 of 88 layers on the GPU): a dense model runs slowly from RAM; RigCheck capacity estimate, not a measured setup. No answer on: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60. The full checker takes your exact setup (context length, RAM, image input) and gives the command to start it.
Can a 24 GB graphics card run Qwen3.8-27B in llama.cpp?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on all 7 24 GB cards in the finder: on 5 of them the model is placed wholly or partly on the card, on 2 it runs on the processor in system RAM alone. On 4 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti, GeForce RTX 5090 Laptop: Yes, by RigCheck's capacity estimate: UD-Q4_K_XL · GPU memory (input embeddings in system RAM); RigCheck capacity estimate, not a measured setup. On 1 of 7 cards: Radeon RX 7900 XTX: Yes, by RigCheck's capacity estimate: UD-Q4_K_XL · GPU memory (input embeddings in system RAM); On this Radeon card this is a capacity estimate only: we found no source for this model with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default package (ollama run qwen3.8:27b, 18 GB) is a different file from the one checked here, so compare its size with your memory first; RigCheck capacity estimate, not a measured setup. On 2 of 7 cards: Tesla P40, Intel Arc Pro B60: With caveats, by RigCheck's capacity estimate: Q8_0 · system RAM, CPU only; RigCheck capacity estimate, not a measured setup. The full checker takes your exact setup (context length, RAM, image input) and gives the command to start it.
Can a 24 GB graphics card run Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on all 7 24 GB cards in the finder: on 5 of them the model is placed wholly or partly on the card, on 2 it runs on the processor in system RAM alone. On 4 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti, GeForce RTX 5090 Laptop: Yes, by RigCheck's capacity estimate: Gemma 4 31B: fits (capacity estimate) (IQ4_XS, GPU memory (input embeddings in system RAM)); Gemma 4 26B-A4B: fits (capacity estimate) (UD-Q4_K_XL, GPU memory (input embeddings in system RAM)); Gemma 4 12B: fits (capacity estimate) (Q8_0, GPU memory (input embeddings in system RAM)); Gemma 4 E4B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); Gemma 4 E2B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); RigCheck capacity estimate, not a measured setup. On 1 of 7 cards: Radeon RX 7900 XTX: Yes, by RigCheck's capacity estimate: Gemma 4 31B: fits (capacity estimate) (IQ4_XS, GPU memory (input embeddings in system RAM)); Gemma 4 26B-A4B: fits (capacity estimate) (UD-Q4_K_XL, GPU memory (input embeddings in system RAM)); Gemma 4 12B: fits (capacity estimate) (Q8_0, GPU memory (input embeddings in system RAM)); Gemma 4 E4B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); Gemma 4 E2B: fits (capacity estimate) (BF16, GPU memory (input embeddings in system RAM)); On this Radeon card these are capacity estimates only: we found no source for Gemma 4 with llama.cpp's own AMD builds. Ollama lists this card for its ROCm support, but its default packages (gemma4:31b 19–20 GB, gemma4:26b 16–19 GB, gemma4:12b 7.7–8.0 GB, gemma4:e4b 6.6–9.5 GB, gemma4:e2b 4.6–7.5 GB) are different files from the ones checked here; RigCheck capacity estimate, not a measured setup. On 2 of 7 cards: Tesla P40, Intel Arc Pro B60: With caveats, by RigCheck's capacity estimate: Gemma 4 31B: fits with caveats (capacity estimate) (Q8_0, system RAM, CPU only); Gemma 4 26B-A4B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 12B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 E4B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); Gemma 4 E2B: fits with caveats (capacity estimate) (BF16, system RAM, CPU only); RigCheck capacity estimate, not a measured setup. The full checker takes your exact setup (context length, RAM, image input) and gives the command to start it.
Can a 24 GB graphics card run Qwen-Image-2.1 (image generation)?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on 3 of the 7 24 GB cards in the finder. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti: Only as a planning estimate: the checker's uncalibrated memory budget, offload peak unverified: Above the all-components-resident planning budget; offload peak unverified; Uncalibrated allowances, not a minimum or a guarantee. Full checkpoint files are counted in host RAM even when mmap or sequential loading can use less. Actual peak depends on attention, prefix caches, VAE tiling, reference sizes and backend. No speed prediction. No answer on: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60. The full checker lets you change the task, resolution, references and offload (batch is fixed at one), and lists the files.
Can a 24 GB graphics card run MiniMax H3 (video + audio)?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on 3 of the 7 24 GB cards in the finder. On 3 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti: A published route or recipe matches, with caveats: Hardware memory matches a published video recipe; exact clip peak unverified; H3-Base FL2VA, source recipe canvases only. Disk-streaming routes assume an NVMe drive. Host-RAM and lab assumptions remain in the full checker; full 2K needs an API; Matching recipes: SGLang, one 24 GB card (measured): one card, DiT and text encoder streamed layer by layer; GPU peak about 18 GB; RTX 4090 D: 1344×768, 107 frames, 20 steps in 405.6 s at BF16, 303.3 s with convrot_int8 (host RAM not stated for this run; we require the 32 GB of the cookbook's smallest recipe (RigCheck assumption); a 4090 on a 32 GB host has not been measured) | SGLang Recipe A (lab): one card, DiT, text encoder and VAE streamed from the checkpoint file on an NVMe drive (Recipe A), BF16; measured at 864×480 (at the native 768P the cookbook says to use video_vae=24 if the decode runs out of memory, not measured); lab run with VRAM capped at 12 GiB and a simulated 32 GB host: shows the memory fits, not your card's speed; a real 32 GB machine re-reads the weights from disk on every step. No answer on: GeForce RTX 5090 Laptop, Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60. The full checker lets you change the route or recipe settings and lists the files and the published recipe.
Can a 24 GB graphics card run Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B)?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on 5 of the 7 24 GB cards in the finder. On 2 of 7 cards: GeForce RTX 4090, GeForce RTX 5090 Laptop: A published route or recipe matches, with caveats: Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 80 GB budget: UD-IQ2_M, UD-Q2_K_XL or UD-IQ3_XXS (55.9–59.8 GB)); Nemotron 3.5 Bolt 74B-A9B: NVIDIA publishes no recipe for a 24 GB card; its discrete-GPU recipes start at 32 GB. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 24 GB of VRAM + 64 GB of RAM = 88 GB. Longer contexts and video need more. On 2 of 7 cards: GeForce RTX 3090 / 3090 Ti: A published route or recipe matches, with caveats: Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 80 GB budget: UD-IQ2_M, UD-Q2_K_XL or UD-IQ3_XXS (55.9–59.8 GB)); Nemotron 3.5 Bolt 74B-A9B: This card is outside the architectures NVIDIA's GGUF card lists (Ada Lovelace, Blackwell), and NVIDIA publishes no recipe for it. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 24 GB of VRAM + 64 GB of RAM = 88 GB. Longer contexts and video need more. On 1 of 7 cards: Radeon RX 7900 XTX: A published route or recipe matches, with caveats: Nemotron 3.5 Bolt 74B-A9B: a published route or recipe matches, with caveats (Matches Unsloth's short-context budget: about 32 GB of RAM or unified memory); Nemotron 3.5 Super VL 120B-A12B: a published route or recipe matches, with caveats (Matches Unsloth's 64 GB budget: UD-IQ1_M (46.1 GB) or UD-IQ2_XXS (51.1 GB)); Nemotron 3.5 Bolt 74B-A9B: We found no source covering AMD GPUs for this model, so only system RAM is counted here. Unsloth budgets around 32 GB of RAM or unified memory for short-context use (48–64 GB for more headroom) with its 22 GB IQ2_XXS GGUF in llama.cpp; longer contexts, images and video need more. This system RAM is 64 GB. That is Unsloth's planning estimate, not a measured run on this hardware. Nemotron 3.5 Super VL 120B-A12B: We found no source covering AMD or Intel GPUs for this model, so only system RAM is counted. Unsloth's planning estimate for a modest context, including the OS, runtime, KV cache and vision file; not a measured run. This setup counts 64 GB of RAM = 64 GB. Longer contexts and video need more. No answer on: Tesla P40, Intel Arc Pro B60. The full checker lets you change the route or recipe settings and lists the files and the published recipe.
Can a 24 GB graphics card run FLUX 3 Image Klein (int8, ComfyUI)?
In RigCheck's quick setup with 64 GB of system RAM, the checker has an answer on 4 of the 7 24 GB cards in the finder. On 4 of 7 cards: GeForce RTX 4090, GeForce RTX 3090 / 3090 Ti, GeForce RTX 5090 Laptop: A published route or recipe matches, with caveats: Matches BFL's 8 GB guidance: the int8 files in ComfyUI; BFL: the int8 ComfyUI files run on 8 GB GPUs such as the RTX 3070. Image model, int8 text encoder and VAE together are 11.0 GB; by our reading, on a card smaller than that ComfyUI keeps them on the GPU one at a time and needs system RAM for the rest. BFL gives no RAM figure. The prompt upsampler BFL says not to skip is a 9B model (6.72 GB w4a8, 9.75 GB int8 or 18.8 GB BF16 in ComfyUI); BFL does not say whether its 8 GB figure includes it. When it does not fit with the image model, run it on its own first (BFL's README) or switch it off in the ComfyUI template, with weaker results. No answer on: Tesla P40, Radeon RX 7900 XTX, Intel Arc Pro B60. The full checker lets you change the route or recipe settings and lists the files and the published recipe.
Why do 24 GB cards get different answers?
Each checker judges the card itself, with its own support list and the routes its sources name, not only the memory size. On this page that happens for Qwen3.8-Flash-Next in the Strata engine, Qwen3.8-Flash-Next in llama.cpp, Mistral Medium 3.5 in llama.cpp, Qwen3.8-27B in llama.cpp, Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp, Qwen-Image-2.1 (image generation), MiniMax H3 (video + audio), Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B), FLUX 3 Image Klein (int8, ComfyUI), GLM-5.3-Flash (Unsloth GGUF), DeepSeek V4.1 Flash (September release, 1017 update) in DwarfStar; the table lists each card's answer. Speeds also differ between cards with the same memory, so this page has no speed line: each card's own page and the full checkers show measured speeds, labeled.
How does system RAM change what a 24 GB card can run?
With 32 GB instead of 64 GB, the answer changes on some or all of these cards for 6 models: Qwen3.8-Flash-Next in the Strata engine, Qwen3.8-Flash-Next in llama.cpp, Mistral Medium 3.5 in llama.cpp, Qwen3.8-27B in llama.cpp, Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp, Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B). With more than 64 GB, a checker gives a better answer for 1 model: Qwen3.8-Flash-Next in llama.cpp. See What system RAM changes for the cards and the answers.
Other memory sizes
8 GB · 12 GB · 16 GB · 32 GB · All VRAM sizes · Graphics cards · Macs · Any other machine
Sources
- DeepSeek V4.1 Flash (September release, 1017 update) in DwarfStar: the checker, its sources and assumptions
- FLUX 3 Image Klein (int8, ComfyUI): the checker, its sources and assumptions
- Gemma 4 (E2B, E4B, 12B, 26B-A4B, 31B) in llama.cpp: the checker, its sources and assumptions
- GLM-5.3-Flash (Unsloth GGUF): the checker, its sources and assumptions
- Kolibri-1 (official FP8 route): the checker, its sources and assumptions
- MiniMax H3 (video + audio): the checker, its sources and assumptions
- Mistral Large 4: the checker, its sources and assumptions
- Mistral Medium 3.5 in llama.cpp: the checker, its sources and assumptions
- Nemotron 3.5 (Bolt 74B-A9B, Super VL 120B-A12B): the checker, its sources and assumptions
- Qwen3.8-27B in llama.cpp: the checker, its sources and assumptions
- Qwen3.8-Flash-Next in llama.cpp: the checker, its sources and assumptions
- Qwen-Image-2.1 (image generation): the checker, its sources and assumptions
- Qwen3.8-Flash-Next in the Strata engine: the checker, its sources and assumptions
- NVIDIA Tesla P40 datasheet (PDF): card memory
- AMD Radeon RX 7900 XTX specifications: card memory
- Intel Arc Pro B60 GPU datasheet (PDF): card memory
- NVIDIA GeForce RTX 3090 family specifications: card memory
- NVIDIA GeForce RTX 4090 specifications: card memory
- NVIDIA GeForce RTX 50 Series laptop specifications: card memory