What LLMs can Desktop PC · GeForce RTX 4060 Ti 16GB · 32 GB RAM run?
16 GB VRAM + 32 GB RAM, 288 GB/s memory bandwidth, about $1,350. Every open model in our catalog, rated by the engine for chat and for agentic coding.
Runs well (17)
Fast enough and with memory to spare for everyday chat.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| gpt-oss-20bOpenAIOpen source | Excellent | Comfortable | MXFP4 | 50–85 tok/s |
| Gemma 4 26B-A4BGoogleOpen source | Excellent | Acceptable | Q3_K_M | 55–95 tok/s |
| MiniCPM5 2BOpenBMBOpen source | Excellent | Acceptable | Q8_0 | 50–85 tok/s |
| Qwen3.5 4BAlibaba QwenOpen source | Excellent | Acceptable | Q8_0 | 30–50 tok/s |
| Qwen3.5 9BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 17–30 tok/s |
| Gemma 4 12BGoogleOpen source | Excellent | Acceptable | Q5_K_M | 16–25 tok/s |
| GLM-4.6V-Flash (10B)Z.aiOpen source | Excellent | Acceptable | Q5_K_M | 19–30 tok/s |
| Qwen3 8BAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 19–30 tok/s |
| DeepSeek-R1-0528-Qwen3-8BDeepSeekOpen source | Excellent | Acceptable | Q6_K | 19–30 tok/s |
| Gemma 4 E4BGoogleOpen source | Excellent | Borderline | Q6_K | 20–35 tok/s |
| Qwen3 14BAlibaba QwenOpen source | Excellent | Borderline | Q4_K_M | 15–25 tok/s |
| Llama 3.2 3B InstructMetaOpen weights (restricted) | Excellent | Technically Runs | Q6_K | 50–80 tok/s |
| Llama 3.1 8B InstructMetaOpen weights (restricted) | Excellent | Borderline | Q6_K | 20–35 tok/s |
| Phi-4 (14B)MicrosoftOpen source | Excellent | Acceptable | Q4_K_M | 15–25 tok/s |
| Qwen2.5-Coder 7B InstructAlibaba QwenOpen source | Excellent | Acceptable | Q6_K | 20–35 tok/s |
| Mistral Small 3.2 (24B)Mistral AIOpen source | Comfortable | Borderline | Q3_K_M | 12–19 tok/s |
| Devstral Small 2 (24B)Mistral AIOpen source | Comfortable | Borderline | Q3_K_M | 12–19 tok/s |
Loads, but not recommended (17)
Technically runs. Expect a frustrating experience.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| LFM2.5 24B-A2BLiquid AI | Borderline | Borderline | Q4_K_M | 85–140 tok/s |
| Recursive Flint (40B-A2.5B)RecursiveOpen source | Borderline | Borderline | MXFP4 | 40–65 tok/s |
| Qwen3.6 35B-A3BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 30–45 tok/s |
| GLM-4.7-Flash (30B-A3B)Z.aiOpen source | Borderline | Borderline | Q4_K_M | 35–60 tok/s |
| Qwen3.5 35B-A3BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 30–45 tok/s |
| Qwen3 30B-A3B Instruct 2507Alibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 30–45 tok/s |
| Qwen3.8 27BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 6–10 tok/s |
| Qwen3.6 27BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 6–9 tok/s |
| Qwen3-Coder 30B-A3B InstructAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 30–45 tok/s |
| Qwen3.5 27BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 6–10 tok/s |
| Gemma 4 31BGoogleOpen source | Borderline | Borderline | Q4_K_M | 4.2–7 tok/s |
| Qwen3-Next 80B-A3B InstructAlibaba QwenOpen source | Borderline | Does Not Fit | Q3_K_M | 25–40 tok/s |
| Muse Glimmer (30B)MetaOpen source | Borderline | Borderline | Q4_K_M | 6–10 tok/s |
| Gemma 3 27BGoogleOpen weights (restricted) | Borderline | Borderline | Q4_K_M | 6–9 tok/s |
| Qwen3 32BAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 3.3–6 tok/s |
| Qwen2.5-Coder 32B InstructAlibaba QwenOpen source | Borderline | Borderline | Q4_K_M | 3.2–5 tok/s |
| Llama 3.3 70B InstructMetaOpen weights (restricted) | Technically Runs | Does Not Fit | Q3_K_M | 1.3–2.2 tok/s |
Doesn't fit or isn't supported (16)
Not enough usable memory, or the runtime can't run it here.
| Model | Chat | Agentic coding | Quant | Chat speed |
|---|---|---|---|---|
| DeepSeek-V4.1-Flash (748B-A16B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Kolibri-1 (78B-A3.5B)Aleph AlphaOpen source | Does Not Fit | Does Not Fit | — | — |
| Muse Spark Open 816B-A42BMeta | Does Not Fit | Does Not Fit | — | — |
| Nemotron 3.5 Bolt 74B-A9BNVIDIA | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3 (753B-A40B)Z.ai | Does Not Fit | Does Not Fit | — | — |
| GLM-5.3-Flash (320B-A18B)Z.aiOpen source | Does Not Fit | Does Not Fit | — | — |
| DeepSeek-V4-Flash (284B-A13B)DeepSeekOpen source | Does Not Fit | Does Not Fit | — | — |
| Mistral Small 4 (119B-A6.5B)Mistral AIOpen source | Does Not Fit | Does Not Fit | — | — |
| Qwen3.5 122B-A10BAlibaba QwenOpen source | Does Not Fit | Does Not Fit | — | — |
| gpt-oss-120bOpenAIOpen source | Does Not Fit | Does Not Fit | — | — |
| GLM-4.5-Air (106B-A12B)Z.aiOpen source | Does Not Fit | Does Not Fit | — | — |
| Llama 4 Scout (109B-A17B)MetaOpen weights (restricted) | Does Not Fit | Does Not Fit | — | — |
| Nemotron 3.5 Super VL 120B-A12BNVIDIA | Unsupported | Unsupported | — | — |
| Reflection Beam (501B-A23B)Reflection AIOpen source | Unsupported | Unsupported | — | — |
| Step 5 Preview 600B-A27BStepfun | Unsupported | Unsupported | — | — |
| MiMo-V2.6-Pro-RL (1T-A42B)Xiaomi MiMoOpen source | Unsupported | Unsupported | — | — |
Want a specific tool, context size or workload?
The full check models your exact setup, including the apps you keep open.