GPU Fit Checker — Can I Run This LLM?

Check if any LLM fits on your GPU. Enter model size, quantization, context length, and VRAM.

🎮 Check Compatibility

Model Size (B params)

Quantization

Your GPU VRAM (GB)

Context Length

✅ FITS!
Need 2.2 GB — you have 8 GB

🔍 How It Works

The calculator estimates total VRAM needed including model weights, KV cache, and overhead. If the total fits within your GPU's VRAM, the model can run. If not, try a smaller quantization, shorter context, or smaller model.

⚡ Common GPUs

GPU	VRAM	Max 7B Q4	Max 70B Q4
RTX 4060	8 GB	✅ Yes	❌ No
RTX 4090	24 GB	✅ Yes	⚠️ 4-bit
A100	80 GB	✅ Yes	✅ Yes