KV cache calculator
Calculate KV cache memory requirements for any model on supported GPU systems
Tested: Nemotron, DeepSeek V4, Gemma 4, Kimi, ... — type to autocomplete
Gated model? Add your HF token in Settings →
Calculate KV cache memory requirements for any model on supported GPU systems