LLM GPU Calculator: Estimate VRAM for Any Model Size, Quantization and Context (Free Online Tool)
Free LLM GPU calculator: pick a model, quantization and context length to estimate VRAM, with weight and KV-cache cheat sheets, the formula and 24 GB examples.