Gemma Local Deployment Guide: Run Gemma 4 and Gemma 3 with Ollama, Sized by VRAM
Gemma local deployment with Ollama: compare Gemma 4 e2b, e4b, 12b, 26b and 31b sizes and context, pick one by VRAM, and set thinking mode, sampling, and fixes.
Gemma local deployment with Ollama: compare Gemma 4 e2b, e4b, 12b, 26b and 31b sizes and context, pick one by VRAM, and set thinking mode, sampling, and fixes.
gpt-oss local deployment with Ollama and llama.cpp: official memory needs for 20b and 120b, MXFP4, MoE offload flags, and reasoning effort.
Choosing a laptop for local LLMs? Compare RTX 50 laptop VRAM, bandwidth and power limits, cooling, and Mac unified memory, and see what 8GB to 24GB can run.
How to run Qwen locally: Ollama file sizes for Qwen3, 3.5, 3.6, 3.8, Coder and VL, a VRAM matching table, one-line commands and thinking-mode control.
Run DeepSeek locally the right way: R1 distills vs the full model vs V4, which Ollama tag fits 8GB to 48GB of VRAM, and four commands to get started.
Find the best GPU for local LLM use: VRAM tiers from 8GB to 32GB, matching models, bandwidth, power draw and dated price ranges, plus buying pitfalls.
LLM quantization explained: what Q4_K_M means, GGUF quant sizes and speeds side by side, and how to pick Q4, Q5 or Q8 for your VRAM, with Ollama commands.
How much VRAM does an LLM need? Use weights + KV cache + overhead to estimate from parameters, quantization and context, with quick tables for 8GB to 48GB.
Want to run an LLM locally? Learn how much VRAM you need, which models fit 8GB to 48GB, and how to get your first model running with Ollama in five steps.
Ollama not using GPU? Confirm with ollama ps, then check NVIDIA drivers, AMD ROCm, Vulkan, Mac and Docker, with the env vars and log paths to use.