LLM Out of Memory Fix: A Local OOM Troubleshooting Checklist (Ollama and llama.cpp)
LLM out of memory fix for local models: check usage first, then cut context and parallelism, quantize the KV cache, and only then change model or hardware.
LLM out of memory fix for local models: check usage first, then cut context and parallelism, quantize the KV cache, and only then change model or hardware.
Ollama download slow? Check proxies and resume, move models with OLLAMA_MODELS, and pull GGUF files from ModelScope or Hugging Face. Windows, Mac, Linux.
Local LLM installation service: five steps of remote setup, scope and deliverables, remote access safety, an acceptance checklist and when DIY is faster.
Ollama not using GPU? Confirm with ollama ps, then check NVIDIA drivers, AMD ROCm, Vulkan, Mac and Docker, with the env vars and log paths to use.