Home AI Server: How to Build a Private LLM Box for Your NAS and Network
Build a home AI server for local LLMs: hardware tiers, Docker setup with Ollama and Open WebUI, NAS storage, remote access and the security steps that matter.
-
-
How to Read LLM Benchmarks Before You Pick a Local Model: A Buyer’s Guide to Leaderboards
How to read LLM benchmarks: what MMLU, GPQA, Arena votes and llama-bench measure, leaderboard traps, and a 20-prompt test you can run yourself.
-
LLM Rig Power and Cooling: PSU Sizing, Power Limits and Airflow for a Local AI PC
LLM rig power and cooling guide: how to size the PSU, use nvidia-smi power limits, plan airflow and noise, and avoid the mistakes that crash a GPU server.
-
Local LLM API Server: Turn Ollama or llama.cpp Into an OpenAI-Compatible Endpoint
Local LLM API server guide: expose Ollama or llama-server as an OpenAI-compatible endpoint, test it with curl and Python, and keep it safe on your network.
-
Local LoRA Fine-Tuning VRAM: How Much GPU Memory You Need for QLoRA and LoRA
Local LoRA fine-tuning VRAM explained: Unsloth minimums for QLoRA vs LoRA from 3B to 70B, what raises memory use, and the levers that fix training OOM.
-
Local LLM Model Size Chooser: 7B, 14B, 32B or 70B for Your VRAM and Task
Local LLM model size chooser: pick 7B, 14B, 32B or 70B from your VRAM and task with a five-step method, memory formulas and a table of starting sizes.
-
MoE Models for Local LLMs: Why a 30B Model Can Run Like a 3B One
MoE models for local LLMs explained: total vs active parameters, why speed follows active weights, memory needs of gpt-oss and Qwen3-30B-A3B, and offload tips.
-
RAM vs VRAM for Local LLMs: How CPU Offload Works and What It Costs in Speed
RAM vs VRAM for local LLMs: why memory bandwidth sets speed, how CPU offload splits a model, worked speed ceilings for a 70B model, and when more RAM helps.
-
LLM on Phone Offline: Run a Local Model on Android or iPhone with AI Edge Gallery, MLC Chat or Termux
Run an LLM on phone offline: five routes from AI Edge Gallery to MLC Chat and Termux, how big a model your RAM allows, and tips on heat, battery and privacy.
-
Local LLM Installation Service: How Remote Setup Works, What to Ask, and How to Stay Safe
Local LLM installation service: five steps of remote setup, scope and deliverables, remote access safety, an acceptance checklist and when DIY is faster.
