MoE Models for Local LLMs: Why a 30B Model Can Run Like a 3B One
MoE models for local LLMs explained: total vs active parameters, why speed follows active weights, memory needs of gpt-oss and Qwen3-30B-A3B, and offload tips.
-
-
RAM vs VRAM for Local LLMs: How CPU Offload Works and What It Costs in Speed
RAM vs VRAM for local LLMs: why memory bandwidth sets speed, how CPU offload splits a model, worked speed ceilings for a 70B model, and when more RAM helps.
