Mini PC for Large LLMs: Ryzen AI Max+ 395, DGX Spark and Mac with 128GB of Unified Memory
Mini PC for large LLMs: Ryzen AI Max+ 395, DGX Spark and Mac Studio compared on memory, bandwidth and reference prices, and why big memory does not mean fast.
-
-
AMD GPU for Local LLMs: ROCm vs Vulkan, and Can the RX 7900 XTX or 9070 XT Do the Job?
Using an AMD GPU for local LLMs? See Ollama’s support list, choose ROCm or Vulkan, compare RX 7900 XTX and 9070 XT bandwidth, and fix common errors.
