vLLM Tutorial: Serving Local LLMs With vLLM and SGLang When Ollama Is Not Enough
A vLLM tutorial for local LLM serving: when vLLM or SGLang beats Ollama, how PagedAttention and batching work, install and serve commands, and VRAM planning.
-
-
Local LLM API Server: Turn Ollama or llama.cpp Into an OpenAI-Compatible Endpoint
Local LLM API server guide: expose Ollama or llama-server as an OpenAI-compatible endpoint, test it with curl and Python, and keep it safe on your network.
-
What Is GGUF? Getting Started with llama.cpp: Download, Run and Quantize
What is GGUF? Learn the GGUF format, how to install and run llama.cpp, how Q4_K_M and other quantizations change file size, and how it relates to Ollama.
-
LM Studio Tutorial: Download and Run Models Without the Command Line
A complete LM Studio tutorial: install, search and download models, pick a quantization, tune context, chat with documents and start the local API.
