#LLMs6 min read
Self-Hosting DeepSeek-R1 with vLLM: The Hardware, VRAM & AWQ Benchmarking Guide
Exact memory calculations, tokens/sec benchmarks, and vLLM configuration flags for serving DeepSeek-R1 distilled models on RTX 4090, RTX 3090, and Apple Silicon.