Find reporting and practical references by subject.
The llm-d v0.10.0 release shifts inference image builds to upstream vLLM, deprecates its CUDA and AWS images, and introduces a two-registry system with signed production images and unsigned PR builds.
Read the article ↗llm-d v0.9.0 ships new batch gateway and latency predictor components, adds an Intel XPU SGLang image, and updates vLLM to v0.26.0 across CPU, ROCm, and TPU targets.
Read the article ↗The release graduates multimodal serving, batch gateway, and flow control to production, adds non-Kubernetes routing for RL workloads, and shifts GPU and ROCm images to upstream vLLM builds.
Read the article ↗llm-d v0.8.0 moves CUDA, ROCm, and XPU images to upstream vLLM builds, graduates multimodal, batch, and flow control to production, and adds multi-tier KV offloading with HMA support.
Read the article ↗We count visits on the server, cookie-free. You can also let this browser tell us how long you read, how far you scroll and which links you follow. It stays with us.
