llm-d

vLLM Expands Encoder Disaggregation for Multimodal AI Serving
vLLM has detailed engineering work that separates multimodal encoding from language-model prefill and decode, allowing operators to scale those stages independently. The…

CoreWeave Joins CNCF as a Platinum Member
CoreWeave has become a Platinum member of the Cloud Native Computing Foundation, expanding its support for Kubernetes and the AI-native cloud community. The company…

Red Hat Details EnMaaS Pilot for Open Source AI Inference
Red Hat has detailed EnMaaS, an internal Model-as-a-Service pilot that combines its Praxis AI gateway with llm-d distributed model serving. The company says the…

CoreWeave joins Red Hat's llm-d open source project as a founding member
CoreWeave has become a founding member of Red Hat's new llm-d open source project, alongside IBM Research, Google and NVIDIA. According to CoreWeave, the project aims to…
For developersIBM Research says llm-d 1.0 hardens open-source AI inference
IBM Research has published a blog post titled "llm-d 1.0 hardens open-source AI inference for production", pointing to a 1.0 release of llm-d aimed at production use.…

llm-d 1.0 arrives with production features for open AI inference at scale
The open source llm-d project has released version 1.0, a milestone aimed at helping organizations run large language model inference more efficiently in production.…

Red Hat AI 3.5 lets chat and batch share one GPU without latency hits
Red Hat AI 3.5 makes priority-aware serving generally available, letting chat, batch and agentic traffic share one GPU pool while interactive requests go first.…

llm-d enters CNCF Sandbox as open source push for distributed AI inference grows
The open source project llm-d, built to orchestrate and scale distributed inference across accelerator infrastructure, is entering the Cloud Native Computing Foundation…