_llm_d_ Profile Banner
llm-d Profile
llm-d

@_llm_d_

Followers
212
Following
2
Media
3
Statuses
16

llm-d: a Kubernetes-native high-performance distributed LLM inference framework

Joined May 2025
Don't wanna be here? Send us removal request.
@_llm_d_
llm-d
@_llm_d_
3 days
Want to influence the future of llm-d?. Our 5-min survey on real-world LLM use cases is open until July 11. We're reviewing the results live at our community meeting on July 16th, so your voice will be heard immediately. Make an impact: . #AI #MLOps #vllm.
0
0
6
@_llm_d_
llm-d
@_llm_d_
7 hours
RT @natalevinto: Developer Day Milan happening now! Here's Roberto Carratalà fand Marco Caimi showing Llama Stack @vllm_project @_llm_d_ an….
0
5
0
@_llm_d_
llm-d
@_llm_d_
6 days
We're defining the next phase of llm-d, and we need your expert input. Share your insights on LLM serving, from hardware to performance, in our quick 5-minute survey. Your feedback will directly shape our roadmap. Take the survey here: . Thank you!.
0
3
11
@_llm_d_
llm-d
@_llm_d_
8 days
Big news from the llm-d project! Your input on our 5-min survey will define our future roadmap. Plus, we've just launched our YouTube channel with meeting recordings & tutorials. Subscribe and help us build the future of LLM serving!.
Tweet media one
1
3
16
@_llm_d_
llm-d
@_llm_d_
10 days
Are you serving LLMs in production? We need your input for the llm-d project!. Take our 5-min anonymous survey to help guide our roadmap by sharing your model strategy, hardware use, and biggest challenges. Let's build a better project together.
0
6
14
@_llm_d_
llm-d
@_llm_d_
12 days
Two new ways to get involved with the llm-d project!. ✅ Help shape our roadmap by taking our 5-min survey on your LLM use cases. ✅ Subscribe to our new YouTube channel for tutorials & SIG meetings!. Details in our latest community update:
Tweet media one
0
7
18
@_llm_d_
llm-d
@_llm_d_
27 days
Join the @vllm_project office hours this week with @RedHat_AI for an intro to llm-d. 📅 Thursday, June 12 at 11AM PST / 2PM EST. 🔗 Sign up to get a Google Calendar invite w/ Google Meet link: 📷 Or watch live on YouTube:
1
4
16
@_llm_d_
llm-d
@_llm_d_
27 days
RT @RedHat_AI: .@_llm_d_ is a Kubernetes-native distributed LLM inference framework designed for fast, scalable serving across hardware acc….
0
5
0
@_llm_d_
llm-d
@_llm_d_
1 month
🚀 2 weeks since launch: 1,000 ⭐️'s on GitHub!. The llm-d project is moving fast with active design discussions on inference APIs, workload scheduling & model serving on Kubernetes. Check out what we are currently working on:. #llm #kubernetes #ai.
0
3
12
@_llm_d_
llm-d
@_llm_d_
1 month
Want to contribute to llm-d? Here's how to get started!. - Attend weekly office hours, Wed at 1230 Eastern Time (. - Join the Google group ( . - Join Slack (.
0
6
19
@_llm_d_
llm-d
@_llm_d_
1 month
RT @christianposta: llm-d is a new open-source distributed inference serving framework, but what does that mean? In this lightboard video,….
0
2
0
@_llm_d_
llm-d
@_llm_d_
1 month
AMD Integrates llm-d on AMD Instinct MI300X Cluster For Distributed LLM Serving .
0
1
12
@_llm_d_
llm-d
@_llm_d_
2 months
RT @_llm_d_: Red Hat announces the launch of llm-d, a new open source project that answers the most crucial need of generative AI’s (gen AI….
0
6
0
@_llm_d_
llm-d
@_llm_d_
2 months
RT @RedHat_AI: LLM inference is too slow, too expensive, and too hard to scale. 🚨 Introducing llm-d, a Kubernetes-native distributed infer….
0
86
0
@_llm_d_
llm-d
@_llm_d_
2 months
Read how llm-d is a k8s-native high-performance distributed LLM inference framework- a well-lit path for anyone to serve at scale, with the fastest time-to-value and competitive performance per dollar for most models across most hardware accelerators.
1
5
19
@_llm_d_
llm-d
@_llm_d_
2 months
Red Hat announces the launch of llm-d, a new open source project that answers the most crucial need of generative AI’s (gen AI) future: Inference at scale.
1
6
14