Exciting to share we have been working on over the past one year. MLCEngine, a universal LLM deployment engine that brings the power of server optimizations and local deploymet into a single framework, checkout platforms support 👇 and blogpost more in a🧵

RT @BanghuaZ: Excited to share that I’m joining NVIDIA as a Principal Research Scientist!. We’ll be joining forces on efforts in model post….

RT @JeffDean: Mark your calendars for #MLSys2026 in May, 2026 in Seattle. Submission deadline for papers is Oct 30 this year.

#MLSys2026 will be led by the general chair @luisceze and PC chairs @JiaZhihao and @achowdhery. The conference will be held in Bellevue on Seattle's east side. Consider submitting and bringing your latest works in AI and systems—more details at

RT @JiaZhihao: 📢Exciting updates from #MLSys2025! All session recordings are now available and free to watch at We….

RT @JokerEph: I’ve been starting to collaborate with the folks who are building FlashInfer: nice project and pretty amazing set of people!….

RT @chrisdonahuey: Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generati….

RT @JiaZhihao: One of the best ways to reduce LLM latency is by fusing all computation and communication into a single GPU megakernel. But….

RT @Xinyu2ML: 🚀 Super excited to share Multiverse!. 🏃 It’s been a long journey exploring the space between model design and hardware effici….

RT @BeidiChen: Say hello to Multiverse — the Everything Everywhere All At Once of generative modeling. 💥 Lossless, adaptive, and gloriousl….

Check out our work on parallel reasoning 🧠; We bring an AI-assisted curator that identifies parallel paths in sequential traces, then tune models into native parallel thinkers that runs efficiently with prefix sharing and batching. Really excited about this general direction.

RT @InfiniAILab: 🔥 We introduce Multiverse, a new generative modeling framework for adaptive and lossless parallel generation. 🚀 Multivers….

RT @lmsysorg: NVIDIA🤗SGLang🚀.

RT @NVIDIAAIDev: .@lmsysorg (SGLang) now achieves 7,583 tokens per second per GPU running @deepseek_ai R1 on the GB200 NVL72, a 2.7x leap o….

RT @lmsysorg: The SGLang team just ran DeepSeek 671B on NVIDIA’s GB200 NVL72, unlocking 7,583 toks/sec/GPU for decoding w/ PD disaggregatio….

RT @zhyncs42: SGLang is an early user of FlashInfer and witnessed its rise as the de facto LLM inference kernel library. It won best paper….

Checkout the technical deep dive on FlashInfer.

RT @NVIDIAAIDev: 🔍 Our Deep Dive Blog Covering our Winning MLSys Paper on FlashInfer Is now live ➡️ Accelerate LLM….

RT @rsalakhu: Holy cow! It has been over 10 years - no way! Feels like I was giving this tutorial just a few years ago.

RT @matei_zaharia: Excited to launch Agent Bricks, a new way to build auto-optimized agents on your tasks. Agent Bricks uniquely takes a *d….

RT @yi_xin_dong: @databricks 's Agent Bricks is powered by XGrammar for structured generation, and achieves high quality and efficiency. It….