 
            
              Thang Luong
            
            @lmthang
Followers
                28K
              Following
                1K
              Media
                135
              Statuses
                2K
              Director, lead Superhuman Reasoning @GoogleDeepMind. AI IMO Gold. Co-led #DeepThink, #AlphaGeometry, #Bard (now Gemini) Multimodality, #MeenaBot. LuongAttention
              
              United States
            
            
              
              Joined December 2008
            
            
           Very excited to share that an advanced version of Gemini Deep Think is the first to have achieved gold-medal level in the International Mathematical Olympiad! 🏆, solving five out of six problems perfectly, as verified by the IMO organizers! It’s been a wild run to lead this 
           Super thrilled to share that our AI has has now reached silver medalist level in Math at #imo2024 (1 point away from 🥇)! Since Jan, we now not only have a much stronger version of #AlphaGeometry, but also an entirely new system called #AlphaProof, capable of solving many more 
            
                
                78
              
              
                
                230
              
              
                
                2K
              
             Just posted Q3 earnings. We delivered our first-ever $100B quarter driven by double-digit growth across every major part of our business. (Five years ago, our quarterly revenue was at $50B🚀) Our full-stack approach to AI is driving real momentum and we’re shipping at speed. 
          
                
                522
              
              
                
                1K
              
              
                
                14K
              
             Today, we’re overjoyed to have a 25th Anniversary Reunion of @stanfordnlp. So happy to see so many of our former students back at @Stanford. And thanks to @StanfordHAI for the venue! 
          
                
                9
              
              
                
                41
              
              
                
                315
              
             New breakthrough quantum algorithm published in @Nature today: Our Willow chip has achieved the first-ever verifiable quantum advantage. Willow ran the algorithm - which we’ve named Quantum Echoes - 13,000x faster than the best classical algorithm on one of the world's fastest 
          
                
                2K
              
              
                
                8K
              
              
                
                47K
              
             The Art of Scaling Reinforcement Learning Compute for LLMs "We present the first large-scale systematic study, amounting to more than 400,000 GPU-hours, that defines a principled framework for analyzing and predicting RL scaling in LLMs." "we propose a best-practice recipe, 
          
                
                8
              
              
                
                46
              
              
                
                318
              
             Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single, 
          
                
                663
              
              
                
                3K
              
              
                
                24K
              
             We processed over 1.3 Quadrillion tokens last month - that's 1,300,000,000,000,000 tokens! or to put it another way that's 500M tokens a second or 1.8 Trillion tokens an hour... 🤯 
          
                
                303
              
              
                
                473
              
              
                
                6K
              
             For the 2024 IMO we made a math-specific system and got silver. For 2025 we made Deep Think: a general-purpose reasoning system that got gold and excels on other tasks besides math, like voxel art! 
           Gemini Deep Think is on Voxelbench! And what a gap between: #1 Gemini 2.5 Deep Think and #2 GPT-5 (High) Check out the amazing Deep Think builds yourself on Voxelbench! 
            
                
                5
              
              
                
                7
              
              
                
                50
              
             Correction: it's a public model access through Gemini Ultra subscription (not API). I guess the main point is DeepThink IMO lite is available for the public to assess :) 
          
                
                0
              
              
                
                0
              
              
                
                27
              
             Very cool to see this new state-of-the-art result on FrontierMath achieved by the #DeepThink IMO Gold model that we built 3 months (a long time) ago :) The fact that is evaluated externally using a publicly available API is a strong testament that what we built generalizes beyond 
           We evaluated Gemini 2.5 Deep Think on FrontierMath. There is no API, so we ran it manually. The results: a new record! We also conducted a more holistic evaluation of its math capabilities. 🧵 
            
                
                15
              
              
                
                16
              
              
                
                249
              
             Congrats @furst_fly! Special thanks to @chiennv2000 and @longphan3110 for designing this Flash Attention assignment. Check it out at  https://t.co/LA5qhD63i4! 
          
          
            
            github.com
              GStar Bootcamp - Assignment 1. Contribute to newturing/GStar-Assignment-1 development by creating an account on GitHub.
             It felt like yesterday I was a 17yo at MIT Manipal who thought AI was more magic than math. Today, I shipped a first-of-its-kind backprop implementation that combines FlashAttention + GQA + SWA + Attention Sinks for GPT‑OSS : fully open source. Benchmarks: ~33× faster 
            
                
                0
              
              
                
                2
              
              
                
                4
              
             We’re announcing a major advance in the study of fluid dynamics with AI 💧 in a joint paper with researchers from @BrownUniversity, @nyuniversity and @Stanford. 
          
                
                183
              
              
                
                746
              
              
                
                5K
              
             I'm pleased to announce another (fairly minor) update to my RL tutorial (I fixed some typos, cited more papers, and added a wee bit more stuff on multi-agent RL and RL for LLMs). I don't have time to work on this anymore, so enjoy it as is! (Link below) 
          
                
                18
              
              
                
                207
              
              
                
                2K
              
             Yet another important milestone for Gemini #DeepThink in achieving gold🥇at #ICPC2025, the world's most prestigious college-level programming contest. Big congrats to everyone in this great achievement! Stay tuned for more to come from DeepThink ;) 
           An advanced version of Gemini 2.5 Deep Think has achieved gold-medal level performance at the ICPC 2025 - one of the world’s most prestigious programming contests. 🏅 Building on the model's success in math at the IMO, this marks another historic milestone for advanced AI. 🧵 
            
                
                3
              
              
                
                10
              
              
                
                75
              
             Glad to hear external validations like this for the Gemini #DeepThink IMO model we shipped last month :) Stay tuned for future updates! 
           Few people are aware of how good Gemini Deep Think is. It's at the point where "Should I ask an expert to chew on this or Deep Think?" is often answered with Deep Think. GPT-5 Pro is more "intellectual yet idiot" while Deep Think has better taste. I've been repeating this a 
          
                
                2
              
              
                
                4
              
              
                
                60
              
             🌀Diversity Aware RL (DARLING)🌀 📝:  https://t.co/MH0tui34Cb  - Jointly optimizes for quality & diversity using a learned partition function - Outperforms standard RL in quality AND diversity metrics, e.g. higher pass@1/p@k - Works for both non-verifiable & verifiable tasks 🧵1/5 
          
                
                5
              
              
                
                87
              
              
                
                425
              
             Image generation with Gemini just got a bananas upgrade and is the new state-of-the-art image generation and editing model. 🤯 From photorealistic masterpieces to mind-bending fantasy worlds, you can now natively produce, edit and refine visuals with new levels of reasoning, 
          
                
                185
              
              
                
                541
              
              
                
                3K
              
             Congrats @longphan3110 on yet another cool benchmark (after HLE). Long grew up from @newturing (formerly VietAI) working with me & @thtrieu_ on machine translation. Now return back to  https://t.co/fRvhGyWatj  to help nurture young talents from Asia-Pacific (<12hrs left to apply!) 
          
            
            gstar.newturing.ai
              Empowering future AI leaders in Asia-Pacific and beyond. A 12-week, fully online accelerator that equips emerging AI talents with cutting-edge technical expertise and leadership skills - culminating...
             Can AIs beat long video games? We made TextQuests to test GPT-5, Grok 4, Deepseek, etc. These games can often take people dozens of hours to beat. - AIs can't beat any of the games (without clues) - some AIs behave more viciously than others - AIs are getting better rapidly 
            
                
                0
              
              
                
                1
              
              
                
                14
              
             Hang Sơn Đoòng in Vietnam is the world's largest cave. Its vast chambers are large enough to accommodate entire city blocks, including skyscrapers. 📽: Daniel Kordan  https://t.co/fmuC9BPsIt 
          
          
                
                13
              
              
                
                140
              
              
                
                774
              
             Genie 3 is here - it can generate an entire world simulation that you can interact with in real-time, just from a text prompt! It's pretty mind-blowing really when you stop to think about it, and it's rapidly improving - one day we will be able to build the Holodeck for real! 
          
                
                252
              
              
                
                741
              
              
                
                5K
              
             Also I'm doing this while I'm on a two-week vacation :) The hope is to find and nurture young talents in Southeast Asia and beyond. And hopefully the community will carry on the work further. 
          
                
                1
              
              
                
                1
              
              
                
                12
              
             
             
             
             
             
             
             
               
               
             
               
             
             
               
            