Jeff Dean
@JeffDean
Followers
351K
Following
38K
Media
442
Statuses
8K
Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
Joined September 2017
In April, '17, @jsomers of @NewYorker reached out & said he wanted to do a small profile of me & my longtime colleague Sanjay Ghemawat, watch us work for a few hours, maybe dinner, etc. It came out today. I think it captures our working style really well.
295
1K
5K
I’m very excited to share our work on Gemini today! Gemini is a family of multimodal models that demonstrate really strong capabilities across the image, audio, video, and text domains. Our most-capable model, Gemini Ultra, advances the state of the art in 30 of 32 benchmarks,
260
3K
13K
If you want to know more about how Google Flights works, airline tickets, and why it is super complicated to deal with all the constraints and the combinatorial combinations, I highly recommend this set of slides by Carl de Marcken, one of the co-founders of ITA software, which.
The most underrated Google product: Google Flights.
82
793
11K
Google Dataset Search is now officially out of beta. "Dataset Search has indexed almost 25 million of these datasets, giving you a single place to search for datasets & find links to where the data is.". Nice work, Natasha Noy and everyone else involved!.
46
2K
7K
Gemini 1.5 Pro - A highly capable multimodal model with a 10M token context length. Today we are releasing the first demonstrations of the capabilities of the Gemini 1.5 series, with the Gemini 1.5 Pro model. One of the key differentiators of this model is its incredibly long
188
1K
6K
We're using a ReLU to set tariffs?.
86
456
6K
After 25.3 million autonomous miles driven, @Waymo vehicles have an 88% reduction in property damage claims and a 92% reduction in bodily injury claims compared to human drivers per mile driven. 🚖
Our mission is to be the world's most trusted driver and a new study by @SwissRe validates the exceptional safety record of the Waymo Driver. Learn more:
102
660
5K
Introducing Gemma - a family of lightweight, state-of-the-art open models for their class, built from the same research & technology used to create the Gemini models. Blog post:.Tech report:. This thread explores some of the
105
796
4K
25 years ago today I officially started at a small search engine company, wedged into a tiny office space above what's now a T-Mobile store in downtown Palo Alto. Since then, I have had the incredible pleasure of working with awesome colleagues on software used by billions of
199
145
4K
Introducing Gemini 2.0 Flash Thinking, an experimental model that explicitly shows its thoughts. Built on 2.0 Flash’s speed and performance, this model is trained to use thoughts to strengthen its reasoning. And we see promising results when we increase inference time.
129
489
4K
I can't believe they've just cancelled the Epidemic Intelligence Service program at CDC. My father was an EIS officer:. @Farzad_MD's thread below gives you a sense of the kind of people in this elite program to train the best & brightest epidemiologists.
1/ After residency at Mass General Hospital, I reported to Atlanta to meet my fellow CDC Epidemic Intelligence Service Officers. I have never felt so intimidated by my peers. The best and the brightest, they were star clinicians, had served in disaster zones; MD/PhDs and MSF.
130
939
4K
I am very hopeful that we move the U.S. back to welcoming the best & brightest students from all around the world to our colleges and universities. For so many decades, this was an incredible strength of the U.S. I hope we get back to welcoming amazing students with open arms!.
A huge relief for international students; I am really happy for them as I know very well the stress that they have been living under #AcademicTwitter.
22
373
3K
A reminder that some people in our field are alienating our female colleagues by flirting in settings that are meant to be professional and by trying to turn what should be topic- & setting-appropriate conversations into dates. Please don't do this.
49
864
3K
Since I wrote this answer to a student, I thought I would share more broadly.
47
253
3K
🥁Introducing Gemini 2.5, our most intelligent model with impressive capabilities in advanced reasoning and coding. Now integrating thinking capabilities, 2.5 Pro Experimental is our most performant Gemini model yet. It’s #1 on @lmarena_ai leaderboard. 🥇
93
315
3K
And in a nod to efficiency, it's balanced, too!.
16
228
2K
Last week, many of my colleagues got together to throw a surprise party to celebrate my 20th anniversary of working @Google. I am delighted & incredibly fortunate to have worked with so many amazing people over the years, on such a wide variety of projects. Thank you all!
74
90
2K
Happy 25th Birthday Google! 🎉. I have gotten incredible enjoyement from being along for the ride for 24+ of these years. When I joined, we were a handful of people wedged into a small office area in downtown Palo Alto above what is now a T-Mobile store. 1/
52
204
2K
Congratulations to my colleague @geoffreyhinton, along w/ @ylecun, & Yoshua Bengio for receiving this year's @TheOfficialACM Turing Award (the highest honor in computer science) for their pioneering work in deep learning!.
21
507
2K
So, it turns out you don't get much time to throw together a Nobel Prize party, but we got people together to celebrate! 🎉. Here's me & Geoff before the party started, & a nice group photo of all of Geoff's former PhD students that were able to attend on short notice.
40
132
2K
Someone just reminded me of this lecture I gave in 2009 that described the evolution of Google Search from 1999 to 2009. People who are interested in how our search systems work might find this interesting. It touches on disk-based serving systems, in-memory indices,.
39
261
2K
This is a small research community. To all my friends, former colleagues and those that I don't know at OpenAI, the last few days have been a rollercoaster for those of us watching from the outside: I can't imagine the ebb & flow of emotions you're all experiencing. ♥️.
32
132
2K
Check out NotebookLM! Create a notebook, upload one or more sources (e.g. PDFs of research papers, your favorite PhD thesis, a newspaper article, etc) then click on 'Generate' to create a podcast of two voices talking about the content you've uploaded.
94
368
2K
We're starting to roll out API support for Gemini 1.5 Pro for developers. We're excited to see what you build with the 1M token context window!. We'll be onboarding people to the API slowly at first, and then we'll ramp it up. In the meantime, developers can try out Gemini 1.5.
Gemini 1.5 Pro - A highly capable multimodal model with a 10M token context length. Today we are releasing the first demonstrations of the capabilities of the Gemini 1.5 series, with the Gemini 1.5 Pro model. One of the key differentiators of this model is its incredibly long
94
382
2K
I'm delighted to have joined my good friend and colleague @NoamShazeer for a 2+hour conversation with @dwarkesh_sp about a wide range of topics (early Google, ML hardware, training trillion token LLMs in 2007, model sparsity, continual learning, and more). Thanks for a fantastic
The @JeffDean & @NoamShazeer episode. We talk about 25 years at Google, from PageRank to MapReduce to the Transformer to MoEs to AlphaChip – and soon to ASI. My favorite part was Jeff's vision for AGI as one giant MoE that is grown in bits and pieces over time like a forest,
75
221
2K
On behalf of the Google Brain team, I wrote a summary of some of the things we did in 2017. This is part 1 of 2. I'm very proud of the whole team and what we accomplished in 2017!
19
784
2K
I understand the concern over Timnit’s resignation from Google. She’s done a great deal to move the field forward with her research. I wanted to share the email I sent to Google Research and some thoughts on our research process.
576
188
2K
This graph is pretty striking. I hadn't seen this data broken apart by Bay Area vs. rest of California for a while.
28
449
2K
The Gemini cookbook is the top trending repository on GitHub. Examples, API documentation, and more!.
35
340
2K
Welcome, AlphaChip!. Today, we are sharing some exciting updates on our work published in @Nature in 2021 on using reinforcement learning for ASIC chip floorplanning and layout. We’re also naming this work AlphaChip. Since we first published this work, our use of this approach
Our AI for chip design method AlphaChip has transformed the way we design microchips. ⚡. From helping to design state-of-the-art TPUs for building AI models to CPUs in data centers - its widespread impact can be seen across Alphabet and beyond. Find out more →
42
313
2K
AI is full of promise, with the potential to revolutionize so many different areas of modern society. In order to realize its true potential, our field needs to be welcoming to all people. As it stands today, it is definitely not. Our field has a problem with inclusiveness.
33
401
2K
Exciting news: @Waymo is beginning public service on the Peninsula, starting with Palo Alto, Mountain View, and Los Altos! Initial service area below.
We’ve made millions of miles of memories over the past 15+ years, but today is special. We’re returning to where the journey began, gradually opening our doors to our first public riders in Mountain View, Los Altos, Palo Alto, and parts of Sunnyvale.
68
88
2K
I too have been told to learn to code.
The disparaging "learn to code" comments on some of my earlier Tweets are so funny. People don't realize that's literally what 90% of meteorological research is. I was actively writing code yesterday when I got that form email haha. OK, no more engaging with trolls.
68
69
2K
AI System Achieves Silver Medal-level score in IMO. The International Mathematical Olympiad (IMO) is the oldest, largest & most prestigious competition for young mathematicians. Every year, countries send their top young mathematicians to take a 6 problem test spanning two days.
63
325
2K
Reminds me of my time in grad school.
when they send out an email that they had an event and there’s food leftover
22
95
2K
My @Google colleague and longtime @UCBerkeley faculty member David Patterson has a great essay out in this month's Communications of the ACM (@TheOfficialACM):🎉. "Life Lessons from the First Half-Century of My Career.Sharing 16 life lessons, and nine magic words.". I saw an
20
336
2K
Introducing TxGemma, a family of open models specifically tailored for health settings, building on top of Gemma and Gemini.
44
217
2K
At Google, we've been getting a better understanding of issues of bias & fairness in machine learning models as we've used ML throughout more of our products. We've also created training for Google engineers on these topics, and we've now made this material available externally.
Introducing the MLCC Fairness in #MachineLearning module (, which looks at different types of human biases that can manifest in training data, and provides strategies to identify them and evaluate their effects. Learn more at:
19
494
2K
Congratulations to my good friend & former Google colleague Geoff Hinton for winning this year's Nobel Prize in Physics (along w/John Hopfield)! 🎉. Geoff's impact on so many scientific fields continues to grow as neural networks are applied in more & more domains. Celebratory
BREAKING NEWS.The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Physics to John J. Hopfield and Geoffrey E. Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.”
31
89
2K
What a way to celebrate one year of incredible Gemini progress -- #1🥇across the board on overall ranking, as well as on hard prompts, coding, math, instruction following, and more, including with style control on. Thanks to the hard work of everyone in the Gemini team and
Big news on Chatbot Arena 🔥. The new @GoogleDeepMind model gemini-exp-1206 is crushing it, and the race is heating up. Google is back in the #1 spot 🏆overall and tied with O1 for the top coding model! . Highlights (improvement since gemini-exp-1121 in parentheses). - First
90
316
2K
AI can unlock joint human/computer creativity! Imagen is one direction we are pursuing:. "A high contrast portrait of a very happy fuzzy panda dressed as a chef in a high end kitchen making dough. There is a painting of flowers on the wall behind him."
46
276
2K
Human language LLMs are so passe. Read about this work on a whale bioacoustics model that can identify eight distinct species, including multiple calls for some of these species (e.g. the "biotwang" of the Bryde's whale). I'm going to say this until I'm blue in the face, but.
Introducing our new whale bioacoustics model, which can identify eight distinct species, including multiple calls for two of those species. The model even includes the “Biotwang” sounds recently attributed to the Bryde’s whale. Learn more at:
60
198
2K
Gemini is Latin for "twins". The Gemini effort came about because we had different teams working on language modeling, and we knew we wanted to start to work together. The twins are the folks in the legacy Brain team (many from the PaLM/PaLM-2 effort) and the legacy DeepMind.
68
136
1K
Bard (the product) is now Gemini. Gemini Advanced is powered by the Gemini Ultra 1.0 model, our most advanced multimodal model. Congrats to everyone who worked on this effort, including the Bard and Gemini teams! Lots more updates in the blog post!.
68
246
2K
When I was finishing grad school, I was applying for both academic faculty positions and industrial research positions. Only got one academic interview (& offer), and not from a top- or even mid-tier place, so I went into industrial research. It's turned out okay. .
Being denied tenure is a life-twisting thing, and there's no one best strategy for dealing with it. It's okay to recommit to your academic goals, or to try something completely different. Take the opportunity to have your mid-life crisis a little bit early.
21
194
2K
The denial of visas for people to attend scientific conferences inhibits the free flow of ideas that is essential for scientific progress. I wish visas weren't such a hindrance, especially for those from underrepresented countries in the field of ML. We need everyone's voice!.
This never ends. This year, so far, 15 out of 44 people to attend @black_in_ai workshop at @NeurIPSConf (which is still in Canada) have been denied visas. That's 33%. We had all this press last year, they were supposed to help us this year.
43
371
1K
Congrats to my colleagues @demishassabis & John Jumper for winning the Nobel Prize in chemistry for their awesome AlphaFold work. AlphaFold has had a dramatic impact across many fields including medicine, drug development & more. And yes, this is my second Nobel-congratulating.
This year’s chemistry laureates Demis Hassabis and John Jumper have developed an AI model, AlphaFold2, to solve a 50-year-old problem: predicting proteins’ complex structures. Check out two examples of protein structures determined using AlphaFold2. First up, a bacterial enzyme
32
130
2K
.@geoffreyhinton was in Mountain View this week, so we decided to hold a Turing award celebration for him at @GoogleAI. Deanna Chen obtained secret info from Mohammad Norouzi about Geoff's favorite dessert, and ordered a version to feed 100. Behold our Turing-misu celebration!
10
113
1K
Currently, the OPT program enables talented graduate students to work in the US for a period after they graduate. Eliminating this program will cause graduate students, with newly minted PhDs, to be forced to leave the US, hurting US competitiveness.
41
338
1K
Our best model*, Gemini 2.5 Pro, is now available for everyone in the Gemini app model drop down menu at Give it a try with your most difficult questions!. *For now! 😃.
Gemini 2.5 Pro is taking off 🚀🚀🚀. The team is sprinting, TPUs are running hot, and we want to get our most intelligent model into more people’s hands asap. Which is why we decided to roll out Gemini 2.5 Pro (experimental) to all Gemini users, beginning today. Try it at no.
66
114
1K
The launch of @TensorFlow ~5 years ago this week was a pretty exciting milestone for a lot of us. We all gathered in a conference room early one morning to watch the original blog post announcing it go live & people start downloading it:.
Five years ago, we open sourced @TensorFlow, our machine learning framework that's now the most popular machine learning library in the world. 🌎 To celebrate, we’re sharing few interactive demos and tutorials you can try, no experience required →
10
125
1K
As in past years, I've spent part of the holiday break summarizing much of the work we've done in @GoogleResearch over the last year. On behalf of @Google's research community, I'm delighted to share this writeup (this year grouped into five themes).
45
273
1K
An update: @geoffreyhinton has been in contact with Canadian immigration officials. They told him that anyone who has been denied a visa to attend @NeurIPS can request their case to be reconsidered via this form:. No guarantees, but please pass along!.
The denial of visas for people to attend scientific conferences inhibits the free flow of ideas that is essential for scientific progress. I wish visas weren't such a hindrance, especially for those from underrepresented countries in the field of ML. We need everyone's voice!.
29
492
1K
Some new work from the part of Google Brain that works on ml for healthcare: we have encouraging early signs that non-invasive retinal images contain subtle indicators of cardiovascular health that ml models can pick up on, that weren't previously even known to human doctors.
Learn how #deeplearning makes it possible to accurately assess cardiovascular risk factors using retinal images. -->
16
506
1K
This ICE action against students on F-1 visas is incredibly damaging in many ways. It hurts U.S. competitiveness, damages our world-class universities, and, if enacted, will disrupt the scholarly study of millions of the brightest students from around the world.
This is bad. ICE just told students here on student visas that if their school is going online-only this fall, the students must depart the United States and cannot remain through the fall semester.
17
250
1K
I'm very excited to see the launch of Dataset Search, which can help researchers, scientists, and others around the world find open datasets!. To get a feel for it, try it with things like .… or.… or.….
Announcing the launch of Dataset Search, a new way for researchers to find the datasets they need, wherever they’re hosted, whether it’s a publisher's site, a digital library, or an author's personal web page. Learn more at
11
492
1K
We have an experimental updated version of Gemini 1.5 Pro that is #1 on the @lmsysorg Chatbot Arena. This model is a significant improvement over earlier versions of Gemini 1.5 Pro (it cracks into 1300+ elo score territory). I'm really proud of the whole team of people that.
Exciting News from Chatbot Arena!. @GoogleDeepMind's new Gemini 1.5 Pro (Experimental 0801) has been tested in Arena for the past week, gathering over 12K community votes. For the first time, Google Gemini has claimed the #1 spot, surpassing GPT-4o/Claude-3.5 with an impressive
32
109
801
Happy Thanksgiving, everyone, and I hope everyone is staying healthy! When in doubt, you can't go wrong with a kale salad!
30
13
1K
Some meetings can literally suck the oxygen right out of you.
This is crazy. Study shoes three people in a conference room over 2 hours can result in a Co2 level that can impair cognitive functioning. Ie. If you’re making decisions at the end of the meeting, you’re mentally less qualified to do so.
17
323
1K
On behalf of our co-authors Tomáš Mikolov, @ilyasut and Kai Chen, @greg_corrado and I were delighted to accept the #NeurIPS2023 Test of Time Award for the "word2vec" paper (. Thanks to the @NeurIPSConf test of time committee for honoring us with this
Congratulations to Jeff Dean, Greg Corrado, & co-authors of the paper “Distributed Representations of Words and Phrases and their Compositionality”, for winning the #NeurIPS2023 Test of Time Award! This prize recognizes a highly impactful paper published at NeurIPS 10 years ago.
40
121
1K
The multimodal and reasoning capabilities of Gemini are quite strong. The benchmark results, which I’ll discuss in a moment are nice, but I’m most excited by demonstrations of what it can do. Consider the image below. A teacher has drawn a physics problem of a skier going down
23
207
1K
Bard, powered by the Gemini Pro-scale model, debuts at the #2 position on the independent lmsys leaderboard. 🔥. Give it a try at Bard is much better & has many more capabilities since its debut in March, thanks to everyone on the Bard/Gemini teams!.
🔥Breaking News from Arena. Google's Bard has just made a stunning leap, surpassing GPT-4 to the SECOND SPOT on the leaderboard! Big congrats to @Google for the remarkable achievement!. The race is heating up like never before! Super excited to see what's next for Bard + Gemini
85
185
1K
@ilyasut @sama @gdb @miramurati Ilya, best of luck in all that comes next for you. I was pleased to call you a colleague for many years, and I've admired everything you've accomplished at OpenAI. I always enjoy when our paths cross (even if just for coffee).
9
11
1K
We’ve been thrilled by the positive reception to Gemini 2.0 Flash Thinking we discussed in December. Today we’re sharing an experimental update (gemini-2.0-flash-thinking-exp-01-21) with improved performance on math, science, and multimodal reasoning benchmarks 📈:.• AIME:
54
136
1K
@moderncpp7 @clu_cheng @NeurIPSConf @drfeifei @jhyuxm @edchi I didn't see the talk, but the images I've seen of the slide seem quite offensive. Such generalizations should have no place in NeurIPS or anywhere else.
35
161
1K
I think I'd never really watched a pole vault in such slow motion from this angle. It truly is an incredibly complex motion!.
19
152
1K
School "buses" like this would be awesome! Health benefits, a bit of excess energy burned off before arriving at school, chance to all work together on getting to school, great for the environment, . Probably way cheaper than a fuel-burning school bus, too.
These Dutch “bicycle buses” are transporting 50+ kids getting the kind of exercise that leads to better learning, who DON��T need to be driven & dropped off by parents adding lots of local car traffic. Nijmegen, NL video via @MartijnLi HT @urbanthoughts11
25
188
1K
What a time to be alive: collecting whale mucus via UAV! No doubt the first stage in a complex pipeline for data analysis or machine learning. Anyone else have equally exotic data collection techniques in work they're doing?.
A drone captures data from a surfacing Blue whale | carries a petri dish, collects mucus samples with DNA and hormones !! 🐳 🎯| Feb 2019
11
276
1K
What a great photo capturing that exhilirating moment when your hard work all comes together for the first time. Congrats to Katie Bouman and the whole team behind this work!.
5
108
1K
Today, the part of Google Brain that had been working on healthcare problems open sourced a set of protocol buffer definitions for the FHIR standard, which makes it much easier to manipulate data in FHIR format. We've been using this for our recent work on ML for medical records.
27
378
1K
Wonderful to see my good friend & colleague @geoffreyhinton today at the retirement party we organized for him. He retired in May, but this was the first chance to have a proper party for him in the Bay Area. To your amazing career & a happy retirement, @geoffreyhinton! 🥂
Attending @geoffreyhinton’s retirement celebration at Google with old friends. Thank you for everything you’ve done for AI! @JeffDean @quocleix
12
46
1K
@Yuchenj_UW That's beyond frustrating. We should want talented people to come to this country! You deserve better than a cursory denial where it's clear the person didn't even look carefully at the application. I hope it gets sorted out in the opposite decision in the end.
19
15
1K
I am deeply saddened by the passing of my dear colleague and friend @SusanWojcicki. She has had a profound influence on everyone at Google and impacted the lives of so many. My heart goes out to her entire family and to all who knew her. 😥 💙.
Unbelievably saddened by the loss of my dear friend @SusanWojcicki after two years of living with cancer. She is as core to the history of Google as anyone, and it’s hard to imagine the world without her. She was an incredible person, leader and friend who had a tremendous.
29
28
1K
This video is a good reminder of why low latency, on-device ML is an important piece for creating really nice, natural-feeling user interfaces.
I don't think that people appreciate how different the voice to text experience on a Pixel is from an iPhone. So here is a little head to head example. The Pixel is so responsive it feels like it is reading my mind!
14
174
1K
Very happy to see my colleague Geoffrey Hinton has been named a Companion of the Order of Canada. A well-deserved honor! Congrats, Geoff!.
🎉🇨🇦 Congratulations to the godfather of Deep Learning, AI pioneer and @Google Engineering Fellow Geoffrey Hinton on being named a Companion of the #OrderofCanada. @GoogleAI @UofT
6
135
1K
Not that many systems handle 6B QPS. 😀. "Bigtable has been in continuous production use at Google for more than 15 years now, processing over 6 billion requests per second at peak and with over 10 exabytes of data under management. ".
43
165
1K
One great thing about the Palo Alto area is that there's enough open space to go out and relax a bit, away from people. Ahhh.
26
22
1K
Very excited to see the MLPerf 0.7 results released today, where Google TPUs set records in six of the eight benchmarks!. We need bigger benchmarks, because we can now train the ResNet-50, BERT, Transformer, & SSD benchmarks each in under 30 seconds.
20
266
1K
@karpathy Congrats! AI is going to have a huge impact on education & I know it's something you're passionate about (seeing how you organized cs231n years ago when I gave a guest lecture it was clear you put lots of thought into the best way to teach people different kinds of material).
4
13
1K
Okay, this is fun. I tried our new Gemini 2.0 Flash Thinking Experimental 01-21 model on my PhD thesis ("Whole Program Optimization of Object-Oriented Languages", 134,540 tokens) with this prompt:. "Please analyze this PhD thesis and give me a concise critique of things that
I uploaded my PhD thesis (98K tokens) and asked our latest Flash thinking model to find flaws in it. "Potential over-reliance on empirical results without sufficient theoretical grounding." A Deep Learning thesis, indeed.
41
98
1K
It's nice to have good names for things. I'm proud to have named or been involved in naming a bunch of things at Google over the years, including:. MapReduce.Bigtable.Spanner.TensorFlow.Tensor Processing Units (TPUs).Pathways.Protocol Buffers.PaLM.Gemini.
"I felt the twins aspect of the name ‘Gemini’ was a great fit. The twins here are the folks in the legacy Brain team and the legacy DeepMind team, who started to work together on this ambitious multimodal model project.” - @JeffDean .
59
74
1K
Watching this animation is like a tour down memory lane of old processors.
13
283
1K
Today, @Google signed the world’s first corporate agreement to purchase nuclear energy from a series of small modular reactors, to be developed by @KairosPower. Learn how this will help bring new 24x7 clean power to the US electricity system. ⬇️.
39
121
1K
Current U.S. policies that make it hard or impossible for some of the most talented people in the world to enter this country, or the proposed tax policies that will tax graduate students that make $28k per year as if they make $71k will definitely hurt the U.S.
A good friend, AI scientist, recently returned from China in awe: “they are toe to toe with us, but moving faster.” In Singapore I was told, “BTW the best thing to happen to China AI is your immigration policy. ”
20
494
1K
