Prof. Anima Anandkumar Profile Banner
Prof. Anima Anandkumar Profile
Prof. Anima Anandkumar

@AnimaAnandkumar

Followers
25,256
Following
2,012
Media
132
Statuses
2,091

Bren Professor @caltech , Fmr Sr Director of #AI research @nvidia , Fmr Principal Scientist @awscloud , AI+Science, PDE, Neural operators. Views my own.

Joined May 2021
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
Pinned Tweet
@AnimaAnandkumar
Prof. Anima Anandkumar
1 month
Our @NatRevPhys perspective article on neural operators and their ability to accelerate simulations and design is now out. @Nature 1. Neural operators learn mappings between functions, e.g. spatiotemporal processes and partial differential equations.…
Tweet media one
8
53
326
@AnimaAnandkumar
Prof. Anima Anandkumar
2 months
For the first time, we show that the Llama 7B LLM can be trained on a single consumer-grade GPU (RTX 4090) with only 24GB memory. This represents more than 82.5% reduction in memory for storing optimizer states during training. Training LLMs from scratch currently requires huge…
@_akhaliq
AK
2 months
GaLore Memory-Efficient LLM Training by Gradient Low-Rank Projection Training Large Language Models (LLMs) presents significant memory challenges, predominantly due to the growing size of weights and optimizer states. Common memory-reduction approaches, such as low-rank
Tweet media one
17
165
870
48
390
2K
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
I have decided to leave my position at Nvidia to focus on starting something new, as some of you may already know. I look forward to scaling models with physical and scientific understanding to accelerate progress toward AGI. I will share more soon. Excited to meet everyone at…
85
86
2K
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
Launching Lean Co-pilot for LLM-human collaboration to write formal mathematical proofs that are 100% accurate. We use LLMs to suggest proof tactics in Lean and also allow humans to intervene and modify in a seamless manner. Automating theorem proving…
21
328
2K
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
My mom was one of the first female engineers in my community. Initially, my grandpa refused since she would be too qualified and hence, unmarriageable. My mom went on a hunger strike for three days and my grandpa relented. I stand on the shoulder of giants #womeninstem
8
76
1K
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Our big day came together so beautifully, surrounded by family and friends at the historic @caltech Athenaeum. More pictures to come soon! @bjenik #wedding
Tweet media one
167
4
1K
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
This is one of my favorite #Pics so far from our #wedding (credit: @alicejacobsmd ) I jumped for the kiss a bit too early before @francesarnold could finish her speech and give us the permission :) Thanks so much @francesarnold for officiating our #wedding
Tweet media one
41
4
562
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Thank you @TheOfficialACM for recognizing me as an ACM Fellow! This honor belongs to my team and collaborators. Every day I am energized and inspired to work with them. Also thankful to my mentors and my family for supporting me all this way!
@TheOfficialACM
Association for Computing Machinery
1 year
💐Meet the 2022 ACM Fellows! 57 of the ACM members have been selected for their wide-ranging and fundamental contributions in the #computing field. Please join us in congratulating these new inductees! Learn more about their achievements here: #ACMFellows
Tweet media one
6
19
87
63
15
511
@AnimaAnandkumar
Prof. Anima Anandkumar
11 months
Reduce training cost of diffusion models by ~70% through masked training of transformer backbones. Masked training is popular for self-supervised representation learning, but we are first to show for #GenerativeAI @wn8_nie @Kay12400259 @ArashVahdat
6
87
490
@AnimaAnandkumar
Prof. Anima Anandkumar
2 months
How do we capture local features across multiple resolutions? While standard convolutional layers work only on a fixed input-resolution, we design local neural operators that learn integral and differential kernels, and are principled ways to extend standard convolutions to…
Tweet media one
6
94
479
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
How can we mix active and transfer learning in few-shot learning setting with pre-trained LLMs? We show that you need to label only few samples in-domain and leverage on transfer learning from out-domain along with ingrained knowledge in pretrained models
2
101
464
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
TLDR: We developed StrassenNet ~ 4 years ago. It already re-discovered Strassen's algorithm, reduced multiplications by 99.5% while maintaining accuracy of #deeplearning No guarantee #alphatensor is stable while StrassenNet explicitly trains for it.
6
72
436
@AnimaAnandkumar
Prof. Anima Anandkumar
7 months
I agree with @ylecun that open source has been the primary reason for AI innovation and growth. Do not let misinformation and hysteria kill this. Open-source means we democratize and allow everyone to explore new ways to make AI reliable and safe, and allow for peer review.
@ylecun
Yann LeCun
7 months
The heretofore silent majority of AI scientists and engineers who - do not believe in AI extinction scenarios or - believe we have agency in making AI powerful, reliable, and safe and - think the best way to do so is through open source AI platforms NEED TO SPEAK UP !
172
410
2K
14
72
409
@AnimaAnandkumar
Prof. Anima Anandkumar
10 months
My hypothesis is that more RLHF and fine-tuning destroys the calibration of pretrained models. It is a shallow fix that encourages the models to convince the user that they are following instructions, rather than actually following them.
@random_walker
Arvind Narayanan
10 months
This from a VP at OpenAI is from a few days ago. I wonder if degradation on some tasks can happen simply as an unintended consequence of fine tuning (as opposed to messing with the mixture-of-experts setup in order to save costs, as has been speculated).
1
5
109
14
45
409
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Join our AI algorithms team at @nvidia as an intern working on a broad range of topics from generative models, reinforcement learning, neural operators, 3D vision, AI for science, and quantum algorithms.
12
67
400
@AnimaAnandkumar
Prof. Anima Anandkumar
3 months
Text understanding with #LLMs is useful but not enough for scientific understanding and discovery. In chemistry, in addition to text, chemical structure is essential to determine the properties of molecules. We have created the first multimodal text-chemical structure model:…
9
74
391
@AnimaAnandkumar
Prof. Anima Anandkumar
25 days
Looking forward to my @TEDTalks on building #AI with universal physical understanding. Excited to announce our recent works building the foundations for such a model. Language models have shown impressive capabilities with universal text understanding capabilities, but they are…
Tweet media one
14
42
365
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Strongly disagree with the first one. "What I cannot create I cannot understand" - Richard Feynman. Generative AI is not just for creating fun art, it is at the core of concept learning.
@BeingMIAkashs
Mofijul Islam
1 year
Recommendations from @ylecun talk at SSL #NeurIPS2022 Workshop
Tweet media one
26
87
571
16
25
333
@AnimaAnandkumar
Prof. Anima Anandkumar
11 months
Celebrating a personal milestone. Last year I married @bjenik my amazing cheerleader, partner-in-crime and soulmate amidst family and friends coming out of the pandemic. Can't believe the year has gone by! #happyanniversary
Tweet media one
Tweet media two
Tweet media three
Tweet media four
16
4
316
@AnimaAnandkumar
Prof. Anima Anandkumar
1 month
AI with Fourier Neural Operators speeds up Plasma modeling in Nuclear fusion by a million times Predicting plasma evolution within a Tokamak reactor is crucial to realizing the goal of sustainable fusion. A big challenge are disruptions that occur when the plasma gets unstable…
9
51
311
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
#ValentinesDay ❤️Really lucky to have @bjenik in my life. It has transformed my perspective in so many ways. To have someone supportive and dependable allows me to be authentic and vulnerable. Looking forward to so many new adventures ❤️
Tweet media one
7
2
304
@AnimaAnandkumar
Prof. Anima Anandkumar
6 months
I am so excited to see that the long-planned release of the Makani library for #AI based weather and climate modeling has finally happened! It started with our FourCastNet work almost three years ago using the Fourier neural operator, where we showed for…
8
35
288
@AnimaAnandkumar
Prof. Anima Anandkumar
9 months
Swimming in a glacier lake
Tweet media one
@AlHendiify
David AttenBruh
9 months
Scientists of Twitter! The world needs more reminders that we're living, breathing human beings. Quote tweet this with a picture of you doing not-science
Tweet media one
9
9
265
6
5
282
@AnimaAnandkumar
Prof. Anima Anandkumar
11 months
What an amazing evening at @TheOfficialACM awards reception yesterday! Honored to be selected as an ACM Fellow and privileged to be working with phenomenal students and colleagues! Wonderful to have @bjenik by my side and cheering me!
Tweet media one
Tweet media two
Tweet media three
Tweet media four
23
8
274
@AnimaAnandkumar
Prof. Anima Anandkumar
2 months
Very proud to see the FourCastNet model that I helped build at @nvidia in collaboration with @BerkeleyLab and other universities be highlighted in Jensen's keynote at #GTC24 - FourCastNet was the very first high-resolution #AI model to show competitive performance for weather…
10
28
277
@AnimaAnandkumar
Prof. Anima Anandkumar
9 months
Coming off from @nvidia blow-out earnings and company meeting, Jensen met our Earth-2 team. #ai + #science is a game-changer here. We are #hiring AI research scientists, deep learning engineers, numerical methods experts, and climate modelers. DM me.
Tweet media one
8
19
267
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
I have missed conference dinners. #NeurIPS2022 reunion. Great to see former students grow their research groups. Great to have students presenting at their first-ever conference. Great to connect everyone together.
Tweet media one
3
14
267
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
On #WomeninScienceDay I honor my grandma. While she didn't get a chance to formally study #STEM she instilled in me innate curiosity. She, along with my grandpa, allowed my mom to study engineering, something unprecedented in the community then, despite widespread opposition.
Tweet media one
1
9
248
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Check out the awesome video for our #neural #fly Our #AI based rapid adaptation to strong winds @GuanyaShi @aeropolarbear @Azizzadenesheli @yisongyue @Caltech
@Reuters
Reuters
2 years
Researchers at the California Institute of Technology have developed a drone that can fight back against powerful wind gusts, powered by machine learning, AI and complex algorithms
13
106
367
4
50
243
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
#Diffusion models are effective for protein-ligand structure prediction with equivariant transformers. Our method NeuralPLexer accurately inpaints binding site while using #alphafold doesn't. @ZhuoranQ @wn8_nie @ArashVahdat @tfmiller3
Tweet media one
@_akhaliq
AK
2 years
Dynamic-Backbone Protein-Ligand Structure Prediction with Multiscale Generative Diffusion Models abs:
Tweet media one
2
35
163
1
58
244
@AnimaAnandkumar
Prof. Anima Anandkumar
11 months
RL is too difficult to learn from scratch. The future is large foundation models with world knowledge helping with automatic curriculum generation and online learning
@KevinAFischer
Kevin Fischer — soul/acc
11 months
It’s becoming increasingly understood that RL is no longer the way to create agents that interact with their environment Instead, it’s about using GPT as a processor, and writing cognitive programs the agents execute @DeveloperHarris is one of my favorite follows in this space…
13
14
119
4
27
239
@AnimaAnandkumar
Prof. Anima Anandkumar
3 years
Join my Keller lecture at @Caltech today at 4pm PT on learning in infinite dimensions using neural operators and their applications in learning PDEs
Tweet media one
0
23
238
@AnimaAnandkumar
Prof. Anima Anandkumar
4 months
Our work on using Neural Operators to design a medical catheter just got published in Science Advances. A catheter is a flexible tube to draw fluids out of a human body. Unfortunately, catheters frequently cause bacterial infections by bacteria swimming…
2
38
242
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
"Let us ban matrix multiplications for six months" is not a solution to dangers #AI potentially poses while ignoring vast benefits. As with any technology, I believe in humanity's ability to embrace positive benefits while figuring out safety guardrails. No need to stop progress
4
20
235
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Thank you @GuggFellows for selecting me as a Guggenheim Fellow. The honor goes to my research team and collaborators. @caltech #guggfellows2023
Tweet media one
37
11
231
@AnimaAnandkumar
Prof. Anima Anandkumar
4 months
2023 is the year that we took AI+Science mainstream. My research summary of an amazingly productive year. In 2018, I co-founded the @caltech #AI + #Science initiative that spurred deep collaborations leading to many of these developments. Looking forward…
1
17
230
@AnimaAnandkumar
Prof. Anima Anandkumar
3 months
Tensors are back! I am so glad to see this! We have been advocating that tensor or multilinear operations are all you need. The benefits: universal approximation and expressivity. Higher order BLAS operations for parallelism without the need for any transposition or data…
@Grigoris_c
Grigoris Chrysos
3 months
Proud for our new #ICLR2024 paper attempting to answer: Are activation functions required for all deep networks? Can networks perform well on ImageNet recognition without activation functions, max pooling, etc? 🧐 Arxiv: 🧵1/n
10
49
337
1
25
219
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
I am thankful for having an amazing group of students and collaborators both at @Caltech and @nvidia Their passion continues to inspire me every day. I am also thankful to my family for being an amazing source of support. #HappyThanksgiving
Tweet media one
Tweet media two
2
4
222
@AnimaAnandkumar
Prof. Anima Anandkumar
6 months
For natural language, reducing hallucinations is a tradeoff between utility and creativity. Not so, for theorem proving and other applications that can be formally verified and certified. Check out our LeanDojo using LLMs including GPT4 interface that has…
@deliprao
Delip Rao e/σ
6 months
🚨 BREAKING: Introducing a new language model with ZERO hallucinations! Best of all, it’s easy to implement, easy to deploy, safe, and low resource!
Tweet media one
78
68
1K
3
33
220
@AnimaAnandkumar
Prof. Anima Anandkumar
3 months
Generative models are not just for generating plausible text, as in ChatGPT, but also samples in other domains such as chemistry and biology. An important problem is generating the configuration of how proteins and small molecules (ligands) bind with one another. We designed…
8
25
204
@AnimaAnandkumar
Prof. Anima Anandkumar
3 months
Honored to be awarded the Distinguished Alumnus Award by @iitmadras Feeling nostalgic about the time I spent there and how fast time has flown!
Tweet media one
10
5
201
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Thank you @laxmevy @QuantaMagazine for taking the time to present a unique perspective of my work and my background.
@QuantaMagazine
Quanta Magazine
2 years
Anima Anandkumar is leading research and institutional change that aim to reform the foundations of AI. In a conversation with @laxmevy , the machine learning scientist discusses her upbringing, tensor algebra and the ethical challenges facing her field.
40
37
132
7
26
180
@AnimaAnandkumar
Prof. Anima Anandkumar
3 months
Thrilled that our work on generative AI for dynamic protein-ligand binding is now on the cover of @Nature @ZhuoranQ @wn8_nie @tfmiller3
Tweet media one
@AnimaAnandkumar
Prof. Anima Anandkumar
3 months
Generative models are not just for generating plausible text, as in ChatGPT, but also samples in other domains such as chemistry and biology. An important problem is generating the configuration of how proteins and small molecules (ligands) bind with one another. We designed…
8
25
204
13
42
189
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Top-10 things that happened in 2022. It has been an action-packed year! So thankful for the opportunities I have been given and the amazing people I am surrounded with
3
21
183
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Really excited to see my @caltech group #website revamped, and is sleek and simple. Check it out! We will also be adding detailed project pages over the next month
6
9
178
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Physics-informed neural operator (PINO) for multi-body dynamics. The 3D PDE is challenging, but nicely decomposes into ODEs that are simpler and PINO can be used to solve it effectively
Tweet media one
2
29
176
@AnimaAnandkumar
Prof. Anima Anandkumar
18 days
We have now posted an expanded version of our Lean Co-pilot paper and updated the code base. The credit goes to @p_song1 for driving this effort. Our latest experiments show that our co-pilot can automate >80% of the proof steps…
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
Launching Lean Co-pilot for LLM-human collaboration to write formal mathematical proofs that are 100% accurate. We use LLMs to suggest proof tactics in Lean and also allow humans to intervene and modify in a seamless manner. Automating theorem proving…
21
328
2K
5
37
178
@AnimaAnandkumar
Prof. Anima Anandkumar
3 months
Super excited to share our paper on efficient training of Neural Operators with mixed precision, recently accepted at #ICLR2024 ! We show more than 50% gain in throughput with almost no loss in accuracy. Neural operators are #AI methods for solving #PDE . Unlike traditional…
Tweet media one
3
32
176
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
#blastfromthepast #pictures from @NeurIPSConf 2011, my first ever #NeurIPS I wanted to check out #ML before it was glamorous (my grad school was in #signalprocessing ) I found @NeurIPSConf to be open and welcoming, so I decided to stay :) Thank you @yaroslavvb for unearthing!
Tweet media one
Tweet media two
3
5
176
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
See our new paper on a new perspective on self-attention in #transformer We view the continuous extension of self-attention as kernel integration and use #Fourier neural operator #FNO to solve it. Leads to efficient #transformer with no loss in performance. @NVIDIAAI @Caltech
@MardaniMorteza
Morteza Mardani
2 years
Check out our new arxiv preprint on efficient token mixers for transformers via Fourier neural operators Fourier meets attention but more efficiently O(nlogn). With soft thresholding it allows dynamic scaling to high/continuous resolution vision.
Tweet media one
3
19
125
1
38
175
@AnimaAnandkumar
Prof. Anima Anandkumar
10 months
We apologize for confusion caused by the erroneous job posting at @nvidia We emphasize quality over quantity. Our work reflects that. My team is at @icmlconf Come talk to us. We will have a coffee chat on Thursday. DM us. @yukez @DrJimFan @ChaoweiX @Azizzadenesheli @JeanKossaifi
@BillDally
Bill Dally
10 months
@linylinx Allow me to apologize. This bullet item was posted in error. NVIDIA looks for the quality of publications. We are not concerned with quantity.
3
5
109
1
11
173
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Join us for #AI for science workshop at @Caltech on Feb. 9th for a hybrid workshop (both in-person and on Zoom). Register before Feb. 3rd here:
2
41
172
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
See you at #NeurIPS2022 My @Caltech team there: @SahinLale Learning and Control @ZongyiLiCaltech Neural operators @jiawzhao Optimization @ZhuoranQ AI for Chemistry @guanzhi_wang Minedojo and VIMA: RL with language models @KaiyuYang4 Neurosymbolic AI @OrSharir Quantum+AI
1
11
167
@AnimaAnandkumar
Prof. Anima Anandkumar
7 months
I do teach this in my class at @caltech
@DimitrisPapail
Dimitris Papailiopoulos
7 months
Your ML professor might not mention this, but in 1993 Barron famously proved that killer AI is in fact possible.
Tweet media one
7
32
229
3
12
164
@AnimaAnandkumar
Prof. Anima Anandkumar
9 months
Swimming in a glacier lake for real (not generated by AI)
Tweet media one
@francesarnold
Frances Arnold
9 months
Scientists of Twitter! The world needs more reminders that we're living, breathing human beings with lives outside a lab. Quote tweet this with a picture of you doing not-science! No water, no electricity, all home sweet home. I miss 137...
Tweet media one
9
17
523
6
3
166
@AnimaAnandkumar
Prof. Anima Anandkumar
1 month
Like many others, I came to US as an immigrant and made it my home. I benefitted immensely by being around smart and passionate people everywhere I went. Finding a path for capturing the value of immigrants we train here is really important to keep us competitive and innovative.
@deliprao
Delip Rao e/σ
1 month
If this were a science paper, you would expect a country that picks its science workforce at random as a “weak baseline” and a leading nation like the US to actively experiment towards state-of-the-art, or at least beat the baseline. Not providing a guaranteed path for…
33
123
685
1
9
163
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
A short summary of my #AI #research #Highlights2021 Grateful to have an amazing team of students and researchers at @Caltech and @nvidia #HappyNewYear
2
25
163
@AnimaAnandkumar
Prof. Anima Anandkumar
15 days
It is hard to put into words my experience speaking at @TEDTalks It was exhilarating, fulfilling, inspiring! Thank you @SCR10 for tirelessly helping me shape my talk and @TEDchris for all the feedback. Thank you @bjenik for being my cheerleader and a partner in making this talk…
Tweet media one
6
11
163
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Rare rainbow at @caltech after getting soaked in the rain.
Tweet media one
3
5
154
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
Automotive aerodynamics aims to study the behavior of vehicles under motion, minimizing drag and detecting any undesirable behavior before the vehicle design is approved for production. This is typically done with a combination of simulation and wind tunnel testing, which are…
Tweet media one
1
15
152
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
Geometry-informed neural operators (GINOs) can significantly accelerate traditional fluid dynamics simulations. We extend GINO to solve partial differential equations on irregular geometries using physics-informed losses. Based on flexible sampling strategies and exact…
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
Automotive aerodynamics aims to study the behavior of vehicles under motion, minimizing drag and detecting any undesirable behavior before the vehicle design is approved for production. This is typically done with a combination of simulation and wind tunnel testing, which are…
Tweet media one
1
15
152
3
25
153
@AnimaAnandkumar
Prof. Anima Anandkumar
4 months
Thank you for the honor. The credit really goes to my team and my collaborators. It is a privilege to be working with so many amazing people! @RealAAAI @Caltech
@CaltechEAS
Caltech Division of Engineering & Applied Science
4 months
Congrats to @Caltech EAS Professor @AnimaAnandkumar for being elected as an AAAI Fellow!
0
3
27
15
8
149
@AnimaAnandkumar
Prof. Anima Anandkumar
2 months
I love the open source community! We should fight to preserve this at all costs!
@tydsh
Yuandong Tian ✈️ ICLR2024
2 months
Lightning speed from open source community! The memory reduction of GaLore is reproduced from third-party (LLama-Factory), with 100% GPU utility and good-looking loss curve during full parameter fine-tuning :) GaLore 8-bit AdamW requires 28G while standard AdamW requires >= 42G…
Tweet media one
3
40
230
1
11
151
@AnimaAnandkumar
Prof. Anima Anandkumar
11 months
The first open data, model and benchmark for theorem proving under MIT license. Our small LLM with retriever is as good as the closed @OpenAI model. Democratization of #AI See more details in @KaiyuYang4 thread:
@_akhaliq
AK
11 months
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models paper page: Large language models (LLMs) have shown promise in proving formal theorems using proof assistants such as Lean. However, existing methods are difficult to reproduce or build…
1
24
109
5
22
144
@AnimaAnandkumar
Prof. Anima Anandkumar
9 months
A great afternoon with fabulous #womeninai and strong allies like our own Jensen Huang doing a panel on a wide range of topics, from pursuing an AI career to the value of diverse teams for building trustworthy AI and promoting hybrid work. @nvidia @Oracle @MosaicML #siggraph
Tweet media one
4
9
141
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
A simple lightweight approach to convert unconditional GANs into conditional models by only training a classifier through energy-based models in latent space of GANs. Zero-shot composition of attributes not present in training data. at #NeurIPS @wn8_nie @ArashVahdat @NVIDIAAI
@ArashVahdat
Arash Vahdat
2 years
📢 #LACE : Controllable & Compositional Generation with Latent-Space Energy-Based Models We introduce an extremely simple method for converting unconditional GANs into conditional models by training only a classifier. abs: project:
3
53
292
1
22
139
@AnimaAnandkumar
Prof. Anima Anandkumar
4 months
Thank you @RyanMaue for posting about our FourCastNet model. It was the first AI high-resolution weather model to show that accurate weather forecasting is possible while being tens of thousands of times faster than numerical weather models, which paved the way for other AI…
@RyanMaue
Ryan Maue
4 months
Want to see magic? This is the Nvidia FourCastNet (v2) A.I. global weather model prediction (inference) of Hurricane Lee from the day it was a named storm. Lee grows larger and more intense as it bends around the Bermuda high. Then, 12 days later it make landfall in NL.
3
14
76
2
24
137
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
My mom has always been my hero. She went on a hunger strike for days to convince my grandfather to allow her to study #engineering . She nurtured my love for #STEM as a kid and I didn't realize #womenengineers were such a rarity. #WomenInSTEM @QuantaMagazine
@QuantaMagazine
Quanta Magazine
2 years
“I never saw it as something weird for women to be interested in engineering … If my mom ever saw sexism, she would point it out and say, ‘No, don’t accept this.’ That really helped.” — Anima Anandkumar, machine learning scientist
Tweet media one
Tweet media two
1
21
83
0
4
136
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Looking forward to doing a discovery session on #ai tomorrow at @TEDTalks #TED2023 with @inafried @etzioni @tomgtgraham
Tweet media one
2
8
136
@AnimaAnandkumar
Prof. Anima Anandkumar
4 months
A unique experience to visit the remotest continent, #Antarctica on invitation from @congresofuturo organized by the Chilean senate. Everything was planned immaculately, and we were accompanied by two Senators organizing the event and received by a military general. We got to…
Tweet media one
3
5
135
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
Proud to be awarded @argonne_lcf Impact Award for winning team of @TheOfficialACM 2022 Gordon Bell Special Prize for building #genome scale #LM to help predict new variants of concern #SARSCoV2 with @arvindr_ @yuntiandeng @wn8_nie @ChaoweiX @ArashVahdat @sacdallago @nvidia
Tweet media one
11
11
135
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
🏆 Our paper "Deep Multimodal Fusion for Surgical Feedback Classification" won the best proceedings paper at @SymposiumML4H ! 🎉 We're revolutionizing #SurgicalTraining by automating feedback analysis using #MachineLearning . We've developed the first #AI
8
28
131
@AnimaAnandkumar
Prof. Anima Anandkumar
9 months
My talk on neural operators for science and engineering at the U.S. National Congress on Computational Mechanics. We have made exciting progress in applying neural operators to challenging multi-scale problems like weather forecasting, nuclear fusion
0
20
136
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
It was a unique #birthday and still having a strong viral load. Thanks to all friends and family for support. Hope to get better soon.
Tweet media one
27
0
134
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
#2021 has been an amazing year with so many unexpected #adventures Grateful to have an amazing team at @Caltech and @NVIDIAAI and supportive family and friends. Thank you! #HappyHolidays #happynewyear2022
Tweet media one
2
1
134
@AnimaAnandkumar
Prof. Anima Anandkumar
8 months
Our #AI weather model FourCastNet nailed the forecast for Hurricane Lee a week in advance!
@washingtonpost
The Washington Post
8 months
As Hurricane Lee tracked slowly westward in the middle of the Atlantic Ocean, three new weather models developed in the private sector predicted the storm would make landfall in Nova Scotia about a week later.
15
13
47
6
12
133
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Look what's crawling! Holding a #tarantula for the first time
Tweet media one
6
0
131
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
A short demo of Lean Co-pilot by @KaiyuYang4 We are here at #NeurIPS2023 to talk about AI for theorem proving - Tutorial on Machine Learning for Theorem Proving (): Monday 1:45–4:15 PM, Hall B2 - LeanDojo’s oral presentation: Tuesday 10 AM, Ballroom A-C…
2
27
129
@AnimaAnandkumar
Prof. Anima Anandkumar
10 months
Join us for coffee chat at @icmlconf Learn more about both full-time and intern positions in our AI Algorithms group. DM me or @DrJimFan @Azizzadenesheli @JeanKossaifi @ChaoweiX 1. AI + Science, Neural Operators 2. Foundation models + Decision Making 3. Fundamental AI research
@DrJimFan
Jim Fan
10 months
I'm going to ICML in Hawaii! My team pushes the research frontier in AI agents, multimodal LLMs, game AI, and robotics. If you're interested in joining NVIDIA or collaborating with me, please reach out by email! My contact info is at If applicable,…
Tweet media one
10
22
366
3
14
125
@AnimaAnandkumar
Prof. Anima Anandkumar
3 years
Proud to see launch of @nvidia Modulus for #physics #ai which will incorporate our work on physics informed neural operator. Stay tuned!
@NVIDIAGTC
NVIDIA GTC
3 years
NVIDIA Modulus—a framework for developing physics-based machine learning models that can be used for everything from basic analysis to digital twins. #GTC21
Tweet media one
0
27
78
1
7
123
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Awesome time at @nvidia offsite at #asilomar Got to meet so many team members in person for the first time.
Tweet media one
Tweet media two
2
4
123
@AnimaAnandkumar
Prof. Anima Anandkumar
6 months
Thank you @BloombergTV for having me on #AI IRL talking about AI+Science and how AI is revolutionizing weather forecasting through faster and cheaper forecasts allowing us to create larger ensembles.
@bbgoriginals
Bloomberg Originals
6 months
NVIDIA is using AI to create “very accurate digital twins of this planet.” The company's AI research director @AnimaAnandkumar explains why. Watch the full episode of AI IRL here
4
10
17
2
13
121
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
I am excited about generative AI but also concerned that not everyone can equally benefit from it. I got mixed results from @PrismaAI Some bore a resemblance, but many didn't. Also could not control the hypersexualization of women. Bias in the models is so obvious.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
@ctnzr
Bryan Catanzaro
1 year
Fun with @PrismaAI 2022 is a huge moment for generative AI.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
4
5
82
6
14
120
@AnimaAnandkumar
Prof. Anima Anandkumar
9 months
Our @Nature paper on #AI + #Science gives a comprehensive overview of current progress and things to come
@Nature
nature
9 months
Nature review: Scientific discovery in the age of artificial intelligence
2
40
122
1
21
119
@AnimaAnandkumar
Prof. Anima Anandkumar
6 months
Take a break from OpenAI drama. @bjenik encouraged me to try out the @leica_camera during our recent trip. A refreshing break from AI. trying manual focus and settings makes photography lot more enjoyable. #seoul #market
Tweet media one
Tweet media two
Tweet media three
Tweet media four
10
7
121
@AnimaAnandkumar
Prof. Anima Anandkumar
10 months
Come work with us on exciting and cutting-edge #ai research on topics such as: 1. AI + Science and Neural Operators 2. Foundation models and Decision Making 3. Fundamental algorithmic research in AI. We have internships open year-round at @nvidia
@Azizzadenesheli
Kamyar Azizzadenesheli
10 months
Fall 2023 Internship Join us at NVIDIA and be part of a highly esteemed AIAlgo team at the forefront of AI research and development. @AnimaAnandkumar
8
22
115
3
14
117
@AnimaAnandkumar
Prof. Anima Anandkumar
11 months
Agree. Our work showed that using GPT4 in an interactive way to generate automatic curriculum and build skill library can tackle complex long-horizon tasks in Minecraft. The future of RL will be generative modeling + online learning.
@DimitrisPapail
Dimitris Papailiopoulos
11 months
@DrJimFan If your Minecraft paper taught me something is that maybe you don’t really need RL when you have GPT4. Amazing project btw.
3
1
20
1
16
116
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Excited to release first genome-scale language models revealing evolutionary dynamics of Sars-CoV-2. Our model rapidly and accurately identifies variants of concern. Largest biological language models > 1.4 zettaflops on @nvidia Selene and Polaris
1
28
115
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Bill Dally @nvidia presenting at @caltech on role of number representation in #deeplearning 1000x speedup over the last decade. Logarithmic representation has the best efficiency. We propose multiplicative updates for low-precision training in log system
Tweet media one
Tweet media two
Tweet media three
0
15
113
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
It has been an absolute pleasure to work with @GuanyaShi at @Caltech He has done groundbreaking work in interdisciplinary area "learning to fly" requires building new foundations in #ai for safety+stability. See impressive demos on #drones He is on academic market. Hire him!
@GuanyaShi
Guanya Shi
2 years
I wrote a blog post: "Neural-Control Family: What Deep Learning + Control Enables in the Real World." This post discusses some key principles of our work on learning robotic agility in safety-critical systems (e.g., Neural-Swarm below).
5
82
512
1
10
108
@AnimaAnandkumar
Prof. Anima Anandkumar
4 months
An amazing experience going to the remotest continent #Antarctica on invitation from #chile #senate and got flown on a military plane. It is an honor to be part of this special group! #congresofuturo
2
3
108
@AnimaAnandkumar
Prof. Anima Anandkumar
5 months
#NeurIPS2023 dinner with my team and collaborators. Great to get everyone together after an energizing week!
Tweet media one
1
8
105
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Fundamental rights of women stripped. I never expected to see this day. Dogma and extremism instead of scientific foundations are dangerous. Guns now have more rights than women. #AbortionIsHealthcare #AbortionRightsAreHumanRights
5
11
104
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Our StrassenNet had shown 99.5% reduction in number of multiplications in #deeplearning and automatically discovering Strassen's algorithm. Good to see this line of work being extended
@demishassabis
Demis Hassabis
2 years
Since 1969 Strassen’s algorithm has famously stood as the fastest way to multiply 2 matrices - but with #AlphaTensor we’ve found a new algorithm that’s faster, with potential to improve efficiency by 10-20% across trillions of calculations per day!
154
1K
7K
1
8
99
@AnimaAnandkumar
Prof. Anima Anandkumar
1 year
It was great to go for @Caltech group dinner to celebrate PhD defense of @SahinLale after finishing @NeurIPSConf deadline
Tweet media one
1
3
100
@AnimaAnandkumar
Prof. Anima Anandkumar
2 years
Hugely excited to have powerful #AI tools for #scientific problems. Modulus is an efficient @PyTorch based framework with multinode support for solving #PDEs Our Fourier neural operator #FNO is available here. We used adaptive #FNO to obtain #FourCastNet SOTA #weather #emulation
@NVIDIAHPCDev
NVIDIA HPC Developer
2 years
NVIDIA Modulus has created physics-informed #digitaltwins of wind farms and power plants, as well as being utilized for prognosis and health management. Learn more about this neural network framework. #GTC22
0
11
64
1
14
101