Jim Fan
@DrJimFan
Followers
312K
Following
8K
Media
832
Statuses
4K
NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
Views my own. Contact →
Joined December 2012
What if robots could dream inside a video generative model? Introducing DreamGen, a new engine that scales up robot learning not with fleets of human operators, but with digital dreams in pixels. DreamGen produces massive volumes of neural trajectories - photorealistic robot
55
112
656
Attending CVPR at Nashville! Email or DM me. I’ll float around the venue like brownian motion. Recruiting!.
14
107
219
DreamGen was featured in Jensen's Computex Keynote as the new GR00T Dreams workflow: .
1
3
32
Also check out the deep dive thread from @jang_yoel for more technical details! .
Introducing 𝐃𝐫𝐞𝐚𝐦𝐆𝐞𝐧!. We got humanoid robots to perform totally new 𝑣𝑒𝑟𝑏𝑠 in new environments through video world models. We believe video world models will solve the data problem in robotics. Bringing the paradigm of scaling human hours to GPU hours. Quick 🧵
3
7
41
Paper: DreamGen: Unlocking Generalization in Robot Learning through Neural Trajectories. Project website with lots of videos: This is a large team effort led by NVIDIA GEAR Lab and involves researchers from 8 other institutes!.
1
6
38
Video is our ASAP work from @TairanHe99 et al.
We RL'ed humanoid robots to Cristiano Ronaldo, LeBron James, and Kobe Byrant! These are neural nets running on real hardware at our GEAR lab. Most robot demos you see online speed videos up. We actually *slow them down* so you can enjoy the fluid motions. I'm excited to announce
2
2
34
The Physical Turing Test: your house is a complete mess after a Sunday hackathon. On Monday night, you come home to an immaculate living room and a candlelight dinner. And you couldn't tell whether a human or a machine had been there. Deceptively simple, insanely hard. It is the
70
214
1K
Some day in the next decade, we will have robots in every home, every hospital and factory, doing every dull and dangerous jobs with superhuman dexterity. That day will be known as “Thursday”. Not even Turing would dare to dream up our lifetime in his wildest dreams.
we crossed the turing test & no one gave a shit. no parades. no front page headlines. just… a casual shrug. like “oh yeah, the machines are smart enough to fool us now. anyway, what’s for lunch?”. that silence tells you everything about the pace we’re moving at. back in my cs.
34
101
741
We got lots of great community feedback on our open-source GR00T N1! Check out our Github, star, fork, contribute back! Let's solve generally intelligent robots together, one commit at a time.
Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset
15
57
399
Agents in the world of bits (computer use) and world of atoms (robotics) are the future. Stephanie gives a great talk, check it out!.
🔴Excited to share my TED AI talk! How we advance AI into an era of superintelligence, with true *practical* impact in our world. ❓I ask: For all the groundbreaking milestones we’ve reached, all the intelligence benchmarks we’ve shattered, for the $53B invested in generative
6
17
126
Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset
93
392
2K
lol a humanoid robot trying to badge into our HQ. Some day they will! 😆
12
5
230
Jensen’s keynote at 10 am!! Our team has been cooking some float matrices non-stop for the past months. Don’t miss Jensen’s bakery - greatness fresh out of the oven😌
19
27
443