Ben Mildenhall
@BenMildenhall
Followers
9K
Following
2K
Media
33
Statuses
152
making stuff 3D at @theworldlabs. co-creator of NeRF and dreamfusion.
San Francisco, CA
Joined December 2020
we've been having so much fun testing our own tech 😆 I was able to create this world from just 2 input images in 10 minutes (and spent another 20 minutes making the flythrough video). workflow description below ⬇️
5
20
131
@liangsays @theworldlabs Bro is that the fucking volume? For a launch video? That’s insane
2
1
3
The rich and sprawling technological ecosystem around virtual worlds, content authoring, and 3D rendering will be transformed from top to bottom over the coming decade. Marble is a peek into our vision for the future of 3D world creation.
Introducing Marble by World Labs: a foundation for a spatially intelligent future. Create your world at https://t.co/V267VJu1H9
5
14
124
AI’s next frontier is Spatial Intelligence, a technology that will turn seeing into reasoning, perception into action, and imagination into creation. But what is it? Why does it matter? How do we build it? And how can we use it? Today, I want to share with you my thoughts on
167
620
3K
get your fresh frames hot off the H100 press https://t.co/FOglOi14Wn
rtfm.worldlabs.ai
RTFM is a new real-time generative World Model from World Labs. It generates video in real-time as you interact with it. Try the demo today!
Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!
6
8
167
Added some nice particle interaction to one of the amazing splats from @theworldlabs. Point positions are set from the gaussian positions and a fluid sim pushes the particles around. Excited to develop this further. Built with @playcanvas
#webgl #webgpu #GaussianSplatting
4
10
97
I've admired Ian's posts here for years – he's consistently producing some of the most creative and inspiring 3D tech demos around. Incredibly excited that he's joined us @theworldlabs, and looking forward to working together to bring our tech to the world!
Life update: I’ve joined @theworldlabs to help design, explore, and build the future of spatial intelligence! We’re entering a new frontier with World Models, and I’m super excited to help shape what’s next. If you’re curious about what’s possible with World Labs, reach out!
6
1
116
We're hiring research scientists in diffusion / generative models at @theworldlabs! Check out the role here: https://t.co/cpBvsvzAry Feel free to DM me if you would like to chat!👋
12
26
291
We're hiring product engineers at @theworldlabs. If you have strong opinions about react-three-fiber, can derive ray-triangle intersection by hand, and want to shape the future of web-native 3D AI tools... let's talk.
25
62
852
Total insanity. This is using an adaptive LOD scheme in sparksjs (not merged yet). The entire scene has 16million splats and this is real time navigation ... 😱😱
71
251
3K
Try it out at https://t.co/FlPMVYZKnc WASD + space to move and jump, click to shoot/grab built from @theworldlabs worlds, @threejs @sparkjsdev for rendering, Rapier for physics
2
4
29
Generated 3D worlds aren't just for viewing, you can also play projectile jenga inside link below
26
44
384
Generate persistent 3D worlds from a single image, bigger and better than ever! We’re excited to share our latest results and invite you to try out our world generation model in a limited beta preview.
210
529
4K
Experimenting with image-to-world: creating consistent 3D environments from a single photo. As someone who studied architecture, this feels like a glimpse into the future of spatial creation and I’m excited to see where World Labs takes it.
31
101
1K
A picture now is worth more than a thousand words in genAI; it can be turned into a full 3D world! And you can stroll in this garden endlessly long, it will still be there.
147
344
3K
Generative image to scene is getting incredibly good. This is pure 3D without v2v generated from the image in the reply ...
44
59
644
By randomly walking the campus, I encountered something surprising, the real NeRF scene! It's awesome!!
7
7
158
AI is so trippy. This entire scene, including the exterior, was created from a single image of the ovens in the interior. This is a multi-view reconstruction, not a video. No v2v used. Prompt image in reply.
42
23
302