Jesse Engel
@jesseengel
Followers
9K
Following
5K
Media
161
Statuses
2K
Guitarist, Researcher Google DeepMind. Opinions are my own. @jesseengel.bsky.social @[email protected]
Joined April 2009
Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...
81
170
1K
Extra cool that it's also an applet so you can fork it and make it your own:
0
0
1
One of the most fun things about latent spaces, is that they are actual spaces. Take a ride in you own spaceship to explore the constellations of latent music! https://t.co/IYon3jQDc5 Powered by the Lyria RealTime API in AI Studio.
magenta.withgoogle.com
Today, we’re excited to launch Space DJ, a web application from Magenta thatturns music exploration into an interactive journey through a constellation ofsou...
We built a web app that lets you fly a spaceship through a 3D constellation of music - powered by our Lyria RealTime model. 🎶 Space DJ is an interactive visualization where every star represents a different music genre. As you explore, your path is translated into prompts for
2
3
23
We built a web app that lets you fly a spaceship through a 3D constellation of music - powered by our Lyria RealTime model. 🎶 Space DJ is an interactive visualization where every star represents a different music genre. As you explore, your path is translated into prompts for
100
273
2K
My team in GDM Frontier AI is hiring (Mountain View). If you're a researcher interested full duplex modeling, multimodal LLMs (Gemini), modality gap, joint speech/text modeling, PGMs, streamable generative models, and representation learning for language modeling -- DM me!
1
11
103
Join our team and build the future of generative worlds! We are at an incredibily exciting moment where research prototypes are becoming useful technology for capture, creation, and interaction in 3D worlds.
We're hiring for full-time roles in NYC and SF, link to the listing is below.
2
19
285
Want to join @GoogleDeepMind as a Student Researcher for 6 months starting in January (PhD students)? 🧬 The project will be focused on AI for Science and AI for Cancer! Send me a DM and also apply below👇
69
163
2K
Our team at DeepMind is growing (again). 🚀 We're tackling grand challenges in semiconductors, magnets, energy materials, superconductors, and beyond. Join us! Two positions below.
13
42
770
I think the most human thing coding assistants do is making numerical tests pass by just increasing the tolerences, very relatable.
0
0
1
Google Magenta @GoogleMagenta RealTime + music sentiment analysis + prompt block game = A twist on the lo-fi anime girl. 👉 You need to play to keep her studying. If the music gets too quiet → she falls asleep 😴 If it’s too danceable → she starts dancing 💃
2
14
50
So excited about the upcoming live performance by @daitomanabe using Lyria RealTime, this Saturday in Tokyo! He is a true legend and inspiration, and I can't wait to see what he does with the technology. I will be there with @ethanmanilow to share more about our work and
【Event Announcement!】 Google Magenta Night Party Special event featuring Google’s music generation AI ‘Magenta’! A talk by the Magenta developers & a DJ performance using Magenta by Daito Manabe × RISA TANIGUCHI. Experience a one-night-only musical fusion of human sensibility
1
8
34
🔊New paper! Recomposer allows editing sound events within complex scenes based on textual descriptions and event roll representations. And we discuss the details that matter! Work led by Dan Ellis w/ a bunch of Sound Understanding folks @GoogleDeepMind
https://t.co/J6F57BqSMn
0
4
42
Made a walkthrough vid for Magenta RealTime “Audio Injection”! The notebook takes ~10m to spin up, but totally worth it for the surreal experience 🎤💻🎧⁉️
2
15
61
Great tutorial and how to set up and do live AI jamming
Made a walkthrough vid for Magenta RealTime “Audio Injection”! The notebook takes ~10m to spin up, but totally worth it for the surreal experience 🎤💻🎧⁉️
0
3
31
Everyone talks about real-time AI for speech but sleeps on it for music Real-time is nice to have for conversations, but essential for co-jamming
Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...
1
7
37
Nice jam!
@jesseengel Hours and hours of fun and inspiration. Tiny excerpt: https://t.co/nz7fKxjwh4
0
0
0
Insightful passage from @FranklinFoer for @TheAtlantic. It does feel like the pursuit of science to promote human understanding is falling away to the promotion of individuals and their fortunes. "Not so long ago, the astronomer Carl Sagan shaped how Americans thought about
0
2
15
🔊 Easy to lose hours to live jamming w/ Magenta RT. Feels like a glimpse at something magical Try it yourself! Some setup involved (we're working on improving that!) but worth it: https://t.co/eD7rK2lsfz
7
18
112