Lukas Schäfer
@LukasSchaefer96
Followers
837
Following
4K
Media
21
Statuses
382
Researcher @MSFTResearch working on autonomous agents in video games; PhD @InfAtEd; Ex @Huawei Noah’s Ark Lab, Dematic; Young researcher @HLForum 2022;
Cambridge, UK
Joined June 2015
📚🧵1/7 It is finally here!! Only one more week until the print release of our textbook “Multi-Agent Reinforcement Learning: Foundations and Modern Approaches” with @mitpress! What you get, why you should be interested and more, all below in a short 🧵👇
2
19
83
It was great to visit @sheffielduni to give an invited talk on work from my PostDoc at MSR, and have a chance to talk to students and faculty at the CS department. Thanks a lot to Robert Loftin for the kind invitation and for hosting me!
0
0
2
My Lab at the University of Edinburgh🇬🇧 has funded PhD positions for this cycle! We study the computational principles of how people learn, reason, and communicate. It's a new lab, and you will be playing a big role in shaping its culture and foundations. Spread the words!
9
82
326
The Edinburgh RL reading group is back with regular meetings and a new website! Anyone is welcome to attend 👏
Hello world! This is the RL & Agents Reading Group We organise regular meetings to discuss recent papers in Reinforcement Learning (RL), Multi-Agent RL and related areas (open-ended learning, LLM agents, robotics, etc). Meetings take place online and are open to everyone 😊
1
0
10
Hello world! This is the RL & Agents Reading Group We organise regular meetings to discuss recent papers in Reinforcement Learning (RL), Multi-Agent RL and related areas (open-ended learning, LLM agents, robotics, etc). Meetings take place online and are open to everyone 😊
2
9
20
The Multi-Agent RL book has completely sold out! 😀 Reprints are now in production by @mitpress. We have updated the book with some corrections. The book PDF + errata, slides, code and exercises are available at https://t.co/pHWfMZrwmF.
marl-book.com
Textbook published by MIT Press (2024)
1
51
317
I'm excited to chat at #RLDM2025 about our (with @SamuelGarcin) recent project: PixelBrax, where we combine the Brax physics engine with JAX-based rendering to enable end-to-end GPU training from pixels. paper: https://t.co/u1ieca3IVL code: https://t.co/TS2KZEb5YA Thread 1/
1
4
9
Today, I’ll be presenting our work on exploration in MARL using ensembles here! 👇 Multiagent Learning Session Where: Ambassador Ballroom 1 & 2 When: 14:00 - 14:13 I’ll also present the poster later at the Learn track of the poster session at 15:45 - 16:30
At the main conference, I'll be presenting our work on using ensembles of value functions for multi-agent exploration! I'll be presenting the oral at the Multi-agent Learning 1 session on Wednesday (2:00 - 3:45pm), and the poster after 3:45pm! Paper: https://t.co/OIVInWYSVc
0
0
8
Thanks to all the co-authors and collaborators! Logan Jones, Anssi Kanervisto, Yuhan Cao, Tabish Rashid, Raluca Georgescu, David Bignell, Siddhartha Sen, Andrea Treviño Gavito, and first and foremost @smdvln It's been an absolute joy working with this group of kind folks 👏
0
0
2
Paper: https://t.co/IlqfRGBC1M It took some time but I'm super excited that now our code is also open-source and available for everyone to use at:
github.com
Accompanying code for "Visual Encoders for Data-Efficient Imitation Learning in Modern Video Games" publication - microsoft/imitation_learning_in_modern_video_games
1
0
3
At the Adaptive and Learning Agents Workshop I'll be presenting our comprehensive study on the efficacy of different visual encoders for imitation learning in modern video games. I'll be presenting the work as a short talk and poster at the ALA workshop on Monday!
1
0
2
This has been a long time coming, thanks a lot for my collaborators for all their help! Olivers Slumbers, @McaleerStephen, @yalidux, Stefano Albrecht, and David Mguni It's actually going to be my first ever oral presentation, so excited (and nervous) about that 👀
1
0
3
At the main conference, I'll be presenting our work on using ensembles of value functions for multi-agent exploration! I'll be presenting the oral at the Multi-agent Learning 1 session on Wednesday (2:00 - 3:45pm), and the poster after 3:45pm! Paper: https://t.co/OIVInWYSVc
1
0
4
On my way to Detroit for @AAMASconf! Looking forward to presenting the last work from my PhD at the main conference, and work from @MSFTResearch at the Adaptive and Learning Agents Workshop. More info👇 If you'd like to chat, feel free to DM me!
2
1
12
Looking forward to presenting our study on representation learning for on-policy actor-critic algorithms in Singapore for #ICLR2025 ! Here's a picture to tease 3 key insights in our study... 1⃣ Decoupled actor-critic model architectures outperform their shared counterparts.
1
8
32
We are making available an experimental and interactive real-time gameplay experience in Copilot Labs, powered by our Muse family of world models. Learn more about the research underpinning this experience:
microsoft.com
Today we are making available an interactive real-time gameplay experience in Copilot Labs, powered by our Muse family of world models. This blog post provides a deeper look at the research underpi...
4
23
97
What happens when we train generative AI models to predict everything that happens in a modern video game? In my TED AI talk I share insights from how AI can learn the physics of a game, and how this research could empower game creatives:
ted.com
AI is already a powerful tool for collaboration — but this is just the tip of the iceberg, says AI researcher Katja Hofmann. She describes her team's work training AI on years of human gameplay data...
4
14
86
My colleague Martin recorded an awesome tutorial video of the WHAM Demonstrator - a tool that allows you to explore the capabilities of World and Human Action Models like Muse
microsoft.com
Introducing Muse, our World and Human Action Model (WHAM). Muse is a generative AI model of a video game that can generate game visuals, controller actions, or both. It can predict how the game will...
1
7
38
Today in Nature: our research on world and human action models (WHAM) - generative ai models of video games, aimed towards supporting game creatives in gameplay ideation : https://t.co/zeaOGbfVqh - huge congrats to everyone who made this happen, I couldn't be more proud 🥳
nature.com
Nature - A state-of-the-art generative artificial intelligence model of a video game is introduced to allow the support of human creative ideation, with the analysis of user study data highlighting...
20
56
220