Joseph Lim
@JosephLim_AI
Followers
1K
Following
222
Media
7
Statuses
62
PI of the CLVR lab. Associate Professor @KAIST_ai. Prev: assist. prof. @USC, postdoc @Stanford, CS PhD @MIT, BA @UCBerkeley. AI, Robotics, Vision, ML.
Seoul, Republic of Korea
Joined July 2017
We are finally releasing a new benchmark!! #RSS2023 Main highlights are: * For real-world * Reproducible (3D printing) * 9 furniture assembly long-horizon tasks * 200+ hrs of demonstrations This apparently is my 3rd furniture-related benchmark.๐ฅน https://t.co/XrlP4cAuYS
Looking for a challenging manipulation benchmark? Introducing FurnitureBench ๐ช๐ ๏ธ, a reproducible real-world furniture assembly benchmark (#RSS2023 @RoboticsSciSys)! It features * 8 furniture models * 200+ hours of expert demonstrations * FurnitureSim: Isaac Gym simulator ๐งต๐
0
17
90
Very excited to start sharing some of the work we have been doing at Amazon FAR. In this work we present OmniRetarget, which can generate high-quality interaction-preserving data from human motions for learning complex humanoid skills. High-quality re-targeting really helps
Humanoid motion tracking performance is greatly determined by retargeting quality! Introducing ๐ข๐บ๐ป๐ถ๐ฅ๐ฒ๐๐ฎ๐ฟ๐ด๐ฒ๐๐ฏ, generating high-quality interaction-preserving data from human motions for learning complex humanoid skills with ๐บ๐ถ๐ป๐ถ๐บ๐ฎ๐น RL: - 5 rewards, - 4 DR
8
39
291
It's almost time for #CoRL 2025! A reminder that we're hosting the Data in Robotics workshop this Saturday Sept 27th. We have a packed schedule and are also attempting to livestream the event for those who can't attend in person.
3
9
67
We have our speakers: @JosephLim_AI @KarlPertsch @mayacakmak , Serena Booth, @JasonMa2020 @shahdhruv_ @MashaItkina We also have a great panel lined up from 3-3:40pm! @svlevine @yukez @MashaItkina @SudeepDasari @ashwinb96 @JasonMa2020 @shahdhruv_
1
2
6
Honored that our @RL_Conference paper won the Outstanding Paper Award on Empirical Reinforcement Learning Research! ๐Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-Functions ๐ https://t.co/owm0hVVsUK Grateful to my advisors @JosephLim_AI and @ebiyik_!
At @RL_Conference๐, I'm presenting a talk and a poster on Aug 6, Track 1: Reinforcement Learning Algorithms. We find that Deterministic Policy Gradient methods like TD3 often get stuck at local optima under complex Q-functions, and propose a novel actor architecture! ๐งต
9
10
72
https://t.co/AAuq5Emr37 CoRL 2025 schedule is released now! Please note that the whole schedule is earlier than other times. The submission deadline: 4/28 The conference: 9/27-9/30 @corl_conf #corl2025
corl.org
Welcome to CoRL 2025!
0
9
49
Do you work on robotics? Do you like robots? Then, visit Korea next year! We (@ryoo_michael @gupta_abhinav_ @SongShuran Haewon and more) are organizing CoRL 2025 in Seoul, Korea!! #CoRL @corl_conf #robotics
I am extremely pleased to announce that CoRL 2025 will be in Seoul, Korea! The organizing team includes myself and @gupta_abhinav_ as general chairs, and @JosephLim_AI, @songshuran, and Hae-Won Park (KAIST) as program chairs.
4
4
83
I've been historically bearish on skill-based RL and @Jesse_Y_Zhang consistently shows me I'm probably wrong. Come check out EXTRACT at 1600 at @corl_conf (poster #11) to see him yank semantically meaningful skills out offline data by leveraging PTLMs. https://t.co/BddE1rsvXr
arxiv.org
Most reinforcement learning (RL) methods focus on learning optimal policies over low-level action spaces. While these methods can perform well in their training environments, they lack the...
1
6
36
This work was guided by Jesse's co-advisor's @ebiyik_ and @JosephLim_AI, but I think we all agree that Jesse is effectively running his own little lab. If you're thinking about hiring a postdoc in the area of RL for robotics, Jesse comes a ton of insight and mentoring experience!
0
6
14
Well.. we won the best system paper award #RSS2023 @RoboticsSciSys !! @MinhoHeoโs talk can be found at: https://t.co/HyEQQErXOk We (@MinhoHeo @doohyun22 @YoungwoonLee & I) gave quite a bit of effort into this talk. So, we hope you enjoy the talk and, of course, the project :)
Looking for a challenging manipulation benchmark? Introducing FurnitureBench ๐ช๐ ๏ธ, a reproducible real-world furniture assembly benchmark (#RSS2023 @RoboticsSciSys)! It features * 8 furniture models * 200+ hours of expert demonstrations * FurnitureSim: Isaac Gym simulator ๐งต๐
6
6
128
My student @MinhoHeo will be giving a talk in 2hrs (11am KST today). #RSS2023 This work is also one of the best system paper finalists too! Come and check it out :)
We are finally releasing a new benchmark!! #RSS2023 Main highlights are: * For real-world * Reproducible (3D printing) * 9 furniture assembly long-horizon tasks * 200+ hrs of demonstrations This apparently is my 3rd furniture-related benchmark.๐ฅน https://t.co/XrlP4cAuYS
0
2
13
@MinhoHeo @YoungwoonLee @doohyun22 On Friday, at a workshop, about BOSS โ bootstrapping a skill library for unseen environments with LLM Short Talk (Friday 4:30pm) & Poster(2:45pm) Room: 306A By @Jesse_Y_Zhang @JiahuiZhang_32 @KarlPertsch Ziyi Liu @xiangrenNLP @minsuk_chang @shaohua0116
https://t.co/qFkDsAzurw
sites.google.com
Introduction Language is a cornerstone of human evolution that has played a crucial role in developing communication, socialization, and complex societies. In order to seamlessly integrate robots...
0
1
8
Then, on Wednesday, we have FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation. Talk (Wednesday 11am) & Poster (Wednesday 3pm) By @MinhoHeo @YoungwoonLee @doohyun22
https://t.co/K1LHgNJF35
clvrai.github.io
FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation.
1
1
7
Then, on Tuesday, we have PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection. Talk (Tuesday 11am) & Poster (Tuesday 3pm) By Shivin Dass, @KarlPertsch Hejia Zhang, @YoungwoonLee @snikolaidis19
https://t.co/eygwDyvRAs
clvrai.github.io
PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection
1
1
7
We have a bunch of presentations this year. Starting with my own talk (Skill-based Robot Learning) at the Interdisciplinary Exploration of Generalizable Manipulation Policy Learning: Paradigms and Debates workshop. Today at 1:30pm Room: 322A https://t.co/3GhCBTtP2I
1
0
4
At #RSS2023 this week w/ some of my (ex-)students from CLVR (@YoungwoonLee @MinhoHeo @doohyun22 @sungj1026 ). Excited to meet about topics on robot learning, RL, physical reasoning, long-horizon manipulation, etc. + Recruiting (intโl & domestic) students. Plz come and say hi!
1
1
17
Having humans annotate data to pre-train robots is expensive and time-consuming! Introducing SPRINT: A pre-training approach using LLMs and offline RL to equip robots w/ many language-annotated skills while minimizing human annotation effort! URL: https://t.co/KuxuUeaXmA ๐งต๐
2
29
118
Excited to present PATO: Policy Assisted TeleOperation, our recent work on scaling robot data collection! PATO uses a policy trained on prior data to assist the user during data collection, making teleop easier and even allows to teleop multiple robots simultaneously. ๐งต๐
1
10
46
Check out our #CoRL2022 paper on learning skill dynamics for model-based RL! We present a sample efficient RL algorithms by temporal abstraction (skills). @YoungwoonLee @lucy_x_shi (an undergrad who will graduate soon!)
Can robots be farsighted? We introduce SkiMo (Skill + Model-based RL), which allows more accurate and efficient long-horizon planning through temporal abstraction. SkiMo learns temporally-extended, sparse-reward tasks with 5x fewer samples! ๐งต๐
0
2
10