RT @ACMUIST: 📣 The Student Volunteer lottery for #UIST2025 is now open! Be part of the team that brings UIST to life and make valuable conn….

Research is done in amazing collaboration with @nneonneo @hciprof ✨ You can find more details from our recently published paper at #CHI2025. Here are the preprint, full video, and code:

This localization enables on-the-go shared AR without pre-registration!

To do this, we extract square regions from the captured dot pattern. Using the PnP algorithm, we can match each square against a known “template” that we reverse-engineered from the iPhone’s LiDAR. Once we find the best match, the resulting transformation matrix gives us the 6DOF

As your device moves, the LiDAR dot patterns distort with angle and distance—basically encoding where it is. We decode that to find the device’s position and orientation in 3D. These LiDARs are already in your iPhone, iPad, Vision Pro, and Quest.

Yes, your iPhone already has a projector—using invisible light! 📱✨ In my latest research at @acm_chi, we repurpose its LiDAR dot pattern as a visual marker, enabling paired AR experiences without any online communication or pre-registration.

RT @huang_peide: 🚀 New Research on Human-Robot Interaction! 🤖. How can humanoid robots communicate beyond words? Our framework, EMOTION, le….

RT @seeedstudio: How can humanoid robots move smarter in crowded spaces? 🦾 Meet ARMOR —an egocentric perception system developed by @talkin….

RT @lukas_m_ziegler: 🚨 Apple joins the robotics race!. Researchers from @CarnegieMellon and @Apple have developed a robot collision avoidan….

RT @simonkalouche: Occlusion will be a big challenge for robots operating in dense, obstacle rich environments common in manufacturing. U….

RT @fly51fly: [RO] ARMOR: Egocentric Perception for Humanoid Robot Collision Avoidance and Motion Planning.D Kim, M Srouji, C Chen, J Zhang….

RT @OWW: ARMOR: Egocentric Perception for Humanoid Robot Collision Avoidance and Motion Planning.

RT @CarnegieMellon: Say goodbye to dead batteries!⚡️ New tech being developed at @SCSatCMU uses your body to charge wearable gadgets. The….

This work was done at Carnegie Mellon and Apple, partially during my internship at Apple Robotics. I deeply appreciate my internship manager Mario Srouji and amazing collaborators Chen Chen and Jian Zhang. @SCSatCMU.Paper, videos and code (coming soon!) at

We hope that the robotic community continues to expand upon the ARMOR perception to further advance the capability of mobile humanoid robots.

We train a transformer-based imitation learning policy in simulation to perform collision-free motion planning, by leveraging around 86 hours worth of human realistic motions from the AMASS dataset.

Humanoid robots have significant gaps in their sensing and perception, making it hard to perform motion planning in dense environments. Our distributed perception approach enhances the robot’s spatial awareness, and facilitates more agile motion planning.

Can we make wearable sensors for humanoid robots and augment their perception?. We are introducing ARMOR, a novel egocentric perception system that integrates both hardware and software, specifically incorporating wearable-like depth sensors.

RT @realkaranahuja: 🔬 My lab at @NorthwesternU has a new website! Visit to see our latest research from CHI, ECCV &….

RT @ACMUIST: 📸 #UIST2024 albums are here! Huge thanks to our fantastic Photography SVs for capturing all the unforgettable moments. Check….