Motion retargeting and robot learning. A phone video of someone dancing becomes 3D human motion, gets retargeted to the Booster K1 humanoid, trained with reinforcement learning in simulation, and runs on the real robot.
Real robot
Your video becomes a 3D body moving in space.
The human motion is mapped onto the robot's joints and proportions.
Reinforcement learning teaches the robot to follow the motion without falling.
The trained policy runs on the real K1.
More dances on the real K1.
Tools: GVHMR (video to 3D motion), GMR (retargeting), MuJoCo and mjlab (simulation and training).
Sign-up form coming soon — just show up.