Lunch Talk40min
Let's dance! – Teaching your robot some moves with reinforcement learning
A humorous talk on training a humanoid robot to walk and dance using reinforcement learning in simulation. It introduces RL basics, NVIDIA Isaac Sim, Unitree RL Lab, motion retargeting from video, and imitation learning, ending with a live dancing performance by the robot.
talk.summaryAiDisclaimer
Thomas EndresTNG Technology Consulting GmbH
Martin F.TNG Technology Consulting GmbH
Tobias LübbeTNG Technology Consulting GmbH
talkDetail.whenAndWhere
Wednesday, October 7, 13:05-13:45
Room 10
Has this ever happened to you: You just spent €50,000 on a humanoid
robot, but it's not very fun at parties, so you have to train it to
dance using reinforcement learning in a simulation environment on your
€100,000 GPU cluster? What do you mean "NO"?
In this talk, Thomas Endres and David Winderl will teach you how you can
train your humanoid robot to dance using Reinforcement Learning (RL) in
simulation environments. They're gonna kick things off with an
introduction into RL, covering the basics of policies and rewards. After
that, they’ll take their first steps in simulation environments with the
introduction of NVIDIA Isaac Sim and the Unitree RL Lab. Our speakers
will run through the steps of shaping a walking policy, one hilarious
fall at a time. Finally, they're going to shake things up with a dancing
policy: You will learn how you can retarget human motion from videos to
the Unitree G1 robot and train an imitation policy that can dance just
as poorly as you.
For the grande finale, our humanoid robot will close the session with a
dancing performance, not missing out on a single step.
robot, but it's not very fun at parties, so you have to train it to
dance using reinforcement learning in a simulation environment on your
€100,000 GPU cluster? What do you mean "NO"?
In this talk, Thomas Endres and David Winderl will teach you how you can
train your humanoid robot to dance using Reinforcement Learning (RL) in
simulation environments. They're gonna kick things off with an
introduction into RL, covering the basics of policies and rewards. After
that, they’ll take their first steps in simulation environments with the
introduction of NVIDIA Isaac Sim and the Unitree RL Lab. Our speakers
will run through the steps of shaping a walking policy, one hilarious
fall at a time. Finally, they're going to shake things up with a dancing
policy: You will learn how you can retarget human motion from videos to
the Unitree G1 robot and train an imitation policy that can dance just
as poorly as you.
For the grande finale, our humanoid robot will close the session with a
dancing performance, not missing out on a single step.
Thomas Endres
Thomas Endres is a Managing Partner for TNG Technology Consulting in Munich. Besides his normal work for the company and the management of the customers he is creating various prototypes, including real-time deepfakes, an AI for generating presentations or various robotics showcases. He works on applications in the field of AI, robotics, AR/VR and teleoperation. Furthermore, he is involved in Open Source projects.
Thomas studied computer science at TU Munich and is a passionate software developer. As an Intel Software Innovator and Black Belt, he presents new technologies such as AI, AR/VR, and robotics worldwide. For this, he has received awards including a JavaOne Rockstar Award and several Best Speaker Awards.
Thomas studied computer science at TU Munich and is a passionate software developer. As an Intel Software Innovator and Black Belt, he presents new technologies such as AI, AR/VR, and robotics worldwide. For this, he has received awards including a JavaOne Rockstar Award and several Best Speaker Awards.
Martin F.
Martin Förtsch is an IT consultant at TNG Technology Consulting GmbH, located in Unterföhring near Munich. He holds a degree in computer sciences. Professionally, he specializes in Agile Development, primarily in Java, Search Engine Technologies, Information Retrieval, and Databases. As an Intel Software Innovator and Intel Black Belt Software Developer, Martin plays an active role in the creation of innovative tech-demos and showcases alongside the Innovation Hacking team.
In the past, Martin developed software for gesture-controlled quadcopters using Intel RealSense technology and designed an Augmented Reality wearable prototype device. He frequently presents at both national and international conferences on topics such as Artificial Intelligence, Internet of Things, Augmented Reality, and Test Driven Development. He earned multiple accolades, including the Oracle JavaOne Rockstar award.
In the past, Martin developed software for gesture-controlled quadcopters using Intel RealSense technology and designed an Augmented Reality wearable prototype device. He frequently presents at both national and international conferences on topics such as Artificial Intelligence, Internet of Things, Augmented Reality, and Test Driven Development. He earned multiple accolades, including the Oracle JavaOne Rockstar award.
Tobias Lübbe
Tobias Lübbe is a Software Consultant in TNG’s Innovation Hacking team. His work focuses on Physical AI and the development of innovative robotics showcases. Currently, he is exploring the use of Robot Foundation Models (RFMs) across different robotic systems. Before joining TNG, he studied Mechatronics at the Karlsruhe Institute of Technology (KIT) and Robotics, Cognition, Intelligence at the Technical University of Munich (TUM).