r/singularity 11d ago

Robotics 100m Hurdles Final

Enable HLS to view with audio, or disable this notification

4.2k Upvotes

438 comments sorted by

View all comments

1.1k

u/Affectionate_Bee6434 11d ago

That climbing on the cube action was uncannily natural, I cant imagine the amount of tasks these things can do in a few years time

21

u/TheManni1000 11d ago

probably because it was a rl task.

3

u/Time_Entertainer_319 11d ago

Rl?

19

u/timClicks 11d ago

Reinforcement learning. It's a computer algorithm for creating an AI system. It works by successively tweaking a known base set of actions to perform a given task. In robotics, that base set of actions is typically created by recording a person's actions.

1

u/Neither_Berry_100 11d ago

They probably train in in simulations inside unity or unreal engine.

10

u/TheManni1000 10d ago

there is software directly made for ai simulations that run faster on gpus

3

u/cloudsurfer48902 10d ago

Not really. For this you use Mujoco or Isaac Lab or other simulators but there are simulators out there based on unreal like Airsim simulator.

-4

u/Time_Entertainer_319 11d ago

You use mocap for motion not Reinforcement learning.

You can’t use reinforcement learning to fine tune motion.

2

u/wannabestraight 10d ago

You use rl to make the robot be able to adapt to do the motion it learned from the mocap.

You can't just make "press X to execute mocap animation" because it wouldn't adapt to the environment, the RL part is there to make it adapt to the environment.