Get the latest tech news
New Apple study teaches robots how to act by watching first-person videos of humans
In a new paper, Apple researchers propose an interesting way to train humanoid robots. And it involves wearing an Apple Vision Pro.
However, to explore a more affordable solution, they also 3D-printed a mount to attach a ZED Mini Stereo camera to other headsets, like the Meta Quest 3, offering similar 3D motion tracking at a lower cost. The result was a setup that let them record high-quality demonstrations in seconds, a pretty big improvement over traditional robot tele-op methods, which are slower, more expensive, and harder to scale. Instead of splitting the data by source (humans v. robots), HAT learns a single policy that generalizes across both types of bodies, making the system more flexible and data-efficient.
Or read this on r/apple
