Get the latest tech news

MIT's new AI can teach itself to control robots by watching the world through their eyes — it only needs a single camera


Controlling diverse robots by inferring jacobian fields with deep networks! Let's make robots understand where their bodies are! - sizhe-li/neural-jacobian-field

[TL;DR] Neural Jacobian Fields are a general-purpose representation of robotic systems that can be learned from perception. We are working on a simplified implementation using CoTracker for the motion data extraction process, which will be released before the end of June. The authors thank Hyung Ju Terry Suh for his writing suggestions (system dynamics) and Tao Chen and Pulkit Agrawal for their hardware support on the Allegro hand.

Get the Android app

Or read this on r/technology

Read more on:

Photo of World

World

Photo of Eyes

Eyes

Photo of new ai

new ai

Related news:

News photo

"World's most power dense" electric motor obliterates the field | YASA takes the next step in its modernization and development of axial-flux technology, demonstrating a huge new benchmark

News photo

Denmark aims to host world’s most powerful quantum computer - Reuters

News photo

Exhausted man defeats AI model in world coding championship