Get the latest tech news

Google DeepMind's new AI can follow commands inside 3D games it hasn't seen before

Google DeepMind has published new research into an AI system that's able to carry out tasks in 3D games it hasn't seen before. The team says it's the first time an agent has shown it's able to understand a wide range of gaming worlds and carry out tasks within them based on natural-language instructions.

"Each game in SIMA’s portfolio opens up a new interactive world, including a range of skills to learn, from simple navigation and menu use, to mining resources, flying a spaceship or crafting a helmet," the researchers wrote in a blog post. The agent is evaluated on hundreds of basic skills that can be carried out within 10 seconds or so across several categories, including navigation ("turn right"), object interaction ("pick up mushrooms") and menu-based tasks, such as opening a map or crafting an item. "Ultimately, our research is building towards more general AI systems and agents that can understand and safely carry out a wide range of tasks in a way that is helpful to people online and in the real world," DeepMind said.

Get the Android app