Get the latest tech news

Researchers create 3D interactive digital room from simple video


Researchers at the Cornell Ann S. Bowers College of Computing and Information Science have developed an AI-powered process that automatically transforms a short video of a room into an interactive, 3D simulation of the space.

“Because of the advances in generative AI techniques, we finally have enough tools to make a baby step toward creating digital twins that are now interactable.” The research team demonstrated this by creating a game where the user shoots balls to knock over objects in the kitchen, like the kettle and soap bottle. The researchers virtually trained a robotic arm on the digital twin of the kitchen and then showed it successfully put away objects in the drawer in the real world.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of researchers

researchers

Photo of simple video

simple video

Related news:

News photo

Netherlands Unveils €50 Million Fund to Hire Top Researchers

News photo

Popular industry security tool repurposed by cybercriminals to deploy infostealer malware — Shellter developer blasts 'reckless and unprofessional' researchers for not disclosing issue for months

News photo

Researchers Jailbreak AI by Flooding It With Bullshit Jargon