Get the latest tech news

Google DeepMind's new AI tech will generate soundtracks for videos


Google's DeepMind artificial intelligence laboratory is working on a new technology that can generate soundtracks, even dialogue, to go along with videos.

The lab has shared its progress on the video-to-audio (V2A) technology project, which can be paired with Google Veo and other video creation tools like OpenAI's Sora. In its blog post, the DeepMind team explains that the system can understand raw pixels and combine that information with text prompts to create sound effects for what's happening onscreen. The researchers admit that they're still trying to address their V2A technology's existing limitations, like the drop in the output's audio quality that can happen if there are distortions in the source video.

Get the Android app

Or read this on Endgadget

Read more on:

Photo of Videos

Videos

Photo of Google DeepMind

Google DeepMind

Photo of soundtracks

soundtracks

Related news:

News photo

DeepMind’s new AI generates soundtracks and dialogue for videos

News photo

YouTube will soon ask audiences to add context to videos

News photo

YouTube Introduces Experimental 'Notes' for Users To Add Context To Videos