Get the latest tech news

AI headphones translate multiple speakers at once, cloning their voices in 3D sound


UW researchers designed a headphone system that translates several people speaking at once, following them as they move and preserving the direction and qualities of their voices. The team built the...

Now, Chen and a team of UW researchers have designed a headphone system that translates several speakers at once, while preserving the direction and qualities of people’s voices. The team’s algorithms separate out the different speakers in a space and follow them as they move, translate their speech and play it back with a 2-4 second delay. “Other translation tech is built on the assumption that only one person is speaking,” said senior author Shyam Gollakota, a UW professor in the Paul G. Allen School of Computer Science & Engineering.

Get the Android app

Or read this on r/technology

Read more on:

Photo of voices

voices

Photo of AI headphones

AI headphones

Photo of multiple speakers

multiple speakers

Related news:

News photo

Scammers are deepfaking voices of senior US government officials, warns FBI

News photo

Meta Chatbots Using Voices Of John Cena & Kristen Bell Got Sexually Explicit, Even With Minors

News photo

StrictlyVC heads to London and Athens this May: Featuring prime minister of Greece and Europe’s leading tech and VC voices