Get the latest tech news
Led by a founder who sold a video startup to Apple, Panjaya uses deepfake techniques to bite into video dubbing
There’s a big opportunity for generative AI in the world of translation, and a startup called Panjaya is taking the concept to the next level: a
“Our whole lip sync engine is homegrown by our AI research team, because we haven’t found anything that gets to that level and quality of multiple speakers, angles, and all the business use cases we want to support.” The resulting translation videos are very uncanny, not unlike what you get with deepfakes, although Piekarz winces at that term, which has picked up negative connotations over the years that are the exact opposite of the market the startup is targeting. There are a number of startups that compete with Panjaya in the wider area of AI-based translation for videos, including big names like Vimeo and Eleven Labs, as well as smaller players like Speechify and Synthesis.
Or read this on TechCrunch