Feb 11
Groundbreaking AI Translates Voice Tracks In Films Instantly (Into Different Languages)
Unknowingly, artificial intelligence has been shaping the way of Hollywood filming for years now. AI has changed the way films are made, from AI-assisted scripting for storylines, AI in visual effect software that assists in creating photorealistic scenes much faster and efficiently, to even creating movie soundtracks that match the mood of the movie or trailer. — but that’s not even the most impressive aspects of AI in the film industry.
Deepdub was one AI platform that had me in awe.
Deepdub is a Tel-Aviv company that was founded in 2019 that’s changing the movie industry by storm.
“Deepdub aims to bridge the language barrier and cultural gap of entertainment experiences through high-quality localization at scale”
How does it work?
Deepdub works on the voices of actors in a way we never imagined.
There you are, streaming your favorite movie , and you want to switch to a different language but with that actor’s same voice to where it sounds like a natural (and real) transition from one language selection to the next — that’s where Deepdup transitions to different languages beautifully.
The technology is designed to fully automate the dubbing process, in an instant click of a button. Granted, it’s not 100% perfect, but as time progresses and AI gets smarter, this kind of technology can be applied in more ways beyond just streaming services. This kind of technology can be applied to automated call centers, chatbots, and possibly even translation devices.
Here’s a prime example of how it works:
Voice-dubbing years ago (and even now) is a service, where voice actors are hired from different countries to dub over an entire film, commercial, etc .— requiring hours (or even days) of recording, and can even be erroneously translated.
Not impressed?
Instantaneously, Ben Mittelman’s voice was dubbed by Deepdub’s AI, and did so impressively.
Technology like this could change the media-world as we know it, from streaming services, news broadcasting, translation services and more. As streaming services are gaining ground, the need for this technology is much-needed and is revolutionary to the way we connect and communicate.
AI is expanding so fast, there’s no telling what we’ll s̶e̶e̶ hear next!
