This story is free to read because readers choose to support LAist. If you find value in independent local reporting, make a donation to power our newsroom today.
AI Tools For Dubbing And Lip Synching Poised To Transform Global Film And TV
Scarlett Johansson attends the 2023 God's Love We Deliver Golden Heart Awards at The Glasshouse on Oct. 16, 2023, in New York City.
(
Theo Wargo
/
Getty Images
)
Topline:
Last month’s conflagration between the actress Scarlett Johansson and OpenAI over whether it used her voice to train a conversation chatbot misses the bigger Hollywood story of how AI tools for dubbing and lip synching are poised to transform global film and TV.
Why it matters: Localized content that’s been dubbed into the local language is more popular, it allows for creative work to find a larger audience and for content owners to increase the value of their holdings. For actors, there’s potential to generate revenue from their voice work without even being present. But the unlock that AI tools provide do still come with unresolved legal issues, as well as questions about consent and compensation of the actors whose voices help train the AI speech models.
State of the AI art: The best AI voice dubbing tools can capture a complete range of an actor’s performance with about an hour of training data. This input can be blended with other data to create a wholly synthetic voice, thereby avoiding one actor having their aural “persona” appropriated. Lip-synching tools, which are just now emerging, can affordably match the words with the actor’s mouth movements. The premier companies in this space, which are working directly with studios, guilds and news organizations, emphasize their focus on always having permission to use a voice or modify lip movements and paying for their efforts.
Ethical concerns: Of course, not every company in this burgeoning space is upstanding, and the internet is rife with ways to produce unauthorized dubs of a person’s voice. Even if all the participants in AI voice work are properly compensated, there remain questions about the actors who previously provided localized performances, as well as the visual effects and audio engineers who have performed the traditional work of localizing content.
For more . . . read the full story on The Ankler.
This story is published in partnership with The Ankler, a paid subscription publication about the entertainment industry.
You come to LAist because you want independent reporting and trustworthy local information. Our newsroom doesn’t answer to shareholders looking to turn a profit. Instead, we answer to you and our connected community. We are free to tell the full truth, to hold power to account without fear or favor, and to follow facts wherever they lead. Our only loyalty is to our audiences and our mission: to inform, engage, and strengthen our community.
Right now, LAist has lost $1.7M in annual funding due to Congress clawing back money already approved. The support we receive from readers like you will determine how fully our newsroom can continue informing, serving, and strengthening Southern California.
If this story helped you today, please become a monthly member today to help sustain this mission. It just takes 1 minute to donate below.
Your tax-deductible donation keeps LAist independent and accessible to everyone.
Right now, LAist has lost $1.7M in annual funding due to Congress clawing back money already approved. The support we receive from readers like you will determine how fully our newsroom can continue informing, serving, and strengthening Southern California.
If this story helped you today, please become a monthly member today to help sustain this mission. It just takes 1 minute to donate below.
Your tax-deductible donation keeps LAist independent and accessible to everyone.
Senior Vice President News, Editor in Chief
