Congress has cut federal funding for public media — a $3.4 million loss for LAist. We count on readers like you to protect our nonprofit newsroom. Become a monthly member and sustain local journalism.
AI Tools For Dubbing And Lip Synching Poised To Transform Global Film And TV
Scarlett Johansson attends the 2023 God's Love We Deliver Golden Heart Awards at The Glasshouse on Oct. 16, 2023, in New York City.
(
Theo Wargo
/
Getty Images
)
Topline:
Last month’s conflagration between the actress Scarlett Johansson and OpenAI over whether it used her voice to train a conversation chatbot misses the bigger Hollywood story of how AI tools for dubbing and lip synching are poised to transform global film and TV.
Why it matters: Localized content that’s been dubbed into the local language is more popular, it allows for creative work to find a larger audience and for content owners to increase the value of their holdings. For actors, there’s potential to generate revenue from their voice work without even being present. But the unlock that AI tools provide do still come with unresolved legal issues, as well as questions about consent and compensation of the actors whose voices help train the AI speech models.
State of the AI art: The best AI voice dubbing tools can capture a complete range of an actor’s performance with about an hour of training data. This input can be blended with other data to create a wholly synthetic voice, thereby avoiding one actor having their aural “persona” appropriated. Lip-synching tools, which are just now emerging, can affordably match the words with the actor’s mouth movements. The premier companies in this space, which are working directly with studios, guilds and news organizations, emphasize their focus on always having permission to use a voice or modify lip movements and paying for their efforts.
Support for LAist comes from
Ethical concerns: Of course, not every company in this burgeoning space is upstanding, and the internet is rife with ways to produce unauthorized dubs of a person’s voice. Even if all the participants in AI voice work are properly compensated, there remain questions about the actors who previously provided localized performances, as well as the visual effects and audio engineers who have performed the traditional work of localizing content.
For more . . . read the full story on The Ankler.
This story is published in partnership with The Ankler, a paid subscription publication about the entertainment industry.
As Editor-in-Chief of our newsroom, I’m extremely proud of the work our top-notch journalists are doing here at LAist. We’re doing more hard-hitting watchdog journalism than ever before — powerful reporting on the economy, elections, climate and the homelessness crisis that is making a difference in your lives. At the same time, it’s never been more difficult to maintain a paywall-free, independent news source that informs, inspires, and engages everyone.
Simply put, we cannot do this essential work without your help. Federal funding for public media has been clawed back by Congress and that means LAist has lost $3.4 million in federal funding over the next two years. So we’re asking for your help. LAist has been there for you and we’re asking you to be here for us.
We rely on donations from readers like you to stay independent, which keeps our nonprofit newsroom strong and accountable to you.
No matter where you stand on the political spectrum, press freedom is at the core of keeping our nation free and fair. And as the landscape of free press changes, LAist will remain a voice you know and trust, but the amount of reader support we receive will help determine how strong of a newsroom we are going forward to cover the important news from our community.
Please take action today to support your trusted source for local news with a donation that makes sense for your budget.
Thank you for your generous support and believing in independent news.
Chip in now to fund your local journalism
(
LAist
)
Trending on LAist
-
If approved, the more than 62-acre project would include 50 housing lots and a marina less than a mile from Jackie and Shadow's famous nest overlooking the lake. -
The U.S. Supreme Court lifted limits on immigration sweeps in Southern California, overturning a lower court ruling that prohibited agents from stopping people based on their appearance.
-
Censorship has long been controversial. But lately, the issue of who does and doesn’t have the right to restrict kids’ access to books has been heating up across the country in the so-called culture wars.
-
With less to prove than LA, the city is becoming a center of impressive culinary creativity.
-
Nearly 470 sections of guardrailing were stolen in the last fiscal year in L.A. and Ventura counties.
-
Monarch butterflies are on a path to extinction, but there is a way to support them — and maybe see them in your own yard — by planting milkweed.
Best of LAist