YouTube is improving its automatic dubbing tool using artificial intelligence to better match lip movements. Initial testing indicates this upgraded feature might not be free in the future.
The platform is testing a new feature that uses AI to automatically match a speaker’s lip movements to translated audio, resulting in more realistic and captivating dubbed content.
YouTube’s Autodubbing feature, as explained by Product Lead Buddhika Kottahachchi in an interview with Digital Trends, works by visually altering the video to sync with the translated audio. This requires the technology to understand the 3D structure of a person’s face – including their lips, teeth, and overall posture – to realistically match the translated speech.
New YouTube features could cost users more money
Currently, the system performs best at 1080p resolution and isn’t yet optimized for 4K. The team is also expanding the feature to more languages, with the goal of supporting over 20 languages – the same number as YouTube’s automatic dubbing feature, according to Kottahachchi.
While optimistic, he cautioned that it’s too soon to make definitive announcements. He explained, “We need to test with more creators and fully understand the technical limitations and maintain quality before we can say how widely it will be released.”
Kottahachchi suggested this new feature might not be free. YouTube is still working out the details, but is considering charging creators based on how much processing power the feature uses.
We’re testing this feature with a small group of trusted creators right now, just like we did with auto-dubbing before releasing it to everyone.
This new development is a natural step in YouTube’s increasing focus on artificial intelligence. YouTube is already utilizing AI in several ways, including automatically making Shorts videos, optimizing ad placement for better results, and driving VEO 3, its cutting-edge video creation tool.
Automatically translating videos into different languages using lip-sync technology could soon make content available to a wider, global audience. However, creators might need to pay a fee to utilize this feature, and it’s currently unclear when it will be released.
Read More
- Gold Rate Forecast
- Katanire’s Yae Miko Cosplay: Genshin Impact Masterpiece
- Actors Who Voiced the Most Disney Characters
- Shape of Dreams Best Builds Guide – Aurena, Shell, Bismuth & Nachia
- When will Absolum have crossplay? It might take a while, but It’s on the horizon
- LINK PREDICTION. LINK cryptocurrency
- Can you change voice and gender in Blue Protocol Star Resonance? We explain the problem
- New Vampire: The Masquerade – Bloodlines 2 trailer details the Lasombra vampire clan
- HBAR Bulls Face $30M Tragedy: A Tolstoyan Tale of Crypto Woes 😱
- Marvel Zombies Loses #1 Streaming Spot, Beaten Out By Disney’s Biggest Flop of 2025
2025-10-17 22:48