YouTube is improving its automatic dubbing tool using artificial intelligence to better match lip movements. Initial testing indicates this upgraded feature might not be free in the future.
The platform is testing a new feature that uses AI to automatically match a speaker’s lip movements to translated audio, resulting in more realistic and captivating dubbed content.
YouTube’s Autodubbing feature, as explained by Product Lead Buddhika Kottahachchi in an interview with Digital Trends, works by visually altering the video to sync with the translated audio. This requires the technology to understand the 3D structure of a person’s face – including their lips, teeth, and overall posture – to realistically match the translated speech.
New YouTube features could cost users more money
Currently, the system performs best at 1080p resolution and isn’t yet optimized for 4K. The team is also expanding the feature to more languages, with the goal of supporting over 20 languages – the same number as YouTube’s automatic dubbing feature, according to Kottahachchi.
While optimistic, he cautioned that it’s too soon to make definitive announcements. He explained, “We need to test with more creators and fully understand the technical limitations and maintain quality before we can say how widely it will be released.”
Kottahachchi suggested this new feature might not be free. YouTube is still working out the details, but is considering charging creators based on how much processing power the feature uses.
We’re testing this feature with a small group of trusted creators right now, just like we did with auto-dubbing before releasing it to everyone.
This new development is a natural step in YouTube’s increasing focus on artificial intelligence. YouTube is already utilizing AI in several ways, including automatically making Shorts videos, optimizing ad placement for better results, and driving VEO 3, its cutting-edge video creation tool.
Automatically translating videos into different languages using lip-sync technology could soon make content available to a wider, global audience. However, creators might need to pay a fee to utilize this feature, and it’s currently unclear when it will be released.
Read More
- Adolescence’s Co-Creator Is Making A Lord Of The Flies Show. Everything We Know About The Book-To-Screen Adaptation
- The Batman 2 Villain Update Backs Up DC Movie Rumor
- James Cameron Gets Honest About Avatar’s Uncertain Future
- These are the last weeks to watch Crunchyroll for free. The platform is ending its ad-supported streaming service
- New survival game in the Forest series will take us to a sci-fi setting. The first trailer promises a great challenge
- ‘Stranger Things’ Actor Gives Health Update After Private Cancer Battle
- BTC’s Descent: Traders Prepare for a Bitter New Year ❄️📉
- Battletoads Arrives On Nintendo Switch Online Alongside Three Other Classic Games
- The Best Battlefield REDSEC Controller Settings
- Activists arrested after custard and apple crumble thrown over Crown Jewels display at Tower of London
2025-10-17 22:48