YouTube is improving its automatic dubbing tool using artificial intelligence to better match lip movements. Initial testing indicates this upgraded feature might not be free in the future.
The platform is testing a new feature that uses AI to automatically match a speaker’s lip movements to translated audio, resulting in more realistic and captivating dubbed content.
YouTube’s Autodubbing feature, as explained by Product Lead Buddhika Kottahachchi in an interview with Digital Trends, works by visually altering the video to sync with the translated audio. This requires the technology to understand the 3D structure of a person’s face – including their lips, teeth, and overall posture – to realistically match the translated speech.
New YouTube features could cost users more money
Currently, the system performs best at 1080p resolution and isn’t yet optimized for 4K. The team is also expanding the feature to more languages, with the goal of supporting over 20 languages – the same number as YouTube’s automatic dubbing feature, according to Kottahachchi.
While optimistic, he cautioned that it’s too soon to make definitive announcements. He explained, “We need to test with more creators and fully understand the technical limitations and maintain quality before we can say how widely it will be released.”
Kottahachchi suggested this new feature might not be free. YouTube is still working out the details, but is considering charging creators based on how much processing power the feature uses.
We’re testing this feature with a small group of trusted creators right now, just like we did with auto-dubbing before releasing it to everyone.
This new development is a natural step in YouTube’s increasing focus on artificial intelligence. YouTube is already utilizing AI in several ways, including automatically making Shorts videos, optimizing ad placement for better results, and driving VEO 3, its cutting-edge video creation tool.
Automatically translating videos into different languages using lip-sync technology could soon make content available to a wider, global audience. However, creators might need to pay a fee to utilize this feature, and it’s currently unclear when it will be released.
Read More
- Movie Games responds to DDS creator’s claims with $1.2M fine, saying they aren’t valid
- The MCU’s Mandarin Twist, Explained
- These are the 25 best PlayStation 5 games
- SHIB PREDICTION. SHIB cryptocurrency
- Scream 7 Will Officially Bring Back 5 Major Actors from the First Movie
- All Golden Ball Locations in Yakuza Kiwami 3 & Dark Ties
- Server and login issues in Escape from Tarkov (EfT). Error 213, 418 or “there is no game with name eft” are common. Developers are working on the fix
- Rob Reiner’s Son Officially Charged With First Degree Murder
- MNT PREDICTION. MNT cryptocurrency
- ‘Stranger Things’ Creators Break Down Why Finale Had No Demogorgons
2025-10-17 22:48