YouTube Expands AI-Powered Auto Dubbing Feature to Knowledge-Based Channels

The feature supports automatic translation of videos created in English to Hindi, Spanish and more languages.

Written by Shaurya Tomer, Edited by Siddharth Suvarna | Updated: 11 December 2024 10:26 IST

YouTube Expands AI-Powered Auto Dubbing Feature to Knowledge-Based Channels

Photo Credit: YouTube

The auto dubbing feature was first announced at VidCon last year

Highlights

The AI feature transcribes, translates, and dubs videos for creators
Auto dubbing translates videos into a total of 9 languages
YouTube plans to roll out "Expressive Speech" with future updates

YouTube is expanding its auto dubbing feature to knowledge and information-focused content, it announced on Tuesday. The video streaming platform first announced this feature at VidCon last year and it leverages artificial intelligence (AI) technology developed by Aloud — Google's in-house Area 120 incubator. As the name suggests, auto dubbing can automatically transcribe and translate YouTube videos from English to other dialects and vice versa, helping creators engage viewers who don't speak the same language by transcending language barriers.

Expansion of YouTube's Auto Dubbing Feature

YouTube detailed the expanded availability of its AI-powered auto dubbing feature in a blog post. The Google-owned platform says that hundreds of thousands of YouTube channels that are part of the YouTube Partner Program which focus on knowledge and information will be able to take advantage of this feature.

Creators who make videos in English can get them auto dubbed into French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish. Meanwhile, if the video is in any of the aforementioned languages, it will get dubbed into English. Videos dubbed using this feature will appear with a auto-dubbed label. Viewers can choose to listen to the original audio by using the track selector.

Samsung Wins Patent for a Tri-Fold Smartphone With Specialised Barrier Layer for Improved Durability

To use this feature, no special steps are required. Creators simply need to upload videos and YouTube will automatically detect its language and dub it in other supported languages. Dubbed videos can be viewed in the YouTube Studio in the Languages section. Creators will have control over the dub and they can choose to unpublish or delete dubs that are not up to their liking, as per the platform.

The company admits that there may be cases when the translation might stray a bit far or the dubbed voice does not match the original speaker. However, it emphasises that users can always submit feedback for the feature's improvement. It is working towards bringing more accurate, expressive, and natural speech in dubs via a feature called ‘Expressive Speech' that was previewed at the Made on YouTube event in September.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: YouTube, YouTube Features, AI, Artificial Intelligence

Shaurya Tomer

Email Shaurya Tomer

Shaurya Tomer is a Sub Editor at Gadgets 360 with 2 years of experience across a diverse spectrum of topics. With a particular focus on smartphones, gadgets and the ever-evolving landscape of artificial intelligence (AI), he often likes to explore the industry's intricacies and innovations – whether dissecting the latest smartphone release or exploring the ethical implications of AI advancements. In his free time, he often embarks on impromptu road trips to unwind, recharge, and ...More

Instagram Rolls Out Trial Reels to Help Creators Test New Content With Non-Followers