YouTube has integrated a new AI-powered feature that will help users across the world to overcome the language barrier. With the help of AI, Google’s video-sharing platform wants to make it easier for users to dub videos in other languages. At the VidCon event held in the US, the company announced that the Aloudteam will be working on this project.Aloud is an AI-powered dubbing service from Google’s Area 120 incubator.
YouTube AI dubbing: Availability
In an interview with The Verge, YouTube’s Amjad Hanif stated that YouTube is already testing the tool with “hundreds” of creators. Hanif also mentioned that Aloud currently supports a “few” languages. The tool is expected to get more languages in the coming days. Currently, the Aloud dubbing tool only supports English, Spanish, and Portuguese.
YouTube AI dubbing: How will it work
Aloud’s website describes that before dubbing a video into some other language, this tool first transcribes the video. The tool then shows the transcriptions to the user for them to review and edit. After that, it translates and produces the dubbing for that video. Google’s Aloud team has also shared a video to explain how it works
YouTube AI dubbing: Availability
In an interview with The Verge, YouTube’s Amjad Hanif stated that YouTube is already testing the tool with “hundreds” of creators. Hanif also mentioned that Aloud currently supports a “few” languages. The tool is expected to get more languages in the coming days. Currently, the Aloud dubbing tool only supports English, Spanish, and Portuguese.
YouTube AI dubbing: How will it work
Aloud’s website describes that before dubbing a video into some other language, this tool first transcribes the video. The tool then shows the transcriptions to the user for them to review and edit. After that, it translates and produces the dubbing for that video. Google’s Aloud team has also shared a video to explain how it works
Aloud: Let’s overcome the language barrier in videos together
How will it help creators
Aloud can be an important tool for creators even with a limited number of languages. This tool can be useful as more creators are enabled to add multi-language dubs to their videos.
In the coming days, YouTube is “working to make translated audio tracks sound like the creator’s voice, with more expression, and lip sync,” Hanif added. The company is reportedly planning to add these features in 2024.
Last month, the company started using Google DeepMind’s AI to generate descriptions for YouTube Shorts. The company used the visual language model, called Flamingo, to make descriptions by analysing the initial frames of a video.
function loadGtagEvents(isGoogleCampaignActive) { if (!isGoogleCampaignActive) { return; } var id = document.getElementById('toi-plus-google-campaign'); if (id) { return; } (function(f, b, e, v, n, t, s) { t = b.createElement(e); t.async = !0; t.defer = !0; t.src = v; t.id = 'toi-plus-google-campaign'; s = b.getElementsByTagName(e)[0]; s.parentNode.insertBefore(t, s); })(f, b, e, 'https://www.googletagmanager.com/gtag/js?id=AW-877820074', n, t, s); };
window.TimesApps = window.TimesApps || {}; var TimesApps = window.TimesApps; TimesApps.toiPlusEvents = function(config) { var isConfigAvailable = "toiplus_site_settings" in f && "isFBCampaignActive" in f.toiplus_site_settings && "isGoogleCampaignActive" in f.toiplus_site_settings; var isPrimeUser = window.isPrime; if (isConfigAvailable && !isPrimeUser) { loadGtagEvents(f.toiplus_site_settings.isGoogleCampaignActive); loadFBEvents(f.toiplus_site_settings.isFBCampaignActive); } else { var JarvisUrl="https://jarvis.indiatimes.com/v1/feeds/toi_plus/site_settings/643526e21443833f0c454615?db_env=published"; window.getFromClient(JarvisUrl, function(config){ if (config) { loadGtagEvents(config?.isGoogleCampaignActive); loadFBEvents(config?.isFBCampaignActive); } }) } }; })( window, document, 'script', );
For all the latest Technology News Click Here
For the latest news and updates, follow us on Google News.
Denial of responsibility! NewsBit.us is an automatic aggregator around the global media. All the content are available free on Internet. We have just arranged it in one platform for educational purpose only. In each content, the hyperlink to the primary source is specified. All trademarks belong to their rightful owners, all materials to their authors. If you are the owner of the content and do not want us to publish your materials on our website, please contact us by email – [email protected]. The content will be deleted within 24 hours.
