YouTube’s AI dubbing tool, the future of content creation?

Back in 2022, YouTube announced its AI dubbing feature ‘Aloud’, as part of an expanded Google translation experiment. So far, it has only been available to creators who have been granted access to the BETA version of the feature, which allows them to use AI to dub their videos in both Spanish and Portuguese.

Last week at the event ‘Made on YouTube’, YouTube announced their latest updates for the feature – we’ve looked into what this includes, and how this could help creators gain a wider worldwide audience in the long run.

How does YouTube’s AI dubbing tool work?

As noted on Aloud’s website, the service first transcribes, timecodes and translates the video in to your chosen language. The tool the allows the creator check the translated transcription and make any required adjustments, before the AI dub is created.

Once the transcription has been approved, Aloud then produces an AI audio dub into their chosen language, which is then applied directly to video and replacing the original audio – pretty neat!

What updates are being made, and how will this help creators?

There were three key updates announced at ‘Made on YouTube’ last week:

• Expand Creator Access: The auto-dubbing feature will be available to hundreds of thousands of creators in the coming months. Previously, this tool was only accessible to a limited number of creators in beta.
• New Language Options: Initially, the tool only allowed dubbing from English to Spanish and Portuguese. YouTube is now adding further languages, including French and Italian.
• Automatic Implementation: Once creators gain access, their videos will be automatically dubbed upon upload. Creators will have the option to opt out if they prefer not to use the feature.

YouTube’s dedication to using AI technology to improve the creative experience and broaden the platform’s global reach is has been emphasised a lot by this update. With the release of these functionalities, content producers will have additional resources to expand their audiences outside linguistic boundaries, which could change the way that content is created globally on the platform.

What does an AI dubbed version of a video sound like?

‘The Amoeba Sisters’ is a YouTube channel specialising in “demystifying science with humour and relevance”. The channel receives millions of views per video, and has gained a following of 2.7 million subscribers.

The channel has started to use Aloud, in order to produce an AI LATAM Spanish dub for their videos. To access the dubbed version, click the gear symbol, and then the ‘Audio Track’ option:

Once in the audio track menu, click ‘Spanish (Latin American)’, and the AI dubbed version of the video will automatically start to play.

To hear this for yourself, implement the above, and check out the video below!

Is AI dubbing the right choice for your content?

Although this feature isn’t flawless just yet, its present features are a good place to start, which we are sure will only improve with time.

It is an undeniable fact that, as a voice over agency, we are inherently biased in this area. However, we cannot ignore the reality that AI voices are becoming more present, and more effective in the voice over business.

As much as AI voices may seem like the ideal choice (due to their fast turnaround times and high quality), they are unable to replicate the emotions and authenticity of a script, unlike a human voice over.  As the demand for diverse content continues to grow, it becomes increasingly important for dubbing to be executed well. By valuing quality in dubbing, we can ensure that stories resonate with audiences around the globe, fostering a deeper appreciation for your content worldwide.

Do you have a project that requires dubbing services? We’re here to help.

To find out how we can help your business with quality dubbing, subtitling, translation, and voice over services, why not get in touch with us today? We provide voice over and subtitling services in over 80 languages.

Email us today via project@matinee.co.uk, and we’ll get back to you within the hour.