The relentless pace of software companies rolling out translation AI as a feature continues unabated. Video hosting and sharing services provider, Vimeo, has announced the release of AI-enabled video translation and voice cloning features to its video platform.
The company’s new AI-enabled translation functionality promises to “leverage generative AI to translate video, audio and captions into dozens of languages – while replicating the original speakers’ voices.”
The functionality, which also allows users to add and edit automatically generated captions, is the latest in a series of AI enhancements designed to boost the video-for-business enterprise user base. As part of the release, Vimeo allows enterprise users to generate a free, 30-second sample of the translations, after which it charges on a per-minute basis.
Users can upload videos with multiple speakers and can rate the quality of the translation by selecting a thumbs up or thumbs down icon for each language.
Ashraf Alkarmi, Chief Product Officer at Vimeo said that the company’s AI translation solution “goes beyond simple transcription.” He added that the tool allows users to “maintain the original speaker’s authentic nuances and tone […] in any language.”
The company did not reveal, however, if it is working with a third-party commercial AI translation provider to power the technology.
Slator Pro Guide: Translation AI
The Slator Pro Guide presents 10 new and impactful ways that LLMs can be used to enhance translation workflows.
Generative AI as a Feature
Vimeo’s latest development is representative of just how fast AI translation / dubbing is becoming a standard product feature, with the company’s promo video highlighting translation being “generative AI built right into Vimeo.”
Competitor YouTube also enables multiple third-party AI dubbing and voice cloning apps through its YouTube Studio. Adobe, meanwhile, has been teasing its AI dubbing feature for over a year now.
Vimeo has been working on adding AI-enabled capabilities since acquiring the AI video creation service, Magisto, in 2019. The acquisition saw Vimeo add ca. 100m additional users to its user base.