Meta announced today a new AI-based translation tool for creators on Instagram and Facebook. The company uses artificial intelligence to automatically dub videos in other languages, with support for lip-syncing and voice cloning that promises to preserve the creator’s tone and delivery. Here’s how to use it.
Meta AI promises good auto-dubbing with voice matching and lip sync
Right now, the feature supports two-way translations between English and Spanish, and Meta says that “more languages coming in the future”.
Creators can have their Reels automatically dubbed into the other language, and viewers see the dubbed version in their preferred language, along with a subtle indicator that the video was translated using Meta AI.
Meta says that all Instagram users with public accounts and Facebook creators with 1,000+ followers are eligible to use the tool, which is rolling out “in countries where Meta AI is available (excluding the European Union, United Kingdom, South Korea, Brazil, Australia, Nigeria, Turkey, South Africa, Nigeria, Texas and Illinois).”
Here’s how it works
For creators posting on Facebook, this is how you enable the feature:
- Create a Facebook reel
- Tap Translate your voice with Meta AI;
- Turn on the Add lip syncing feature (optional);
- Tap Review before publishing (optional);
- Tap Select languages and choose the language you want it translated to;
- Tap the back chevron;
- Tap Share now
Meta says that once the translation, dubbing, and lip-syncing process is done, you’ll be notified so you can review, approve, optionally remove the lip-sync, or delete the translation entirely. You’ll also have the option to report translation errors.
The company also says that it will provide metrics to help creators understand performance by language so that creators can track which languages their audience is watching.
Alternatively, creators can also upload up to 20 translated audio tracks for a single Facebook Reel through the Meta Business Suite platform.
Are you a Facebook or Instagram creator? Do you plan on using this feature? Let us know in the comments.
Limited time Mac deals on Amazon
- Mac mini (M4) 16GB/256GB: $499 (17% off)
- MacBook Air, 15-inch, M4, 16GB/256GB: $999 (was $1,199)
- MacBook Pro, 14-inch, M4, 16GB/512GB: $1,299 (19% off)
- Studio Display, Nano-Texture Glass, VESA Mount Adapter: $1,649 (13% off)
FTC: We use income earning auto affiliate links. More.
Comments