Meta launches artificial intelligence capable of translating text and audio into up to 100 languages

This Tuesday (22) Meta unveiled SeamlessM4T, a new artificial intelligence (AI) model can translate texts and perform audio transcriptions. open source tool supports almost 100 languages will be made available to researchers and developers.

According to the company, this technology is the first of its kind to be recognized as multimodal. This means that the resource has the ability to work with texts and sounds when translating, converting them from one format to another. Others similar tools only do one of these tasks.

SeamlessM4T supports:

• Speech recognition and text-to-text translation in nearly 100 languages;
• Text-to-speech translation in approximately 100 input and 35 output languages
• Speech-to-text translation for nearly 100 input and output languages
• Speech-to-speech translation in nearly 100 input and 36 output languages

Meta compared the novelty to the fictional Fish-Babel in the series A Hitchhiker’s Guide to the Galaxyknown instantly translate any language to any language. Big Tech said that the launch of the universal language translator represents a “significant step” in this work, given the small scope of available languages ​​in the world.

different possibilities

It is based on other translation models published by the company, such as No Language Left Behind and SpeechMatrix. SeamLessM4T can be used for different jobs. One possibility is to integrate it with the resources used by the moderators of the organization’s social networks.

As highlighted BorderProfessionals who moderate content on Facebook and Instagram may have difficulty dealing with certain languages ​​and may not be able to forward posts that violate these platforms’ policies. There is a trend towards reducing errors with the help of the new universal translator.

According to Meta, the AI ​​training included “tens of billions of sentences” and “4 million hours” of speech taken from the web. One Added system to identify poisonous words and sensitive topicsfacilitates the filtering of these contents in translations.