“Yandex.Browser” users became available video polyphonic translation. The service acquired twelve voices, six female and six male. This should improve the quality of the video. This was reported to RB.RU in the press service of the company.
The neural network translates speech into text, then restores punctuation and determines sentence boundaries. Subsequently, another system is connected to it that analyzes the spectrogram of the voice and marks fragments spoken by different people on the audio track.
The company estimates that about half of foreign language YouTube videos are videos with three or more speakers. Seeing them with two-voice voice acting is not very convenient, the company emphasizes, so Yandex added ten more new voices to its services.
In July 2021, Yandex showed a prototype of automatic video translation. The new technology, which has no analogues in the world, combines machine translation, biometrics, speech recognition and synthesis technologies.
In September of the same year, English videos on YouTube, Vimeo, Facebook, Twitter and TikTok became available in Russian voice acting – Yandex began to offer its automatic translation. Two months later, the company added the translation of more videos in French, Spanish and German.
Author:
karina pardaeva
Source: RB
I am Bret Jackson, a professional journalist and author for Gadget Onus, where I specialize in writing about the gaming industry. With over 6 years of experience in my field, I have built up an extensive portfolio that ranges from reviews to interviews with top figures within the industry. My work has been featured on various news sites, providing readers with insightful analysis regarding the current state of gaming culture.
