Modern online translators are often indecisive. Standard metrics like BLEU evaluate translations based solely on word-for-word matches and do not take into account nuances of meaning and grammar. The new development combines various evaluation methods and analyzes translations at the level of words, meaning and syntactic structure.
The program automatically highlights low-scoring bids for any criteria and generates a detailed report. This approach allows not only to evaluate the overall accuracy of the translation, but also to identify specific types of errors (lexical, grammatical or semantic).
Popular online services and commercial neural networks were tested during the experiments. The study showed that many systems are good at choosing words but have difficulty conveying complex grammatical structures.
The tool was based on a Python program using the nltk and Stanza libraries. They help divide the text into sentences and words, perform grammatical analysis and determine the role of each word in the sentence.
Source: Ferra
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.
