Yandex specialists compared the quality of answers from YandexGPT 2 and GPT 3.5.
According to the company, their neural network is checked against the questions of the best competitor 63% of the time.
Comparisons of neural networks are needed not to obtain abstract numbers in a benchmark, but to solve product problems, create new functions and develop business. That is why providing part of the shopping cart for comparison was a requirement of our services.
— Alexey Gusakov, technical director of Yandex Search
The study was conducted using the Side by Side (SBS) comparison method. That is, both neural networks asked the same questions, and the AI trainers chose the best answers, not knowing which model was used.
Queries are taken from typical applications of users of Yandex services to YandexGPT 2. It is independent of real people and counters a variety of topics.
Source: Iphones RU
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.
