“We have already used all of humanity’s knowledge to train artificial intelligence. This actually happened last year,” Musk noted in a recent post on the X.com platform.
The XAI president also emphasized that the future of technology is linked to synthetic data (artificially generated information generated by the AI models themselves).
This view coincides with the predictions of OpenAI’s former head of research, Ilya Sutskever, who announced at the NeurIPS conference in December that “peak data” had been reached.
Sutzkever also predicted that the lack of data would force the industry to change the way it develops models.
Leading companies such as Microsoft, OpenAI and Anthropic are already actively using synthetic data.
For example, Microsoft Phi-4 and Google Gemma models were trained using them. However, despite the economic advantages (for example, Writer created the Palmyra
Source: Ferra

I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.