Elon Musk said that the world does not have enough data for artificial intelligence

CEO of Tesla/X, Elon Muskseems to believe that training AI models on data created solely by humans is becoming impossible. Musk says there is a growing shortage of real-world data to train AI models, including his chatbot. Grok AI.

“We have virtually exhausted the total sum of human knowledge… in the area of ​​AI training,” Musk said during a live interview conducted by Stagwell President Mark Penn. “Basically, this happened last year.”

Musk’s comments mirror those of former OpenAI researcher Ilya Sutskever, who predicted last December that the artificial intelligence industry had reached “peak levels.” Musk’s solution to this problem – synthetic data – also reflects the situation in the industry as a whole. Google, OpenAI, Anthropic and Meta already use synthetic data to train their models.

“The only way to complete [los datos del mundo real] It is with synthetic data that AI creates [datos de entrenamiento]”Musk said. “With synthetic data… [La IA] she will evaluate herself and go through a self-learning process.”

While using synthetic data can offer businesses significant cost savings, some research suggests that overusing synthetic data can lead to model failure, where AI responses become less creative and more biased over time as they are trained repeatedly with recursively generated data. data.

The lack of human data didn’t stop X from turning its Grok AI feature into its own iOS app on Thursday. The chatbot and image generator, which features a complete lack of intellectual property and security barriers, was previously only available to people who paid $8 a month for a premium X account. However, the new app can be downloaded by anyone. This.