Elon Musk reportedthat his company xAI has begun training AI on the most powerful hardware in the world.
It uses 100,000 NVIDIA H100 liquid-cooled GPUs, currently the most durable in the world. And no one has used them in such quantities. According to Musk, xAI has managed to create “the world’s most famous cluster for training AI.”
Each H100 GPU costs around $30,000. xAI leases these chips to Nvidia.
All of this hardware is being used to train the Grok 3 generative AI, which is due out in December of this year. Before that, in August 2024, xAI will release Grok 2, a simplified model trained on 20,000 Nvidia H100 chips. [WccfTech]
Source: Iphones RU
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.
