Apple announced that it is working with Nvidia to develop tools to speed up large language models (LLMs), which remain powered by generative AI.
The company’s engineers managed to speed up the processing of LLM responses on Nvidia graphics chips in version 2.7. To do this, Apple adapted its ReDrafter algorithm for Nvidia chips.
ReDrafter also supports Apple Silicon processors.
Speeding up LLM response times reduces response time to user queries and reduces latency, making chatbots more convenient to use.
Apple has open sourced ReDrafter so its developers can use models in any major language. [Apple]
Source: Iphones RU
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.
