Apple is developing generative artificial intelligence codenamed Ajax. To make it work, the company has developed a revolutionary method for running large language models (LLMs) on the iPhone, according to recently published research.
ChatGPT and its analogs process information on servers, and this is fundamentally different from Apple’s position, which involves moving all the AI and machine learning work to the device. But in the case of generative AI, difficulties arise due to the fact that it requires a lot of operations, which is not the case in iPhones.
Apple has figured out how to get around this limitation. The company proposes storing language model data in flash memory – the same place where applications and photos are stored. To quickly analyze and load data, engineers recommend using two methods:
1. Reuse already processed data.. For example, instead of loading new data from flash memory each time, the language model can reuse some of the data it has already processed.
2. Effective data grouping – will allow you to quickly receive data from flash memory, thereby increasing the speed of recognizing requests and creating responses. This method is similar to reading books in chunks rather than one word at a time.
The combination of these methods allows artificial intelligence models to run twice as fast on existing iPhones. It is also possible to reduce the load on the processor by 4-5 times and on the graphics chip by 20-25 times.
A breakthrough in processing speed allows Apple to bring generative AI to iPhones. Ajax is rumored to operate with 200 billion parameters, which provide a high level of understanding of the complexity of the language.
In addition, Ajax is considered more functional than ChatGPT 3.5 development level. However, future OpenAI language models will likely be better than Ajax.
Source: Iphones RU
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.
