The new product runs directly on the user’s local devices, using the power of GeForce RTX GPUs.
ChatRTX is a significant improvement over its original Chat with RTX tech demo, which was introduced in February 2024.
For example, it improves stability and also expands the range of supported language LLM models, including the Mistral 7B INT4 and Llama 2 7B INT4 from NVIDIA, as well as new products such as Gemma from Google.
ChatRTX features integration with OpenAI’s image recognition technology CLIP, allowing AI to analyze photos and videos without additional metadata.
Additionally, voice input support has been added to the application via Whisper, which makes communication with the chatbot more natural and comfortable.
Source: Ferra
I am a professional journalist and content creator with extensive experience writing for news websites. I currently work as an author at Gadget Onus, where I specialize in covering hot news topics. My written pieces have been published on some of the biggest media outlets around the world, including The Guardian and BBC News.
