ChatGPT gains ability to understand visually and even Santa’s voice

ChatGPT has finally received the advanced voice mode view feature announced by OpenAI in May. Allows the bot to see and analyze the surrounding environment via mobile phone camera. This and other news was announced by the startup last Thursday (12).

When the live video feature is enabled, generative AI turns the smartphone’s lens into its “eyes” as it interacts with the user. During the conversation, you can ask him questions about a specific object in the location, for example, by pointing the camera at the item in question.

As the developer explains, the technology will respond in real time with voice as if it were a conversation between people, revealing the multimodality of the model. The bot can also memorize the characteristics of people participating in the conversation and even record their names.

In this update, ChatGPT’s advanced audio mode also includes screen sharing.It eliminates the need to send photos and videos so the bot can analyze what’s on the monitor. In this way, technology can help solve math problems, suggest responses to messages, and much more.

Santa Claus Mode

Celebrating the approach of the Christmas season, OpenAI has also launched “Santa Claus Mode”, which adds the old man’s voice as an option to conversations with the bot. The new feature will be available to all computer and mobile device users of the platform by the end of December.

to use Santa’s voice on ChatGPT You need to tap the snowflake icon next to the microphone in the prompt bar. According to the initiative, conversations with the “bot noel” will be identified as temporary so as not to affect the chat history with the technology.

Say ho ho ho to Santa in Voice Mode??

Santa Claus is rolling out to everyone on all ChatGPT platforms today and will be available until the end of the month… then he’ll retreat to the North Pole. pic.twitter.com/NVS9bRok4r

— OpenAI (@OpenAI) December 12, 2024

The advanced audio mode with view and screen sharing will be available to ChatGPT Team users as well as subscribers of ChatGPT’s Plus and Pro editions in the coming days. Enterprise and Edu plans will have access to this feature in January.