OpenAI has introduced the Advanced Voice Mode with Vision feature in ChatGPT, available starting Thursday. This innovative addition enables the AI-powered chatbot to capture visual insights using a phone’s camera, offering users interactive and dynamic experiences.

However, the feature is exclusively accessible to ChatGPT Plus, ChatGPT Team, and ChatGPT Pro subscribers.

Powered by the GPT-4 architecture, this new tool delivers real-time voice responses based on visual input from the device’s camera.

Initially previewed in May during the Spring Updates event, the feature is now part of a series of updates released during OpenAI’s ongoing 12-day livestream to unveil several groundbreaking capabilities.

The Advanced Voice Mode with Vision allows users to interact with their environment through the camera, asking questions about whatever is visible. Integrated with memory functionality, the vision feature enhances ChatGPT’s utility, although the specifics of memory retention remain undisclosed.

For example, users can show their bookshelf to ChatGPT and ask for book recommendations, seamlessly integrating the feature into their daily activities.

To access the new feature, users can open the ChatGPT mobile app, click on the Advanced Voice icon, and select the video option in the updated interface. ChatGPT Team subscribers will have access by next week via the latest app version.

The feature will be available to European Union, Switzerland, Norway, and Liechtenstein users later than other Plus and Pro subscribers, with Enterprise and Edu users receiving access in early 2025.

[embedpost slug=”/whatsapp-rolls-out-upgrades-for-calls-and-on-device-translation/”]