Now loading...
Google has introduced Guided Vision, a new feature within its Gemini Live platform, aimed at providing real-time visual assistance for individuals who are blind or have low vision. This enhancement is now available on compatible Android devices, facilitating a voice-first approach to visual interpretation.
Emphasizing the importance of inclusivity, Google stated that Guided Vision is designed to function as a conversational partner, supporting users in understanding their environment. Developed in collaboration with the accessibility community, the feature was previewed earlier this month, showcasing Google’s commitment to improving digital and physical accessibility.
To create Guided Vision, Google collaborated with Aira, a service that connects users with trained agents who provide visual information. This partnership involved thousands of hours of data interpretation and input from more than 1,000 members of Aira’s Trusted Tester network, who helped refine the tool through their daily experiences. Aira experts worked alongside Google’s teams to establish important safety protocols.
Users participating in a Gemini Live session can share their camera feed to receive detailed descriptions of their surroundings, pose follow-up questions, and receive auditory cues to focus on specific areas of interest.
With Guided Vision activated, users can seek assistance with a variety of tasks, including reading small print, finding objects, and exploring new environments. The tool offers verbal prompts to help users adjust their camera for clearer visuals, guiding them to achieve the necessary context to answer their queries effectively.
This innovative technology benefits not only the visually impaired but also older adults and those with varying literacy levels, making it easier for them to navigate everyday tasks, such as reading labels or identifying colors.
Integration into daily routines is simpler, as users can enable Guided Vision through the Gemini app or accessibility settings on their Android devices. It also works in conjunction with Google TalkBack, allowing users to access the feature through familiar commands.
While Guided Vision offers valuable assistive capabilities, Google cautions that it operates as a support tool and is not a substitute for conventional mobility aids or safe navigation practices.
