Apple introduced Live Recognition for the iPhone and Vision Pro last year, and roughly a year later, Google has its own answer ready.
Guided Vision launched in Gemini Live today, giving Android users real-time audio descriptions of what’s around them. The feature works entirely through your phone’s camera, no extra hardware needed.
How does Google Guided Vision work?
Turning on Google Guided Vision is simple enough. Toggle it on through your profile in the Gemini app, set up an Accessibility Shortcut like a two-finger swipe or both volume keys, or use a three-finger tap if you’re using TalkBack.
Once you share your camera during a Gemini Live session, the feature narrates whatever it sees. That covers everything from reading fine print, like nutrition labels or washing machine dials, to helping you find a dropped earbud.
You may also like: Google Messages Is Getting Real-Time Location Sharing: Here’s How It Will Work
To help position the camera correctly, Gemini walks you through reframing in real time, telling you to pan right, tilt down, or step back until something fits properly in frame. Beyond general descriptions, you can also ask follow-up questions, like having it read out an expiration date once it spots one.
Google tested Guided Vision across multiple languages and regions to ensure it works broadly, including India, Brazil, Singapore, and Japan.
Who Developed the Google Guided Vision?
Google built Guided Vision in partnership with Aira, logging tens of thousands of hours of visual interpretation data and relying on more than 1,000 Aira Trusted Testers to stress-test the model. Aira specialists also helped shape its safety guardrails throughout development.
You may also like: ChatGPT Age Prediction System Now Rolling Out to Identify Teen Users
Google is explicit that this isn’t a medical device, mobility aid, or cane replacement, and warns against relying on it for navigation or obstacle detection. That guidance matters, since an incorrect description in those situations could genuinely put someone at risk.
Guided Vision is rolling out now on Android 9 and above, arriving as Google’s response to the Live Recognition feature Apple already shipped on iPhone and Vision Pro. For anyone just catching up, Google first previewed Guided Vision earlier this month alongside a batch of other Android accessibility tools.
