Android will add gemini nano ai powered talkback descriptions – Breaking News & Latest Updates 2026
Skip to main content
The homepageThe VergeThe Verge logo.
The homepageThe VergeThe Verge logo.

Google I/O 2024: all the news from the developer conference

See all Stories

Posted
R
Richard Lawler
Android will use Gemini Nano AI for TalkBack image descriptions.

At Google I/O 2024 today, Google announced a multimodal version of Gemini Nano, allowing the on-device processing-powered AI model to recognize images, sounds, and spoken language in addition to text.

Those multimodal capabilities are also coming to the Android accessibility feature TalkBack, using AI to fill in missing information about unlabeled images, without requiring a connection to the internet.

Animation showing Google Talkback powered by Gemini Nano AI recognizing an image and describing it for a user as “A close-up of a black and white gingham dress. The dress is shor with a collard and long sleeves. It is tied as the waist with a big bow.”
Google notes that “Description of images may vary.”
Image: Google
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
Comments
Loading comments
Getting the conversation ready...

Most Popular

Most Popular
  1. Microsoft brings Xbox back, scraps Microsoft Gaming
  2. You’re about to feel the AI money squeeze
  3. Microsoft launches ‘vibe working’ in Word, Excel, and PowerPoint
  4. Microsoft offers voluntary retirement to long-serving employees
  5. THE PEOPLE DO NOT YEARN FOR AUTOMATION
    Video

More in Google

Top Stories