Paths to Literacy

for students who are blind or visually impaired

Seeing AI: Free App Narrating World Around You

Collage of Seeing AI iOS app

Seeing AI is a free iOS app from Microsoft that is designed to provide audio descriptions of the world to people with visual impairments.  Users point their phone's camera and turn the visual world into an audible experience with descriptions of people, text, and objects, using the power of Artificial Intelligence (AI).

Using VoiceOver, the app enables users to recognize: 
  • Short Text - Speaks text as soon as it appears in front of the camera. 
  • Documents - Provides audio guidance to capture a printed page, and recognizes the text, along with its original formatting. 
  • Products - Scans barcodes, using audio beeps to guide you; hear the name, and package information when available. (works with iPhone 6 and later)
  • People - Saves people’s faces so you can recognize them, and get an estimate of their age, gender, and emotions. 
  • Scenes (early preview) - Hear an overall description of the scene captured. 
  • Images in other apps - Just tap “Share” and “Recognize with Seeing AI” to describe images from Mail, Photos, Twitter, and more. 

 

Watch this introductory overview of Seeing AI:

 

Other video tutorials include:

  • Short Text Demo:  Learn how to instantly hear short snippets of text
  • Document Demo:  A guide on how to make the most of the Document channel
  • Product Recognition Demo:  Listen to audio cues to locate barcodes and identify products
  • Person Demo:  Learn how to use Seeing AI to engage with people around you
  • Scene Demo:  Learn more about this experimental channel that describes what’s in front of you
  • Currency Demo:  A guide for using the app to read currency bills (coming soon)
  • Recognize Images In Other Apps:  Describe images in your photo gallery and other apps including Mail, Twitter, WhatsApp and more

 

Download from iTunes.

 

Learn more from Microsoft.

 

We would love to hear from you if you try this app!  Let us know your impressions either in the comment section below or by emailing us at: Pathsto.Literacy@perkins.org

Seeing AI app collage

Comments

How to switch channels with voiceover on

Posted by Paul Yang

We just tried the amezing app today. Every channel works so great. Thank you so much for developing this app for blind people. The only thing we experience difficult so far is to switch channels when the voiceover is on. Should we use any finger combination to do the switch or need to turn off voiceover to switch?
Best Regards,
Paul

Add new comment