Seeing AI App for Low-Vision and Blind Users Now Available on Android

Microsoft’s Seeing AI app is now accessible to Android users for the first time, as of today. You can download it from the Google Play Store. The objective of this no-cost app is to aid visually impaired individuals in better understanding their surroundings through the use of their smartphone’s cameras and AI-driven narration. Microsoft claims that the Android version of the app utilizes the company’s most recent progress in generative AI and boasts the same features as the iOS version. With over 3 billion Android users worldwide, this app has the potential to significantly enhance the quality of life for many people.

The latest features of Seeing AI were developed based on user feedback. Microsoft states that the app now presents more detailed descriptions of images. Initially, Seeing AI will provide a brief summary of a photo’s content. Upon tapping the “more info” icon, the app will then generate a more comprehensive description of the image. Users can also move their finger over the screen to hear about the positioning of various objects. The app is also capable of importing photos from other applications.

Another new feature, implemented by Microsoft based on user input, is the ability to ask questions about a document. After scanning a document, users can inquire about menu items or the cost of an item on a bill. It is also possible to ask the app to summarize a scanned article. Seeing AI provides audio instructions on how to scan a printed page.

The app offers numerous tools for users to explore their surroundings by using their camera to capture or photograph items. For example, it will instantly read out a short piece of text when detected by the camera. Seeing AI can scan barcodes and provide product details, such as the name and packaging information, which could be particularly beneficial for medication management.

Furthermore, the app is capable of identifying individuals (as well as their facial expressions), currency, colors, and brightness. It can also read handwritten text in certain languages.

International Day of People with Disabilities marks the debut of Seeing AI on Android. The app is now available in 18 languages: Czech, Danish, Dutch, English, Finnish, French, German, Greek, Hungarian, Italian, Japanese, Korean, Norwegian Bokmal, Polish, Portuguese, Russian, Spanish, Swedish, and Turkish. Microsoft aims to extend that number to 36 languages by 2024.