Microsoft Launches iPhone App for Low Vision Community: Seeing AI

  • Microsoft Launches iPhone App for Low Vision Community: Seeing AI

Microsoft Launches iPhone App for Low Vision Community: Seeing AI

The Redmond company revealed the effort past year at its Build developer show, demonstrating how a more developed version might help Saqib Shaikh, a Microsoft engineer on the team who lost his sight at age 7.

The app, which is free and available on iOS-only, relies on holding up one's smartphone camera to hear information about the world.

To use the app, the user must point their phone's camera, select a channel and hear a description of their surroundings.

If you get a document but can't read the print, using Seeing AI provides audio guidance for capturing the document and then spoken words reading the text to the app user.

The Seeing AI app is very simple to use.

The app not only recognizes a person based on his or her face, but can also relay mood based on facial expressions, estimate a person's proximity to the user, and describe physical characteristics. It can also guess things like age and emotion.

For example, Microsoft brought its SQL Server database software to Linux, and it has ported Office apps to the iPad. It also reads and scan documents, and recognizes USA currency.

Another great thing about the Seeing AI app is that most of its basic functions are made on the device itself.

Images in other apps - Just tap "Share" and "Recognize with Seeing AI" to describe images from Mail, Photos, Twitter, and more. The first experimental feature is scene descriptions. Under the leadership of Eric Horvitz, the new Microsoft Research AI program is created to bring together around 100 people who specialize in different technologies categorized under AI, instead of having them spread out in Microsoft AI and Research, which includes around 6,000 people, a Microsoft spokesman said. The company didn't say whether a version would be released for Android phones.