Microsoft’s Seeing AI App Can Help The Blind ‘See’ Through Their Smartphone

Microsoft has unveiled a major update for its Seeing AI app which helps the blind and low vision community by narrating the world around them.

By using the smartphone’s camera the app is able to recognise a staggering amount of information and more importantly, actually understand the context within which it’s being used.

New features now include colour recognition for when you’re trying to get ready in the morning and don’t know what to wear.

A musical light notification plays an audible sound when the camera detects a light source. This can make a huge difference if you’re trying to swap out a lightbulb and don’t fancy burning your hands or for checking whether your battery pack is actually working.

The document reader intelligently captures any text it can see. It can then provide a full voiceover along with synchronised word highlighting. Text size can also be drastically increased as well.

One of the most powerful new features however is handwriting recognition which means that it can understand birthday cards, personal notes or shopping lists.

Last but by no means least is currency recognition in US dollars, Canadian dollars, British pounds and Euros.

Having heard from users about how the app has changed their day-to-day lives a member of the team described the experience as “more than humbling”.

One of those users is university lecturer Cameron Roles who wrote about how the app had improved his life.

“If my children hand me a note from school or if I pick up a book, I can use Seeing AI to quickly capture that text and just give me a very brief instant overview of what’s on the document,” said Roles

“Technology can be such an enabler of good and such an enabler for people to shrink the world, for the world to come closer together, and for people to be able to achieve so much more than they ever could without it,”

The app is available to download for free on the App Store for iPhone, iPod and iPad.