Home Apps Microsoft’s ‘Seeing AI’ app lets your iPhone narrate what it sees

Microsoft is releasing a new app — in the US only for now — that “sees” for you and narrates the world around you.

Seeing AI. It's a new app from Microsoft designed for the "low vision community", and is a research project app that “harnesses the power of AI to describe people, text and objects”.

Sadly, it is only avaialble in the US at the moment to iPhone users, but hopefully will become more widely available.

If you saw the movie ‘Her’, which featured the voice of Scarlett Johansson as the artificial intelligence in the protagonist’s computer and phone, you can imagine that AI would have used similar technology to understand what its camera saw, except at a vastly more advanced level, which is natural for a sci-fi film.

So, what kinds of things does Microsoft say Seeing AI can do?

Short Text
Speaks text as soon as it appears in front of the camera

Documents
Provides audio guidance to capture a printed page, and recognises the text, along with its original formatting

Products
Gives audio beeps to help locate barcodes and then scans them to identify products

Person
Recognises friends and describes people around you, including their emotions

Scene
An experimental feature to describe the scene around you

Currency
Identify currency bills when paying with cash. (Coming soon, US currency only for now)

Turns the visual world into an audible experience.

Now, given that the Google Search app lets you look at things and can tell you, for example, what kind of plant you’re looking at, which is something that Samsung's Bixby app for Galay S8 and S8+ can do too, this tech is definitely on its way for all, and a great example of how far artificial intelligence is coming.

Thankfully a completely autonomous and fully artificially intelligent Terminator robot with the same technology to identify humans is still in the realms of science fiction – or at least, for now!

Also - if you create a free iTunes US account (there are instructions online if you search), it is actually possible to download the Seeing AI app in Australia, but then when updates are due, you'll have to flick between Apple ID logins for the iTunes store, which can be annoying - but it can be done.

Here’s the video:

LEARN NBN TRICKS AND TRAPS WITH FREE NBN SURVIVAL GUIDE

Did you know: Key business communication services may not work on the NBN?

Would your office survive without a phone, fax or email?

Avoid disruption and despair for your business.

Learn the NBN tricks and traps with your FREE 10-page NBN Business Survival Guide

The NBN Business Survival Guide answers your key questions:

· When can I get NBN?
· Will my business phones work?
· Will fax & EFTPOS be affected?
· How much will NBN cost?
· When should I start preparing?

DOWNLOAD NOW!

Alex Zaharov-Reutt

One of Australia’s best-known technology journalists and consumer tech experts, Alex has appeared in his capacity as technology expert on all of Australia’s free-to-air and pay TV networks on all the major news and current affairs programs, on commercial and public radio, and technology, lifestyle and reality TV shows. Visit Alex at Twitter here.

 

 

 

 

Connect

Join the iTWire Community and be part of the latest news, invites to exclusive events, whitepapers and educational materials and oppertunities.
Why do I want to receive this daily update?
  • The latest features from iTWire
  • Free whitepaper downloads
  • Industry opportunities