Connect with us :

A blind Microsoft developer has created an app to help him ‘see’ the world

new batch
View
Like
Share
By JOHN CALLAHAM |30 Mar 2016

Near the end of Microsoft’s Build 2016 keynote, Microsoft promoted how its APIs have inspired one of its software engineers, Saqib Shaikh, to create an app that could help blind people navigate in the world.

Shaikh himself has been blind since he was seven years old. He has worked at Microsoft for the past 10 years in London. He made an app called Seeing AI as a research project, using intelligence APIs from Microsoft Cognitive Services. The app works on both smartphones as well as the Pivothead SMART glasses. The app can “see” objects and people and then translate what it sees to Shaikh via an audio message.

For example, in a meeting the app sees other people and can tell Shaikh their gender, age and even their emotional state, such as if they appear happy or sad or surprised. The smartphone version can also take a picture of a paper with text, like a menu, and then offer an audio version of that menu. Since this is a research project, there’s no indication when, or even if, it will be released as a real commercial app.

Source

Related Articles

Empowering minds: a round table on Generative AI and Education in Asia-Pacific

Empowering minds: a round table on Generative AI and Education in Asia-Pacific

IntroductionThe emergence of generative AI—a groundbreaking technology capable of producing sophisticated content from text and images to simulations and audiovisuals—has…
Teachers and technology: advocacy brief

Teachers and technology: advocacy brief

The Global Education Monitoring Report and Education International have developed an advocacy brief for teachers based on the 2023 GEM…
4 ways to increase the impact of digital tools for parents

4 ways to increase the impact of digital tools for parents

Parents and caregivers around the world seek guidance on how to foster the optimal development of young children. Increasingly, they…