This project will be supported by an NSF-founded project. The two phases for us to pursue the goal of this project are list below:

1. Extracting Street Information Using Google Map

Create an app for extracting street (e.g., sidewalk, etc.) information using Google Map/Street View. 

1. • Planning routes automatically in a chosen area in the city. 

   • Automatically navigating through the route and capturing street images of interests. 

   • Extracting street information using AI technique. 

   • Saving recognition results in a database. Building a new map by overlaying the extracted info on it. Potentially, these information can be integrated into applications such as Google Map.

(This topic may not follow the crowd-sourcing path. However, the outcome of this project can be used to compare with the results from the crowd-source method.) 

2. Smart Glass Navigation App for the Blind

Create an app for the smart glass to help BVI people navigate the NYC streets. 

2. • Streaming video captured by the smart glass to the mobile phone. 

   • Running AI app either locally on the phone or remotely in a cloud server through the phone to extract info of interests to the BVI people. 

   • Providing real-time audio feedback to the BVI users. 

   • If the info is not good enough for the users to resolve the navigation issue, the users can link to a network of volunteers who are online to support them through the streaming video. 

(As the cost of the smart glass gets lower and lower, it is possible to continue upgrading the AI app to create a powerful and affordable tool for the BVI people.)