MindCast

MindCast is an application created for Microsoft HoloLens1 which allows the users to look at a person and pull or predict their information. 

This prototype was inspired by Dr. John Manning's (Clinical Informatics Fellow, College of Medicine, UIC) vision to have a better way to retrieve patients' vitals/lab reports while doing rounds in the hospital.  A doctor is usually interested in 4 specific parameters which are - HBC (Hemoglobin C), WBC (White Blood Cell), HCT (Hematocrit), and Platelets.  However, they currently use an elaborate spreadsheet with a lot of other related information. MindCast presents information in a convenient way to the doctors. To retrieve a patient's information, a doctor would have to wear a HoloLens, open the MindCast application, and air tap while looking at the patient. In doing this, the HoloLens captures the patient's image, sends the information to Microsoft Face/Emotion API, and predicts information such as Age, Gender, Glasses, Emotion, and a customized message. It further queries an online database for information such as the patient's name and lab information and returns the most recent information. The figure on the right shows a user wearing HoloLens looking at a student and air-tapping to retrieve their data(simulated in this case). The user's view is then projected live on the display using the HoloLens application for Desktop.

This application can also be helpful in other fields where there is a need to retrieve a person's consented information at gatherings such as conferences, or meetups or to retrieve information about an exhibit in an exhibition, or in a museum setting.