Research Projects: HRI, Robotics, Sensing, and Human-Centered Care

Humanoid Robot Deployments for Cognitive Stimulation & Daily Activities

This project has been  funded by the Department of Human Services. Pioneering deployment of 16 humanoid robots in 8 nursing homes across Minnesota to augment care, address worker shortages, and administer a variety of therapies. This HRI research explores reciprocity and natural human behaviors in social robot interaction, and assesses the perspective of family and staff about using robots in caregiving settings.

Robot-Delivered Mindfulness therapy (RoboZen)

 Utilizing humanoid robots to administer Mindfulness Based Stress Relief Therapy (RoboZen) to improve mood and cognition, and performing cognitive assessments to help address healthcare worker shortages. This HRI work includes analyzing Human Physiological Response to Robotic Voice Modulation and studying robot acceptance.

Music & Memory Biomarker Studies

Lab studies using wearable EEG, EDA, and HRV sensors to measure emotional and cognitive responses to music, with the objective of identifying an EEG biomarker for memory recall. The HRI aspect compares physiological reactions when music is delivered by a musician, a robot, or a boombox player.

EEG Biomarker for memory recall using music

Gait Analysis & Contactless Fall Detection

Research applying machine learning to sensor-based systems to recognize gait disturbances indicative of Vascular Dementia onset, alongside developing methods for contactless fall detection. This project focuses primarily on sensor technology, though findings inform the role of HRI in monitoring/prompting systems.

Robotics and Dementia (Learning Daily Living Patterns)

Developing an autonomous robot that uses machine learning to learn the daily living patterns of individuals with Mild Cognitive Impairment (MCI) and provides prompts and reminders for activities of daily living as dementia progresses. This project heavily relies on HRI protocols for effective companionship and assistance.

Dementia Friendly Living Space

This project has been  recently funded by the Bold Ideas Grant(OACA). Click on the link above to learn more! A feasibility study integrating assistive humanoid robots, wearable sensors (EEG, EDA, HR/HRV), and spatial tracking to enhance living environments for individuals with dementia. The HRI component involves studying the deployment and integration of these therapeutic robots within a seamless, sensor-equipped space.

Prompting Mechanisms Evaluation

A detailed HRI user study evaluating the effectiveness, compliance, and level of stress/annoyance caused by various prompting devices (the mobile autonomous robot Pepper, the miniature robot Cozmo, tablet, Apple Watch). Stress levels during prompting are measured using the Empatica wearable sensor. Related HRI publications examine the "Reactions and Engagement of Individuals with Dementia Toward Humanoid Assistive Robots: A Study Using the Pepper Robot".

MyHeifer (ASD Intervention)

An Autism Spectrum Disorder (ASD) intervention application designed to help children express emotions and map behavioral patterns to inform caregivers and facilitate personalized care decisions. Related HRI experimental protocol development analyzed the arousal, attention, and language of children during Child-Robot Interaction using wearable sensors.

Assistive Therapeutic Robot for BPSD

Utilizing a humanoid robot to administer reminiscence therapy to address Behavioral and Psychological Symptoms of Dementia (BPSD). This involves HRI protocols designed to effectively deliver therapeutic intervention via robotics.

Bipolar Depression Druid: Monitor, Track and Predict Bipolar episodes 

Integrating Electromagnetic Field (EMF) sensor such as Heart Rate Variability, Quantity and Quality of sleep and electrodermal activity data as predictors to discern between the two bipolar states 

Grad Student - Yumna Anwar

Grad Student - Rushmeet Bahra

•Khan, A., & Bahra, R. Bipolar Depression Druid: Wireless Technology Framework to Predict Bipolar Depression. International Conference on Health Informatics and Medical Systems. (International Conference on Health Informatics and Medical Systems, Las Vegas, 2016) 

•Khan, A. Anwar, Y, (2018). Framework to Predict Bipolar Episodes: Sensor fusion of electrodermal activity, heart rate variability and sleep patterns; Intellisys IEEE, London, September 2018

Happy Times: Aiding Recall of Deeply Embedded Memory 

Grad Student - Danish Imtiaz

Publication: Imtiaz, D., Khan, A., & Seelye, A. (2018). A Mobile Multimedia Reminiscence Therapy Application to Reduce Behavioral and Psychological Symptoms in Persons with Alzheimer’s. Journal of Healthcare Engineering, 2018.

Framework to Predict, Identify, and Track Wandering behavior in Individuals with Alzheimer's Dementia using Various Physiological and Other Sensors, and Kinect 

Grad Student – Arshia Hassan

Grad student - Mahsa Soufineyestani

Publications:

Khan, A. Hassan, A., Seelye, A. (2018). Framework to Predict, Identify, and Track Wandering behavior in Individuals with Alzheimer's Dementia using Various Physiological and Other Sensors, and Kinects. Intellisys IEEE, London, September 2018

Hassan, A, Khan, A. (2018)Wandering Behavior Management Systems for Individuals with Dementia. IEEE Access Journal under review

Recovery Buddy” to assist patients following Open Heart Surgery 

Robotic Assistive Technology for OHS Recovery - Exploring the use of the Baxter humanoid robot and impedance control to develop assistive technology that helps patients safely transition out of bed after open heart surgery.

Prevention of Decubitus Pressure Ulcers:  Preventive Weight Shifting Guide, Monitor, and  Tracker App for Wheelchair Users with Spinal Cord Injuries 

Undergrad Student Nam Phung

Grad Student Dale Dowling

Publications:

Khan, A., reuter, M., & Phung, N. Wireless Solution to Prevent Decubitus Ulcers: Preventive Weight Shifting Guide, Monitor, and Tracker App for Wheel Chair Users with Spinal Cord Injuries (Phase II). IEEE Healthcom. (IEEE Healthcom, Munich Germany, Sept 2016)

Khan, A., & Phung, N. Undergraduate Research in Assistive Technology: Design and development of a Preventive Weight Shifting App to Reduce the Risk of Pressure Ulcers in Wheelchair Bound Patients with Spinal Cord Injuries. ASME Journal of Medical Devices, 10(20):020927, May 2016;. doi: DOI 10.1115/1.4033277

Informing Care Decisions and Aiding Children with Autism in Understanding Emotions 

Undergrad Student - Kun Li

Publication:

Khan, A. Li, K., Madden, J. (2017). MyHeifer: Mobile Autism Spectrum Disorder(ASD) Application: Informing Care Decisions and Aiding Children with ASD in Understanding Emotions. Proceedings of the Healthcare 2017, ZhengZhou, China June 2017 

Systematic Reviews & Equity in Technology for Dementia Care

Scholarly work emphasizing the vital role of culturally sensitive technology in fostering equity in dementia care, combined with systematic reviews on cognitive stimulation, emotion therapy, and surveys on EEG data analysis software. Related HRI reviews address Humanoid Robot Acceptance and Perceptions of Humanoid Robots in Caregiving.

Robotic technologies for in-home monitoring and assistance for older adults with Alzheimers 

My research in the news