Custom designed arm band integrating IMU and EMG sensors with a compact edge computing device that can run a real-time gesture recognition LSTM model. Integrated with a custom audio feedback interface (hardware and software) to relay messages obtained from gesture recognition algorithms in real time. This system facilitates communication using gestures by outputting audio feedback to help individuals with communication disorders or speech impairment

Existing wearable health monitoring systems (Apple watch, Fitbit, etc.) provide real-time sensing capabilities of various physiologic parameters – Good for offline analysis but lacking real-time data analysis and implementation of ML models. Custom-built hardware and software to assess key physiologic and ambient parameters with real-time data process/analysis and classify different states using offline trained and on-board real-time ML model

• Devasundaram, S., Raymond, A., Virgen, M., Shapiro, D. and Park, J-H. Design of a Reconfigurable Multimodal Wearable Sensor Network (RMWSN) for Human Health and Ambience Monitoring. In Proceedings of the 11th International Conference on Sensor Networks, ISBN 978-989-758-551-7, ISSN 2184-4380, pages 26-33. 2022 DOI: 10.5220/0010838100003118

A wearable system that can identify a target object in an enclosed space and allow the user to approach and find the object with their hand; Utilize object recognition algorithms and depth/orientation data from RealSense D435i to calculate a relative location of the object with respect to the user. Use motion data from IMUs connected to the user’s body to track their approach to the object, guiding them using vibrations on a vibrotactile belt and armband, as well as verbal cues for higher-level information

• Bayat N, Kim J-H, Choudhury R, Kadhim IF, Al-Mashhadani Z, Aldritz Dela Virgen M, Latorre R, De La Paz R, Park J-H. Vision Transformer Customized for Environment Detection and Collision Prediction to Assist the Visually Impaired. Journal of Imaging. 2023; 9(8):161. https://doi.org/10.3390/jimaging9080161