People

Hyungil Kim is the director of the Human-Centered Engineering lab (SELW4031) and an Assistant Professor of Industrial Engineering in the College of Engineering at the University of Illinois Chicago. With 10+ years of industry experience in human factors engineering, Dr. Kim has served as PI or Co-PI of 10+ research projects and published 30+ papers in top-tier journals and conferences such as Human Factors, IEEE Virtual Reality, IEEE International Symposium on Mixed and Augmented Reality, Frontiers in Robotics and AI, ACM Intelligent User Interfaces, and ACM Automotive User Interfaces.

Research

• Topics: Human-Computer Interaction, Extended Reality, Human-Machine Teaming, Human Factors Engineering

• Methodologies: Rapid prototyping and evaluation of human-machine interfaces, Human-subject experiments, Human behavioral & physiological data analytics, Contextual Inquiry, Cognitive task analysis, Work domain analysis, Survey, Machine learning, Ecological interface design

• Tools: Mixed reality displays (In-vehicle head-up displays, MS HoloLens, MagicLeap One, HTC VIVE, Varjo XR-3), User interface prototype (Unity 3D, Unreal Engine, C#, C++, X3D), Driving simulators (CARLA, NADS miniSim, OpenDS), Human physiological and behavioral data collection (Tobii eye-tracking glasses, Motion Analysis marker-based motion capture system), Data analysis (R, MATLAB)

Teaching

• IE 569 Virtual and Augmented Reality for Industrial Applications

• IE 441 Ergonomics and Human Factors

• IE 342 Probability and Statistics for Engineers

• ISE 3341 Designing for People Part I: Ergonomics and Work Design

• ISE 4441/5441 Designing for People Part II: Human Factors Engineering

• SYS 5442 Virtual and Augmented Reality 

• SYS 5443 Automotive User Experience

Education

• Ph.D. in Industrial and Systems Engineering (Human Factors & Ergonomics), Virginia Tech, 2017

• Graduate Certificate, Human-Computer Interaction, Virginia Tech, 2015

Professional History

• Assistant Professor, University of Illinois Chicago, 2024-

• Assistant Professor, Oakland University, 2020-2023

• Sr. Research Associate, Virginia Tech Transportation Institute, 2018-2020

• Research Intern, Honda Research Institute USA, 2014 & 2015

• Vehicle Safety Engineer, General Motors Korea, 2006-2012

• Research Engineer, LG Electronics Productivity Research Institute, 2001-2006

Research Grants

• PI, Honda Research Institute USA, Inc., Ride Feedback in Hybrid Mobility, 2024 

• Co-PI, Automotive Research Center, US Department of Defense, Multi-Objective Rapid Generation of Virtual Environments and Data Analysis in Multi-User Immersive Gaming Environments for Testing New Crew Interface Concepts, 2022-2023

• Co-PI, Automotive Research Center, US Department of Defense, Virtual Experimentation for Soldier Evaluation of Autonomous and Non-Autonomous Technologies Using Multi-User Immersive Gaming Environments, 2022-2023 

• PI, General Motors & Augmented Reality Center at Oakland University, Immersive Driving Experience Using a VR Head-Mounted Display, 2022-2023 

• PI, National Surface Transportation Safety Center for Excellence, Mixed Reality Human-Machine Interface for Remote Operation of Low-speed Automated Shuttle, 2020-2021 

• PI, National Surface Transportation Safety Center for Excellence, Mixed Reality Car Owner’s Manual for Automated Driving Systems, 2020-2021 

• PI, Safe-D University Transportation Center, US Department of Transportation, Guiding Driver Responses during Manual Takeovers from Automated Vehicles, 2019-2021 

• PI, Safe-D University Transportation Center, US Department of Transportation, Real-world Use of Automated Driving Systems and their Safety Consequences: A Naturalistic Driving Study Data Analysis, 2019-2020 

• Co-PI, Honda Research Institute USA, Inc., Using Human Gaze to Predict Visual Detection of Automotive Hazards, with PI JL. Gabbard, 2017-2018 

Awards & Honors

• Best Paper Award Honorable Mention, International Symposium on Mixed and Augmented Reality 2018, IEEE

• Best Paper Award Honorable Mention, International Conference on Automotive User Interfaces and Interactive Vehicular Applications 2017, ACM

• 3rd Place, Paul E. Torgersen Graduate Student Research Excellence Award, 2017, Virginia Tech

• Dieter W. Jahns Student Practitioner Award, 2016, Foundation for Professional Ergonomics

• The White Graduate Teaching Assistantship, 2016, Virginia Tech

• Best Engineer, 2010, GM Korea Vehicle Engineering Center

Professional Services

• Officer, eXtended Reality Technical Group (XRTG), Human Factors and Ergonomics Society (HFES), 2023-Present 

• Workshop Organizer: eXtended Reality for Industrial and Occupational Supports (XRIOS) with the IEEE VR, 2022-Present

• Conference Committee: Associate Chair for the Full Paper Track, ACM Auto UI 2023

• Conference Organizer: Workshop Chair, ACM Auto UI 2022

• Conference Committee: International Program Committee for the Journal Paper Track, IEEE ISMAR 2022

• Conference Organizer: Demo Chair, IEEE ISMAR 2021

• Award Committee: Alphonse Chapanis Best Student Paper Award, Human Factors and Ergonomics Society (HFES)

• Steering Committee: Korean-Human Factors and Ergonomics Society (K-HFES)

• Reviewer: IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

• Reviewer: IEEE Conference on Virtual Reality (VR)

• Reviewer: ACM Conference on Human Factors in Computing Systems (CHI)

• Reviewer: Human Factors and Ergonomics Society Annual Meeting (HFES)

• Reviewer: ACM International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Auto UI)

• Reviewer: IEEE Intelligent Vehicles Symposium (IV)

• Reviewer: International Journal of Human-Computer Interaction (IJHCI)

• Reviewer: IEEE Transactions on Visualization and Computer Graphics (TVCG)

• Reviewer: Computers & Graphics

• Reviewer: Human Factors

• Reviewer: Ergonomics

• Reviewer: Applied Ergonomics

• Reviewer: Journal of Cognitive Engineering and Decision Making (JCEDM)

• Reviewer: IEEE Transactions on Vehicular Technology (TVT)

• Reviewer: IEEE Transactions on Intelligent Vehicles (TIV)

• Reviewer: Transportation Research Record (TRR)

Memberships

• Human Factors and Ergonomics Society (HFES)

• Association for Computing Machinery (ACM)

• Institute of Electrical and Electronics Engineers (IEEE)

• Society of Automotive Engineers (SAE)

For more information...

• Google Scholar

• ORCID

• Linkedin

Research

• Virtual, Augmented, and Mixed Reality

• Human-Computer Interaction

• Human-Centered Artificial Intelligence, Machine Learning

Education

• PhD student in Industrial Engineering, University of Illinois Chicago, 2024-

• MS student in Computer Science, Oakland University, 2022-2023

• BS in Computer Information Systems, Al-Balqa Applied University, Jordan, 2019

Employment

• Graduate Research Assistant, University of Illinois Chicago, 2024-

• Graduate Research Assistant, Oakland University, 2022-2023

• Senior Billing Analyst, Orange JO Telecommunication, 2020-2022

• Software Developer, United Data Solutions, 2018-2019

Publications

• External Human-Machine Interface for Robotaxis. In 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 257-258). IEEE.

• Augmented Reality Order Picking Aid for Foreign Workers in Warehouses. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 67, No. 1, pp. 1508-1509). 2023. 

For more information...

• Google Scholar

• Linkedin

Research

• Virtual, Augmented, and Mixed Reality

• 3D vision

• Artificial Intelligence (AI)

Education

• PhD student in Computer Science, University of Illinois Chicago, 2025-

• MS in Human-Computer Interaction, Hanyang University, South Korea, 2022

• BS in IT Media Engineering, Duksung Women's University, South Korea, 2019

Employment

• Graduate Research Assistant, University of Illinois Chicago, 2024-

• Software Researcher&Developer, Korea Institute of Industrial Technology, 2020-2024

• Undergraduate Teaching Assistant, Duksung Women's University, South Korea, 2020

• IT and Society Section Reporter, LA Chosun Daily Newspaper, 2019

• Audience Rating Data Analyst as an intern, Cheil Worldwide, South Korea, 2016

Publications

• Projection Mapping Method Using Projector-LiDAR (light detection and ranging) Calibration, 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Shanghai, China, 2023, pp. 857-858, doi: 10.1109/VRW58643.2023.00271 

For more information...

• Google Scholar

• Linkedin

Research

• Yalda is a passionate HCI researcher with a deep interest in human factors research and user-centered design with extensive experiences in conducting both self-guided and directed research.

Education

• PhD student in Industrial Engineering, University of Illinois Chicago, 2020-

• UX Certification (UX Research, Interaction Design) from Nielsen Norman Group,  2023

• B.Sc. in Industrial Engineering, Shomal University, Iran, 2019

Employment

• UX Research Intern at Nielsen Norman Group, Summer 2023

• UX Research Intern at NortonLifeLock, Summer 2022

Awards & Honors

• Honorable Mention of HFES's Virtual Environments Technical Group, 2022

• Winner of the HFES’s Council of Technical Groups Student Presenter Award, 2021

• Winner of the HFES’s Council of Technical Groups Travel Award for First Year Graduate Students, 2020

Publications

• Effects of Self-Learning and Exploration for XR-based Interactions, HFES 68th International Annual Meeting (online first), 2024

• Embedding Spatial Augmented Reality in Culinary Training: A Comparative Evaluation of sAR Kitchen and Video Tutorials, IEEE Transactions on Learning Technologies, 2023

• Evaluating User Interactions in Wearable Extended Reality: Modeling, Online Remote Survey, and In-lab Experimental Methods, IEEE Access, 2023

• Enhancing Culinary Training with Spatial Augmented Reality: A User Study Comparing sAR Kitchen and Video Tutorials, XRIOS Workshop @ IEEEVR, 2023

• Deep Learning-based Object Detection in Augmented Reality: A Systematic Review, Computers in Industry, 2022

• An Integrated Mixed Reality System for Safety-aware Human-Robot Collaboration Using Deep Learning and Digital Twin Generation, Robotics and Computer-Integrated Manufacturing, 2022

• Using gaze-based interaction to alleviate situational mobility impairment in extended reality, HFES 66th International Annual Meeting, 2022

• A Physiological Approach to Assess Arousal in Virtual Reality and Computer-based Remote Collaboration, HFES 66th International Annual Meeting, 2022

• A Comparative Evaluation of XR-based Remote Collaboration Platforms: A Case Study, HFES 66th International Annual Meeting, 2022

• Subjective and Objective Analyses of Collaboration and Co-Presence in a Virtual Reality Remote Environment, XRIOS Workshop @ IEEEVR, 2022

• Indirect Robot Manipulation using Eye Gazing and Head Movement for Future of Work in Mixed Reality, XRIOS Workshop @ IEEEVR, 2022

• An XR-based Approach to Safe Human-Robot Collaboration, XRIOS Workshop @ IEEEVR, 2022

• Hands-Free Human–Robot Interaction Using Multimodal Gestures and Deep Learning in Wearable Mixed Reality, IEEE Access, 2021

• A Comparative Evaluation of the Wearable Augmented Reality-based Data Presentation Interface and Traditional Methods for Data Entry Tasks, International Journal of Industrial Ergonomics, 2021

• Effects of Head-locked Augmented Reality on User's performance and perceived workload, HFES 65th International Annual Meeting, 2021

• Model-based Task Analysis and Large-scale Video-based Remote Evaluation Methods for Extended Reality Research, XR Remote Workshop @ ACM CHI, 2021

• Effectiveness of Multi-Task Learning for Deep Learning on the Prediction Performance of EEG based Cognitive State Recognition, The Institute of Industrial and Systems Engineers (IISE) Annual Conference, 2021

For more information...

• Google Scholar

• Linkedin

Research

• Virtual, Augmented, and Mixed Reality

• Human-Computer Interaction

Education

• MS in Industrial Engineering, University of Illinois Chicago, 2025-

• BS in Industrial and Systems Engineering, Virginia Tech, 2024

Employment

• Research Assistant, Virginia Tech, 2024

For more information...

• Linkedin

Research

• Human-Centered Design in Virtual, Augmented, and Mixed Reality

Education

• BS in Computer Science and Design, University of Illinois Chicago, 2023~

Employment

• Undergraduate Research Assistant, University of Illinois Chicago, 2025~

• Machine Learning and AI fellow, Clear Company, Breakthrough Tech AI at Cornell, 2024-2025

• Student Web Developer fellow, Girls Who Code, Summer 2022

Awards & Honors

• Chancellor's Undergraduate Research Award, University of Illinois Chicago, 2025~2026

For more information...

• Linkedin

Research

• Human-Computer Interaction

• Virtual, Augmented, and Mixed Reality

• Artificial Intelligence (AI) in Interactive Systems

Education

• MS in Computer Science, University of Illinois Chicago, 2024

• BS in Computer Science, Minor in Mathematics, University of Illinois Chicago, 2022

Employment

• Graduate Research Assistant, University of Illinois Chicago, 2024-

• Teaching Aid, University of Illinois Chicago, 2021=2022

• UI/UX Designer, Ruhi, 2021

• User Experience Designer, Rethink UX, 2020-2021

For more information...

• Website

• Linkedin

Research

• Data Science and Artificial Intelligence

• Virtual, Augmented, and Mixed Reality

Education

• MS candidate in Artificial Intelligence, Oakland University, 2023-

• BS in Data Science & Artificial Intelligence, Princess Sumaya University for Technology, Amman, Jordan, 2023

Research

• Human interaction with technology being analyzed to effect improvements in technology for the benefit of its users has always drawn me intuitively. Within the fields of Human Factors Engineering, my research interests are Ergonomics, Cognitive Engineering, Human-Computer Interactions using statistical analysis and mathematical optimizations 

Education

• PhD student in Systems Engineering, Oakland University, 2021-2023

• MS in Engineering Management, Oakland University, 2020

• BS in Information Science, Visvesvaraya Technological University, India, 2013 

Employment

• Research Intern, Magna Steyr, 2022 Summer

• Graduate Research Assistant, Oakland University, 2022-

• Graduate Teaching Assistant (ISE3341 Ergonomics & Work Design), Oakland University, 2021

• Application Analyst, Meridium by GE Digital, India, 2016 - 2017

• Software Developer & Support Analyst, Virtusa Consulting Services, India, 2013 – 2016

Publications

• Augmented Reality User Manual for Assembly Tasks, In Virtual Reality (pp. 284-290). IEEE. SV Murthy, A Simoski, S Rawashdeh, H Kim (2024). 

• Augmented Reality Order Picking Aid for Foreign Workers in Warehouses. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 67, No. 1, pp. 1508-1509). Albawaneh, A., Venkatesha Murthy, S., Singla, G., Wu, J., & Kim, H. (2023).