Data Science Talk Series 

Title: Incorporating AI-assisted Sensing into the Metaverse: Opportunities for Interactions, eSports, and Security Enhancement

Abstract:

While Metaverse has been rapidly gaining popularity throughout the last decade, it faces several challenges, including difficulties in capturing real-time facial expressions and emotional states, limitations in providing fully immersive experiences and insightful training feedback for eSports, and concerns regarding security and privacy breaches. In this talk, I will explore opportunities for AI-assisted sensing in the Metaverse from three perspectives: interaction, eSports, and security enhancement. First, I will discuss the implementation of BioFace-3D, a continuous facial tracking system to enhance the quality of interaction in Metaverse. Second, I will introduce SmarCypad, the first smart seat pad for cycling fitness tracking, aiming to provide deeper insights into eCycling. Finally, I will dive into the potential security risks associated with sensor data leakage in Metaverse, validating it through the context of keystroke snooping. By exploring these opportunities, my goal is to facilitate a more immersive, convenient, authentic, and secure virtual experience in the Metaverse.