Perception at Magic Leap

Sunday June 16, 2019, Room 201B

Organized in conjunction with CVPR 2019 in Long Beach CA


This tutorial presents the importance of Computer Vision and Deep learning techniques in making Magic Leap an effective spatial computing platform. The four fundamental modalities are introduced: head pose tracking, world reconstruction, eye tracking and hand tracking; emphasizing on the two main general themes: Understanding the world (spatial localization, environment mapping) and Understanding user’s intent (eye, gaze and hands). The tutorial will provide a deep dive into the main modalities along with key challenges and open problems.