The prototype Cosmos XR faceplate sported two very high-resolution cameras that provided a wide field-of-view of the real world while wearing an HMD.
Principal UI Designer: HTC Creative Labs with hardware engineering (Taiwan)
ROLE: Lead competitive testing, UX Design, strategy, internal evangelism, customer research
TEAM: 1 prototyper, 1 UI designer (me)
TOOLS: Unity, proprietary timing and calibration systems
IMPACT: Prototype devices shipped to partner developers; product paused due to performance issues that didn't meet my quality bar
Typical competitive testing I implemented between different technologies for hand-tracking
I tested, compared, and quantified various how various technologies (software and hardware) for:
hand-tracking
occlusion mapping
registration
SLAM
lag/latency
memory footprint
CPU load
To do this, I jury rigged an external timing mechanism to measure latency by using a webcam that could simultaneously directly record a blinking LED and that same LED as seen through the lenses of the HMD.
Open-source Project Northstar reference platform used for testing field-of-view and tracking
Vive Pro with LEAP Motion sensor, Zed Mini, and Webcam used for testing pass-through AR proof-of-concepts
HoloLens 2 (Trimble XR-10 version) used for competitive analysis and testing of enterprise collaboration
Varjo XR-1 with webcam for latency testing