Design a hands-free approach to control the camera view for an improved telepresence experience with a system that comprises an RGB-D camera mounted on a robotic arm and a virtual reality head mount display with the head motion tracking system and controllers. This system maps the human head and upper-body motion to the robotic arm for the teleoperation task of features searching on a given object. An augmented control mode is introduced where the camera follows the remote center of motion with respect to the target location to expand the reachable visual field.
Related Publication
Shang Gao*, Zhaoyuan Ma*, Ryosuke Tsumura, Jakub Kaminski, Loris Fichera, and Haichong K. Zhang "Augmented immersive telemedicine through camera view manipulation controlled by head motions", Proc. SPIE 11598, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling, 1159815 (15 February 2021) [Link]