Vinay Krishna Sharma
Industrial Metaverse, XR (AR,MR,VR), Robotics, AI and User Interaction Design
Industrial Metaverse, XR (AR,MR,VR), Robotics, AI and User Interaction Design
Research Professional, Siemens Technology
PhD Candidate at I3D Lab, CPDM, IISc Bangalore
Robert Bosch PhD Fellow 2020-2021
Robert Bosch PhD Fellow 2021-2022
Eye-Gaze Controlled Robotic Arm for Persons with Speech and Motor Impairment
An eye-gaze controlled robotic arm designed for PicknPlace and Reachability Task. Users with severe speech and motor impairment were able to pick and place objects using the live video see-through user interface for controlling a DIY robotic arm. The users were able to move the Dobot Magician robotic arm to reach the target within significant time at par with the able-bodied users.
Find Paper at: https://dl.acm.org/doi/10.1145/3379155.3391324
Webcam based Eye-Gaze Controlled Robotic Arm for SSMIs
Webcam based Eye-gaze control of the robotic arm for a reachability task. The users had to use the four-way control on the augmented reality user interface to move the robot arm end effector to a target location from a random starting point.
Find Paper at: https://content.iospress.com/articles/technology-and-disability/tad200264
International Conference on Advance Robotics,
ICAR 2021
Gaze Controlled Safe HRI for SSMI
Ensuring the safety of human participants in a human-robot interaction system involving the interaction of persons with a different range of abilities with a table top robotic arm. The proposed system always monitors the human inside its workspace and avoids any possible collision with the human hand by using a naïve geometric modified path algorithm.
Find paper at: https://ieeexplore.ieee.org/document/9659320
ACM Transaction on Accessible Computing,
TACCESS 2022
Comparing Two Safe Distance Maintenance Algorithms for a Gaze Controlled HRI involving users with SSMI
An intelligent algorithm for ensuring safe human-robot interaction considering the uncertainty in robot movement is proposed. The work presents a comparative analysis of two collision avoidance algorithms developed for a human-robot interface meant to be used by persons with severe speech and motor impairment.
Find Paper at: https://doi.org/10.1145/3530822
Eye-gaze and finger laser pointer controlled Head-Up Display for supporting drivers in safe driving. This paper presents an intelligent interactive head-up display (HUD) on the windscreen of the driver that does not require them to take eyes off from road while undertaking secondary tasks like playing music, operating vent controls, watching navigation map and so on.
Find Paper at: https://link.springer.com/article/10.1007/s12193-019-00316-9
This work presents a new interactive visualization system to represent and compare rate of spread of COVID-19 pandemic across different countries over time.
Find Paper at: https://dl.acm.org/doi/10.1145/3411756
The system can be accessed at: http://cambum.net/Covid19/index.html
In this work, we examine the effects of using Extended Reality (XR) interface to assist drivers for taking over and in the first seconds of controlling the vehicle. We present a prototype of an Augmented Reality (AR) and Mixed Reality (MR) assistance system realized on a simulated environment. In a user study, we compare mixed reality with augmented reality display and present results on response time to take over request and found AR is significantly better than MR interfaces.
Find Paper at: https://dl.acm.org/doi/abs/10.1145/3544999.3552527
Journal of Transportation Engineering
Elsevier, 2023
A comparison study between XR interfaces for driver assistance in take over request
This work evaluates ISO 9241 pointing task in XR interfaces and analyzes the ease of interaction, physical, and mental efforts required in augmented and mixed reality interfaces.
Find Paper at: https://www.sciencedirect.com/science/article/pii/S2666691X220005742
V. K. Sharma and P. Biswas, System for Operating Joystick , Indian Patent Application no. 201941044740, PCT International Application No. PCT/IB2020/059959
Himanshu, Shubham Farate, VK Sharma, Pradipta Biswas, A Collaborative Robot for Medical Application, Indian Patent Application No.: TEMP/E-1/44737/2021-CHE
P. Biswas, S. Deshmukh, G. Prabhakar, M. Modiksha, V. K. Sharma and A. Ramakrishnan, A System for Man- Machine Interaction in Vehicles Indian Patent Application No.: 201941009219, PCT International Application No. PCT/IB2020/050253