Multimodal Joystick Controller

For Supporting Edutainment and Enabling Employability of Person with Different Range of Abilities

A patented mechanical design to control and operate the joystick controller of any cyber-physical system like a remote-controlled toy car, drone, robotic arm, etc. with non-traditional modalities of interaction like eye-gaze, hand-body gesture, speech, etc.

Safe and Collaborative Robot for Healthcare

Remotely controlled Robot for safe and contactless medical check-up and monitoring of patients in a healthcare setup to ensure the safety of healthcare personnel

Collaborative Robot for Smart Factory

An intelligent collaborative robot to work alongside workers in a smart factory. The robot can be controlled with eye-gaze and hand gestures. The robot can identify and track human hand and other features in its workspace

Semi-Autonomous Ground Vehicle with VR Interface

We took a remote-controlled toy car, put a camera on its roof, plugged its four-way remote-controller into our joystick controller coupled it with our multimodal user interface and as a result, we had an eye-gaze and gesture-controlled toy car. We had a lot of fun driving the car in our lab with the four-way control UI. Later we added a fixed camera to the system and with a little bit of camera mapping we were able to give way-points to the toy car to follow.