•Haptics skin imaging for assistive technology
Despite the advancement of measuring skin surface properties, there was a need for palpation by hands to be able to better diagnose skin diseases and to learn about the tactile properties of in vivo skin surface. However, directly touching in vivo skin surface can cause secondary infections or damages. Therefore, a technology providing infection- and damage-free skin palpations and precise haptic skin roughness rendering is needed. A multidimensional (2D and 3D) rendering system have been developed for multimodal (visual and haptic) rendering that can run with any given in vivo 2D skin images. This project primarily focus on developing technologies for accurately reconstructing skin surface roughness from a single skin image, estimating/modeling the stiffness of internal skin layers, and providing realistic haptic palpation using complete haptic (kinesthetic + tactile) feedback with a pen style haptic device or a hapitc glove. We are working to integrate VR/MR into the haptic imaging system.
Skin tumor surgery simulation using haptic and VR devices
Hand-eye skills are critical in the skin tumor surgery procedure that includes identifying the tumor area, cutting, and undermining. However, those skills are not easy to obtain due to limited clinical practice or non-realistic surgery simulation. Thus this project is aimed at developing a visuo-haptic skin biopsy simulation system using XR and haptic devices in collaboration with a dermatologist, Dr. Carroll at Case Western Reserve University.
IV (Intravenous) needle insertion simulation using VR/MR glasses and haptic devices (stylus and glove)
This project is to develop an immersive system that can simulate the insertion of a needle as performed during intravenous therapy using VR/MR glasses and haptic devices (a pen stylus and a haptic glove). This system allows users to practice and test their ability to properly insert the needle into a virtual patient’s arm or hand. We have successfully developed the first prototype bimanual hand modality. This system gives an approximate feel of inserting a needle into the skin surface. This project is being conducted in collaboration with faculty members in the College of Nursing, Biological Sciences, and Psychology at Kent State. This project was funded by NSF (2021-2024).
Edema palpation simulation using MR glasses and a haptic device
This project is aimed to develop an immersive system that can simulate edema palpation using a haptic device combined with MR glasses. This system allows users to both practice and test their edema palpation skills on a virtual patient’s arm. This system gives an approximate feel of skin surface, different levels of edema symptoms, and palpation with a haptic device. This project has been conducted in collaboration with a faculty member, Dr. Lisa Onekso in the KSU College of Nursing.
Simulating Bimanual Surgical Removal of Ingrown Toenail in Virtual Reality with Haptic Feedback (Podiatric surgery simulation)
This project is oriented towards developing a VR training simulation to improve podiatric surgery skills using two haptic stylus devices and a VR device (Oculus Rift-S). With the use of two pen stylus haptic devices, the user practices steps of ingrown toenail removal surgery including but not limited to: anesthesia needle insertion, the elevation of toenail from the nail bed, cutting the excess nail, grasping/twisting excess nail, and nail bed destruction. We currently have developed a foundational program and are working towards improving the quality of haptic feedback to increase immersion and realism. This project is in collaboration with faculty members from the Podiatric School of Medicine at Kent State University.