Projects

Multitouch Haptic Touchscreens Project

Current Reseacher: Nathan Pelate

Multitouch Capabilities on a Haptic Touchscreen Using Modal Superposition

Touchscreens have changed the way human interact and access information. Yet, today, touchscreens are simply “touchable” surfaces - they do not provide a true touch experience. Moreover, current touchscreens largely limit interactions to a single point of contact, though multi-touch gestures do exist. A touchscreen that provides touch feedback to the user, however, is strictly limited to a single point of contact, as the current state of the art in touchscreens produces vibrations throughout the entire screen, having no variability regardless of location.

In this project, we are creating the next-generation of touchscreen surfaces. We are building touchscreens that can convey new sensations such as bumpy, smooth, slippery, or sticky, at multiple locations, simultaneously on the screen. We are using ultrasonic vibrations and the principle of superposition to create these new, multi-touch effects and are pushing the boundaries, both technically and perceptually, of what is possible in surface haptics.

Publications

Conference:

• K. Katumu and Gorlewicz, J. L. Using modal superposition for generating localized tactile effects on variable friction touchscreens. IEEE HAPTICS Symposium, April 2016.
• H. Lee, K. Katumu, and J. L. Gorlewicz. Toward active boundary conditions for variable friction touchscreens. Lecture Notes in Computer Science, 8618, Eurohaptics 2014.

Steerable Needle Project

Steerable Guide for Brain Tumor Ablation

Current Researcher: Nnaoma Agwu

Traditional surgical treatments for intracranial lesions often include a craniotomy for resection, which requires a large surgical incision. Recent advancements in technology are now enabling minimally invasive approaches, one of which is called Laser Interstitial Thermal Therapy (LITT). In LITT, a laser probe is inserted into a tumor, and it is essentially heated from the inside-out, destroying it. Currently LITT surgical platforms are restricted to only deploying the laser probe along a straight pathway. This limits treatment capabilities, often leaving edges of tumors that are large or geometrically complex, untreated. In this work, we have designed a steerable port for LITT that is MRI-compatible, biocompatible, thermometry compatible, and seamlessly integrates within an FDA approved LITT surgical platform.

Publications

Conference:

M. Rezapour, E. C. Leuthardt, and Gorlewicz, J. L. Design of a steerable guide for laser interstitial thermal therapy of brain tumors. Design of Medical Devices Conference, April 2016. [Accepted for oral presentation].

N. Agwu, K. Deprow, J. E. Williams, E.C. Leuthardt, and J. L. Gorlewicz. A curved port delivery system for laser interstitial thermal therapy of brain tumors. ASME Design of Medical Devices Conference, April 2019. [Accepted Extended abstract]

Vibratory Touchscreen Project

Current Researcher: Jennifer L. Tennison

Touchscreens with vibratory capabilities are extremely common today. They are our tablets and smartphones, and in some cases, our computer screens and laptops. These devices are highly interactive and help us stay connected as we go about our daily lives. Touchscreens are best known for their significant visual component, however, leaving them largely inaccessible without being able to view the screen. Think of how often you look at the screen when interacting with such devices. This visual input/output is particularly problematic for individuals with disabilities. In the CHROME Lab, we are addressing this challenge, particularly in the context of Science, Technology, Engineering, and Math Education. We are exploring how vibrations and additional multisensory feedback can be used to enhance the accessibility and usability of touchscreens, particularly in visual content such as graphics. In doing so, we are opening up new pathways of multimodal learning while increasing the accessibility and equal opportunities of STEM disciplines for learners of all styles, with the goal of creating an inclusive, accessible touchscreen interface for all users.

Check out our exciting efforts to translate this research out of our lab and into the EdTech industry: www.vital-ed.com

We acknowledge funding through the National Science Foundation for these research efforts.

Publications

Journal:

• J. L. Gorlewicz, J. Burgner, T. J. Withrow, and R. J. Webster III. Initial experiences using vibratory touchscreens to display graphical math concepts to students with blindness. Journal of Special Education Technology, 29:2:17-25, 2014.

Conference:

• Tennison, J. L. and Gorlewicz, J. L. Toward Non-visual Graphics Representations on Vibratory Touchscreens: Shape Exploration and Identification. Bello, F., Kajimoto, H. & Visell, Y. (ed.) Proceedings of the 10th International Eurohaptics Conference on Haptics: Perception, Devices, Control, and Applications, Springer, 2016.
• J. L. Toennies, J. Burgner, T. J. Withrow, and R. J. Webster III. Toward haptic/aural touchscreen display of graphical mathematics for the education of blind students. World Haptics Conference, pages 373-378, 2011.