In our game Stylus Strike, you can get a fun archery experience where it is up to you to defend your castle from the evil monsters. To make you feel like you're really there, we built a spring loaded "bow" that uses a Quest controller for tracking the bow, and the MX Ink attached to the front for tracking the arrow. You can grab the "arrow" and draw it just like you would a real bow! This work has been selected as a finalist in the categories "Best Game" and "Best use of XR stylus" from over 200 projects! Play it yourself here!
This past November I had the amazing opportunity to attend the Basecamp simulation boot-camp at Weill Cornell Medicine to conduct research on our CPR timer application running on the Hololens 2! This app was developed in collaboration with Jonathan Segal at Cornell Tech and is supposed to help medical professionals keep time in CPR scenarios. The event was highly interesting, as we gave the headset to medical professionals in a simulated CPR scenario and got to observe their work with or without using the headset. We were able to gather a lot of feedback about the app and hope to improve it further these coming months.
In health care, there are still many devices with poorly designed user interfaces that can lead to user errors. Especially in acute care, an error can lead to critical conditions in patients. Previous research has shown that the use of augmented reality can help to better monitor the condition of patients and better detect unforeseen events. The system created in this work is intended to aid in the detection of changes in patient and equipment-data in order to increase detection of critical conditions or errors. Find the publication here.
We developed "WueConnect" for the city of Würzburg—an app aimed at streamlining local political engagement by making it easier for citizens to stay updated on municipal projects and share their views. The app empowers users to participate in decisions on issues like preservation or demolition of community structures, and it features a points-based system that rewards active engagement. For instance, users can gain points by voting on issues or attending public workshops, potentially earning rewards like theater tickets. Our team collaborated closely with city officials, preparing for the handover to Würzburg's "SmartCity" team, which will manage the app going forward. "WueConnect" is part of a broader set of digital initiatives led by students to support Würzburg's development as a connected, digital city. Professor Harald Wehnes supervised the project as part of a course for agile project management. At Projekta 2019, we won the prize for most innovative product.
We implemented a neural network from the ground up for detecting and differentiating between gestures. For this we recorded gestures with a Kinect and annotated the recorded videos with the performed gestures. Those gestures were then supposed to be used to control an image viewer, but because we thought that was a bit boring we implemented a short game in Unity to show off our gestures.
In this project, we implemented a custom state-machine for voice recognition and created a VR game in UnityEngine. This game was a tower-defense game, which could be controlled by combining controller gestures with voice commands. For interaction, we built our system off of the "Put that there" paradigm.
Breaking Bad Behaviors is an immersive virtual reality (VR) system for training classroom management skills, with a specific focus on learning to manage disruptive student behavior in face-to-face, one-to-many teaching scenarios.
The core of the system is a real-time 3D virtual simulation of a classroom populated by twenty-four semi-autonomous virtual students.
The system has been designed as a companion tool for classroom management seminars in a syllabus for primary and secondary school teachers. This will allow lecturers to link theory with practice using the medium of VR.
During my time at the Colorado State University I participated in a Virtual Reality Hackathon sponsored by HP. My team and I placed first in the competition with our VR application that simulates various aging-related disabilities in day-to-day scenarios.]
Check out more about it here!
During my internship at Centigrade GmbH in Munich, I dedicated most of my time to 3D design-engineering. I gathered a lot of experience developing a showcase application for the Microsoft Hololens and helped write an article about art styles in 3D as co-author. The application was developed for the company Festo and was shown at the Hannovermesse 2017. I also researched 3D Art styles for XR, resulting in this blog post.
3D User Interfaces
Implemented common 3DUI paradigms from scratch
Machine Learning
Implemented neural network for gesture recognition
Big Data
Neural network for white matter hyperintensity detection in MRI scans
Multimodal Interfaces
Voice and gesture controlled VR tower-defense game
Principles of Realtime Interactive Systems
Agile Methods of Project Management
App for the smart city to increase population participation
Educational VR and AR in the Classroom
AR learning app to teach physics and architecture
Advanced Methods of Data Analysis
Human-Technology-Society
Psychology of Interactive Systems
HCI Theories
Visual and Graphic Design
Introduction to Human Computer Interaction
Introduction to Programming
Foundations of Algorithms and Data Structures
Programming Specialization Interface Development
Software Technology
Software Quality
Web-Design 1&2
Interactive Computer Graphics
Current Research Topics in HCI
Foundations of Psychological Ergonomics
Instructional Psychology
Research Methods
Statistics 1 & 2
Usability and Software Ergonomics
Methods of user centered design
Special Areas of Psychology
Accessibility and Inclusive Design
Digital Museum
Interdisciplinary project for redesigning museum exhibits based on visitor interviews
Qualitative Research Methods