Demos

Project ViPEXP – Mobile Immersive Exploration of Virtual Prototypes (Demo 1)

In the Its-OWL-funded transfer project ViPEXP, a multi-user virtual space for lightweight mobile HMD-systems has been created, which allows participants to review a virtual prototype (e.g. a CAD machine model) in an immersive virtual environment. In one session, 20 or more participants can join in an ad-hoc peer-to-peer mode running on smartphones only (Samsung Gear VR).

The participants are represented using reduced-to-the-minimum avatars which communicate body position and orientation, as well as head orientation. Using a gamepad-controller, they can point to objects, pick-up objects and move them around as well as place pointers to mark certain locations or objects during communication.

This virtual reality simulation can be used to study task-related communication in a shared virtual reality setup.

Photorealistic Character Scanning and Animation (Demo 2)

We will introduce our photoscanners and demonstrate a pipeline to create ready-to-animate virtual characters. To this end, we fit a template character to a point set computed from multi-view stereo reconstruction.

KOMPASS Project (Demo 3)

In the KOMPASS project we develop a socially cooperative embodied conversational agent that helps elderly users and users with cognitive impairments to structure their day and thus to maintain a self-determined lifestyle in their own home. Using interactive spoken dialogue, the user and the agent collaboratively plan the users activities and the agent helps the user adhering to their schedule.

Intelligent Coaching Space (Demo 4)

In the ICSPACE project we explore how to provide intelligent coaching in sports training, motor skill learning, or physical rehabilitation. The goal is to develop a VR-based "Intelligent Coaching Space" that enables novel ways of adaptive, online feedback in a closed-loop interaction and training system. Leveraging fundamental cognitive principles, perceptual processing, and movement understanding, ICSPACE combines state-of-the-art motion tracking and analysis, neuro-cognitive diagnosis, and multi-sensory feedback in various forms, including virtual mirrors, online verbal feedback, or instructions and demonstrations by a virtual coach. The demonstration will show the current state of project.