Programme:
09:00 Opening and presentation of the Profi7 program of Human-AI Co-evolution and Learning in Multi-realities (HI) - Dr. Satu Kaleva, Coordinator.
09:10 Case: VR Training Application for Healthcare Professionals - Dr. Sari Pramila- Savukoski, from the Health care education and competence (HealthEduCom) -research group
09:40 Case: Kai - Embodied AI Agent in Mixed Reality - Asst. Prof. Andy Nguyen from the Learning and Educational Technology Research Lab
10:00 Hands-on sessions with AI agent Kai and VR Training Application for Healthcare Professionals.
11:00 Closing
Hybrid Intelligence: Combines the strengths both of humans and machines to complement and reinforce eachother
There are four teams in hybrid intelligence:
(HI 1) Data and algorithms
(HI 2) Humans
(HI 3) Multi-reality
(HI 4) Quality of life
sofoklis kakouros
https://scholar.google.com/citations?user=RMjnTtQAAAAJ&hl=en
Dr. Sari Pramila
VR/XR training application for healthcare professionals
-> physiotherapist
-> Partnership with Frostbit: https://www.frostbit.fi/en/about-us/
Motivation:
in healthcare students need to conduct practical training
lack of healthcare supervisors in clinical practice
availability of qualified healthcare professionals
So:
-> healthcare sortage
For these reasons they developed simulation-based extended reality (XR) applications
XR can partly replace clinical placement
KulttuuriOsaaja project
https://kulttuuriosaaja.blogspot.com/
https://www.oulu.fi/fi/projektit/kulttuurinen-osaaminen-sote-alan-tyoyhteisoissa
Two XR Cases
1) Patient has had knee surgery: Students have to give advice on how to take care of the wound and provide a home care plan
2) Patient has pneumonia: Students give her antibiotics, but she has anaphylactic shock from antibiotics and students have to take care of that situation
Collection of multimodal data
e.g use of different questionaires about satisfaction, self-confidence and simulation design
also neurophysiological multimodal data from the scene, so students have sensors on forehead (fNIRS - brain activity) and wrist (EEG - heart activity) besides the VR goggles
Benefits
How XR technology can be used in professional development
How XR can simulate real-life scenarios with possibility for trainees to repeatedly engage with situations
AI models to identify patterns in user behavior
Results
Students'clinical reasoning improved significantly
Improvement in Identifying and communicating vital information clearly to the doctors based on the patient's current situation
KAI: Embodied AI in Mixed Reality
How can we combine Generative AI and mixed reality?
-> not only how can AI support humans, but how can mutual learning be achieved
-> The idea behind it was people conversing with an entity rather than a chabot , so they can see AI more as a partner than a tool
-> They look at socioemotional aspects as well as non-verbal communication so they look at different kinds of data
-> MetaQuest website