Home

Tutorial on Pattern Recognition for Medical Augmented Reality Systems

ACPR 2013 Tutorial

Room: Tiida

Time: 10:00-17:00

Date: Tuesday November 5th (Full day)

Organizers

Yuji Oyamada, Waseda University

Pascal Fallavollita, TUM

Hideo Saito, Keio University

Target audience

This tutorial aims to make a bridge between researchers in pattern recognition field and ones in augmented reality field. We target an audience interested in medical augmented reality systems as well as pattern recognition technique used to achieve medical augmented reality systems.

Overview

The concept of augmented reality (AR) has been introduced to variety of fields in the last decade. Recent development of portable devices such as smart phone and tablet PC provides the community a lot of possible applications in AR systems. Even in the medical field, various AR systems have recently been proposed: systems for education, pre-planning, and those in operating room.

It requires several technical tools to design and implement vision based medical AR systems. Pattern recognition (PR) algorithms/methods play an important role for these. Camera tracking and object matching are indispensable for system initialization (calibration) and on-line visualization. Gesture recognition is used for human-computer interaction. Even though such vision researches have already been studied for decades, there still exists a gap between researchers in PR and AR domains.

The aim of this tutorial is to make a bridge between the researchers in the two different domains so that researchers can contribute to the medical AR domain with their specialty. We first give talks about vision based medical AR systems and show some published systems using PR algorithms for system initialization, on-line visualization, and interaction. Then, two guest speakers give us keynote talks. Lastly, a demo session is organized for the participants.

Schedule

Dr. Yuji Oyamada is currently a junior researcher (Research associate) at the School of Fundamental Science and Engineering, Waseda University, Japan. He received all his degrees from Keio University: B.E., M.E., and Ph.D. of Engineering in 2006, 2008, and 2011 respectively. Before joining Waseda University, he was a full-time intern at Microsoft Research Asia from January to June 2010, a postdoctoral researcher at Keio University from October 2011 to March 2013, and a visiting researcher at the chair for Computer Aided Medical Procedure (CAMP), TUM from March 2012 to March 2013. His research interests span computer vision and augmented reality. In particular, he is interested in solving inverse problem to get better visualization of images and videos, medical augmented reality application and its basic researches such as camera/objects tracking.

Dr. Pascal Fallavollita is currently leading innovative research in computer assisted interventions, visualization and augmented reality at the Navigated Augmented Reality Visualization Systems (NARVIS) laboratory.From 2008-2010, Dr. Fallavollita completed a postdoctoral fellowship in collaboration with the teams at Queen’s University, Canada (The Perk Lab) and the Johns Hopkins Medical School, USA (JHU). During this time, he led research work on multimodal image fusion between ultrasound and fluoroscopy/CT, implant segmentation and reconstruction, for the treatment of prostate cancer in brachytherapy interventions.

His ongoing interests are focused on providing solutions for the treatment of various procedures including but not limited to: (i) cardiac ablation, angioplasty in cardiology, (ii) interlocking of intramedullary nails, intra-op measurement of the mechanical axis deviation of lower limb, in orthopedics, and (iii) prostate brachytherapy in radiation therapy

Hideo Saito received his Ph.D. degree in Electrical Engineering from Keio University, Japan, in 1992. Since then, he has been on the Faculty of Science and Technology, Keio University. In 1997 to 1999, he had joined into Virtualized Reality Project in the Robotics Institute, Carnegie Mellon University as a visiting researcher. Since 2006, he has been a full Professor of Department of Information and Computer Science, Keio University. He served as program co-chair of ISMAR (International Symposium on Mixed and Augmented Reality) 2008 and 2009. Now he is a steering committee member of ISMAR. He also served as an Area Chair of ACCV (Asian Conference on Computer Vision) 2009, 2010, and 2012. His research interests include computer vision, mixed reality, virtual reality, and 3D video analysis and synthesis.Acknowledgments

This tutorial is organized in corporation with JSPS Young Researcher Overseas Visits Program for Accelerating Brain Circulation Program "International Collaboration Research of Perception and Representation Media for Establishment of Medical Access Space" in Keio University.