Research

Free-Viewpoint Video is an advanced 3D visual media that makes audience can observe the target scene from arbitral viewpoint. It becomes possible to grasp the situation that is difficult to understand by observing from one direction and to watch the game from the player's viewpoint.

Mixed-Reality (MR) and Augmented Reality (AR) enhance visual information by superimposing computer-generated virtual objects on the real world. Shared Mixed Reality aims to realize more advanced collaborative work by using MR technology.

By combining 3D measurement with visual information, scene recognition, and Mixed Reality, we are researching and developing Intelligent Transport Systems such as " visual assistance for drivers", "improvement of passengers' sense of security", and "control of autonomous vehicles".

Research on the advancement of resource engineering and mining engineering using 3D shape information reconstructed from multi-viewpoint images (cooperating with Curtin University in Western Australia).

"3D surgical navigation system" that integrates "3DCG simulation" used by doctors for preoperative examination and "on-site navigation" based on 3D Computer Vision technology. Supporting surgeons with an intuitive understanding of proper instructional procedures and advanced medical techniques can improve the level of surgery.

By utilizing a 3D model reconstructed from multi-viewpoint images captured at world heritage sites by drones and mobile devices, we are developing a system that detects damage and deterioration, and visualize aging for supporting preventive conservation activities.

Research and development on motion analysis of athletes using video information, training support and strategy analysis based on 3D positional information of players.

Automatic generation of disaster maps using 3D models generated from images of different modalities such as satellites, aerial photography, surveillance cameras, and mobile devices taken at the time of a disaster and annotation by crowdsourcing.

Supporting the developmental education of children using rich visual information of multi-view images and intuitive display of projection mapping.