Augmented Reality User Interfaces for Seamless Interaction with Virtual Spaces (JCAD 2010, GIST)

This project explored the effects of AR technology, when combined with a range of 3D prototype applications.

The first part of this project explored an AR-interfaced 3D computer-aided engineering (CAE) simulation test-bed. The purpose of this part is to leverage the intuitive observation of CAE simulations by incorporating AR interfaces. We embedded an AR interface into a series of custom-built 3D simulators used in robotics and aerospace engineering (Figure 9ab). To better manage multiple coordinate systems in an AR environment, we demonstrated the collaboration of virtual robots that are oriented in different coordinate systems in the physical space. In addition, we examined the reliability of augmentation when graphical occlusion interrupts image processing, which frequently happens as end-users are interacting with or manipulating AR-interfaced graphical visuals.

In the second part of this project, I presented a traveler guidance system (TGS) test-bed that can provide macro- and a micro-service in a two-stage system. In the system, a web-based TGS simulates 3D GIS information about a metropolitan road network and a matrix of paths, and then directs end-users to an AR-based TGS that allows fingertip interaction for detailed information about subsets in the destination area (Figure 9c). This project has explored how an AR-incorporated visualization can facilitate the spatial awareness of the streets as well as better understanding of the geospatial information.

In the last part of this project, I explored the communication of a Haptic-based interaction platform with AR-based information media. The purpose of this project is to test the feasibility of a haptically-enhanced broadcasting test-bed for 3D interactive media (Figure 9d). We adapted AR techniques for broadcasting productions and installed a 6-dof haptic device, Phantom, at the client site. In a validation study, we created a home-shopping scenario to demonstrate TV viewers’ immersion and interactivity.

(a) Robot simulation

(b) Spacecraft simulation

(c) Traveler guidance system

(d) Broadcasting services

Figure 9. Incorporating AR-interfaces for providing intuitive observation, informative visualization, and immersive interaction.