Designed and delivered a prototype of smart human-machine interface that uses augmented reality (AR) to streamline predictive maintenance of jet engines, in collaboration with A*STAR and NTU, Singapore. The solution aimed to replace static manuals with immersive, real-time guidance, improving technician efficiency and reducing errors.
Developed a scaled jet engine model through rapid 3D printing to serve as the physical anchor for AR visualization. Built an interactive AR application using Unity and Vuforia SDK, enabling component identification, step-by-step instructions, and intuitive controls such as play, pause, and help - all integrated into the user’s field of view. The application was successfully deployed on Epson Moverio BT-300 smart AR glasses via Android, demonstrating hands-free interaction and contextual overlays for complex engine systems.
The prototype showcased how AR can accelerate maintenance, repair and operation workflows, reduce preparation time, and lower operational costs for aerospace applications. It validated the feasibility of AR-driven solutions for high-value asset management and laid the foundation for future commercial implementations in predictive maintenance.
A simplified jet engine prototype was built by 3D printing and assembling parts of a jet engine model based on a reference design (as a replica of a real engine).
This physical 3D prototype was used as a model target in the augmented reality (AR) application. When image features of the prototype were detected (with guide views), the application automatically triggered the AR module and displayed relevant information to the user in the head-mounted display.
AR Application Development with Epson Moverio SDK
The model target was trained using Vuforia Model Target Generator and guide views were generated to be detected by the AR glasses so tracking can begin.
AR application was developed using Unity3D development environment & Vuforia AR SDK. Annotations, static and dynamic symbols were augmented on the EPSON Moverio BT-350 AR enabled smart glasses.
AR-Based Smart Human-Machine Interface Demo (v1.0)
Audio and video support included to guide the user with unfamiliar assembly/disassembly tasks.
Provided in-app guidance for the user with animations to better understand the assembly sequence and workflow.