Development of Engine Maintenance Technology with Mixed Reality-Taking Pratt & Whitney JT9D as an Example

The engine is the heart of the aircraft and deeply affects performance, flight safety, and airline management, which makes it a critical component requiring maintenance. With the advancement of technology, augmented reality (AR), virtual reality (VR), and mixed reality (MR) technologies have been introduced one after another. To increase maintenance skill ability, it is important to train for aviation maintenance. Therefore, the engine maintenance mixed reality (EMMR) system was developed through mixed reality technology in this study. There are three different scenarios have been developed in the EMMR system for making engine maintenance easy. In the first scenario, an exploded diagram of the disassembled engine with the main components has been made and an animation of the fuel flow has been demonstrated to introduce the basic structure of the engine. In the second scenario, interactive buttons and animations have been used to simulate the removal of the engine from the wing of an airplane so that the users can understand the process of disassembling the engine. In the third scenario, hybrid reality has been implemented to interact with the virtual objects, so that users could simulate the disassembly and replacement of the engine fan blades and get familiar with the whole process. Students have been introduced to and have been familiarized with the Microsoft HoloLens 2 and a survey has been conducted before and after using the developed technology to understand if the currently developed EMMR could help students to understand the process of each engine maintenance in the general classroom and make the learning more efficient at the same time.