# Holographic Mixed Reality System for Air Traffic Control and Management
## 4 Proposed Mixed Reality System  
This study proposed a 4D (3D + time) holographic mixed reality system for air traffic controllers to visualize and manage air traffic. Within the control tower, the controllers use to watch and monitor a considerable amount of information in the control tower. The information mainly refers to the landing, takeoffs, traffic in air, ground traffic, etc. of airplanes. On close observation of the information monitored by the air traffic controllers, it can be stated that this information can be categorized into the categories of traffic on the ground and traffic in the air. Ground traffic mainly consists of the landing, takeoffs, traffic on the taxiways, etc. of airplanes. To monitor the traffic in this category, the controllers use outside views through the windows of the tower. Due to this conventional method of monitoring, the controllers suffer from many problems including bad weather conditions. However, air traffic is conventionally monitored on a map using 2D monitor screens. These two-dimensional interfaces are less productive for giving a true interpretation of air traffic. Moreover, it gets very hectic and time consuming for air traffic controllers to switch among different monitor screens and real-world views of an airfield. Hence, a 4D mixed reality system was proposed for the efficient management of airfields using both visual and voice interaction through a single hardware unit. Within a single head-mounted mixed reality device, the interaction mechanisms were provided to control traffic in the air as well as on the ground. These mechanisms include switching between multiple interfaces within a single display device using a holographic display or voice commands. Moreover, keeping in mind that sound is an important medium for communicating information, the functionality of giving voice commands was provided through the head-mounted mixed reality device. Furthermore, 3D sound was used to enable the air traffic controller to interpret the location of airplanes within the system. Our proposed system consisted of multiple interaction modules and holographic spatial interfaces to support the air traffic controller's various tasks. These tasks mainly include viewing radar information on a map, monitoring the airport's runways through the windows of the control tower, switching between both views, communication with voice, etc. Figure 2 shows all the modules included in the proposed system.  
\begin{table}
\begin{tabular}{l l} \hline
**Question** & **Response Results** \\ \hline  & (P1) Not helpful—if information such as winds according to positions, altitudes, etc. is available, information necessary for pilots can be given \\ Do you think the provision of & (P2) Will be helpful—since the reliability of equipment is low, the necessity to develop \\ virtual real-time information & new equipment is high \\ in low visibility states will be & (P3) Should be quite helpful—it would be quite helpful if the real scenario is \\ helpful for your work? & implemented by at least 90\% \\  & (P4) Should be quite helpful—it would be very helpful if all the data used by the air \\  & traffic controller were displayed on one screen \\  & (P5) Moderate \\ \hline \end{tabular}
\end{table}
Table 1: Cont.  
Figure 2: The proposed mixed reality system for air traffic management.  
Each module is described in detail as follows: