# Smart Facility Management System Based on Open BIM and Augmented Reality Technology
## 5 System Development and Validation
### System Demonstration of an AR-Based Smart FMS and Validation  
After the system was built, an experimental control group study was designed and conducted to test the developed AR-based smart FMS. Specifically, an experimental group was set up to compare the maintenance work efficiency between the traditional paper-based (control group) approach and the AR-based smart FMS (non-control group) approach. The experiment involved 20 graduate and undergraduate architectural engineering students. Each participant was randomly assigned to conduct an experiment using paper  
Figure 14: Screenshots of prototype system running the (**a**) Start menu, (**b**) Inspection-Inspection type, (**c**) Inspection-Sensor, (**d**) Inspection-Check List, (**e**) Inspection-Property, (**f**) Report defects-Photographing, (**g**) Report defects-Check the BIM model, (**h**) Report defects-Contact with staff, (**i**) Check history-Maintenance history, (**j**) Check history-Department/Company, (**k**) Check history-Warranty Check, (**l**) Repair work-Contract document, (**m**) Repair work-Work status, (**n**) Repair work-Records and (**o**) Repair work-Completion inspection. -based media (control group) or an AR-based smart FMS (non-control group) to perform maintenance tasks. The inspection work on the condition of the doors, windows and inspection space was divided into 14 maintenance tasks (Table 2) which were randomly assigned to the study participants, and their performance was measured and evaluated. The experimental site measured approximately 200 m\({}^{2}\) and had 10 windows with 3 doors. Following an introduction to the experiment, and after becoming familiar with the relevant devices and documents, the participants began the maintenance work. The start and finish times of the work were recorded for each individual, and a brief post-assessment questionnaire was requested to be completed after the maintenance work. The post-experiment questionnaire was adapted from [PERSON] et al. [32], and it focused on the quality of human interaction with technology. Most student participants took BIM and AR courses and therefore possessed mastery of the subject matter needed for the experiment. However, most participants still preferred to use traditional methods and techniques for data searching. Compared with the control group, the non-control group participants thought it was easier to use an AR-based smart FMS to find information during maintenance tasks. Moreover, the non-control group participants responded that the system provided sufficient functionality to complete the task. Although the control group participants were used to the paper-based approach, they felt it was difficult to determine the location of the member subject to inspection and to find the relevant maintenance information for the member. On the other hand, the non-control group participants answered that using the smart FMS had the advantages of location confirmation, rapid information access and ease of use. A summary of the survey statistics of these participants is shown in Table 3. \begin{table}
\begin{tabular}{c c} \hline \hline
**Member Subject to Inspection** & **Operation and Maintenance Tasks** \\ \hline \hline \multirow{6}{*}{Door} & (1) Check open or closed status \\ \cline{2-3}  & (2) Check model name and warranty condition \\ \cline{2-3}  & (3) Check the doorknob condition \\ \cline{2-3}  & (4) Check for any serious damage externally \\ \cline{2-3}  & (5) Verify history track record \\ \cline{2-3}  & (6) Record inspection result \\ \hline \multirow{6}{*}{Window} & (1) Check open or closed status \\ \cline{2-3}  & (2) Check model name and warranty condition \\ \cline{2-3}  & (3) Check the window knob condition \\ \cline{2-3}  & (4) Check for any serious damage externally \\ \cline{2-3}  & (5) Verify history track record \\ \cline{2-3}  & (6) Record inspection result \\ \hline \multirow{2}{*}{Inspection Space} & (1) Measure and record temperature \\ \cline{2-3}  & (2) Measure and record humidity \\ \hline \hline \end{tabular}
\end{table}