# Evaluation of Deep Learning-Based Automatic Floor Plan Analysis Technology: An AHP-Based Assessment
## 2 Background Study
### Technology Assessment with AHP  
The technology assessment commonly applies multi-criteria decision-making tools [12]. AHP is a commonly used technology assessment method that involves characterizing the factors of the evaluation, as well as minimizing the subjectivity in assessment. The method is called \"analytical\" and \"hierarchical\" because it allows complex decisional queries for necessary elements and involves the decomposition of the problem [13]. AHP was originally developed by [PERSON] [14] and is one of the most widely used mathematical methods for analyzing complex decision problems with multiple criteria [15; 16]. AHP was employed because of its accuracy, simplicity, and theoretically robust capability for handling both numerical and non-numerical measurements [15]. This implies that if decision-making incorporates both qualitative and quantitative aspects, AHP can systematically solve it by decomposing the structure of the problem into hierarchies because people tend to make pairwise comparison judgments to develop priorities in each hierarchy [17]. AHP has evolved through several applications, including energy allocation, marketing decisions, technology selection, conflict resolution, project selection, and evaluation [17; 18; 19; 20].  
In the field of technology evaluation, AHP can be used to quantitatively determine the factors and weights appropriate for a given technology possessing several qualitative evaluation criteria. Previous studies utilized the AHP method for evaluating technology, considering performance potential [21] or tangible and intangible factors of technology [22]. Additionally, AHP was applied for selecting technology [20], ranking emerging technologies [18] and evaluating new technology [19]. To quantify intangible risks and benefits, [PERSON] characterized both the positive and negative impacts of critical factors using AHP [20]. In addition, [PERSON] and [PERSON] conducted an assessment of decision making of new technology using the hierarchical structure of AHP considering technological, organizational, marketing, and business aspects [19].  
In the construction technology field, previous studies adapted AHP methodology on ranking, decision making, and evaluating. [PERSON] et al. utilized AHP methodology in construction management decision making, because most of construction management problem is based on multi-criteria decision making [23]. As a result, they suggested seven criteria for solving decision-making problems in construction; technical experience, performance record, financial stability, management and employee qualification, capacity, safety record, and operation and equipment. [PERSON] and [PERSON] applied fuzzy AHP to rank and selected construction management project [24]. A fuzzy AHP model is also used to assess the performance of the construction industry in the study conducted by [PERSON] et al. [25]. In addition, [PERSON] and [PERSON] evaluated advanced construction technology using  
Figure 1: Examples of CVC, Rakuten, Rent3D, and EAIS datasets.  
AHP, assessing the intangible aspects of technology by considering both favorable and unfavorable evaluation factors in one framework [26]. A review paper by [PERSON] et al. investigated 77 AHP-based papers from the construction sector from 2004 to 2014. They concluded that application of AHP in construction has gained increased attention because this method can analyze complex situations and make sound decisions [27]. Particularly, when assessing new technologies, the evaluation criteria vary according to the characteristics of each technology. Therefore, it is favorable to utilize the AHP method to assess the effectiveness of a new technology which does not possess any evaluation criteria. It is also reasonable to use the AHP method as it can transform qualitative elements into quantitative indicators. Therefore, in this study, to evaluate the automatic approach for converting floor plan images to vector indoor information, the AHP method was employed.