## 2 Methodology
### Field Investigation
This process involved comprehensive reliability testing and validity assessment to ascertain that the scale effectively measures the intended constructs related to signage evaluation. Therefore, a reliability analysis was performed on the collected data during the pilot study following the design and administration of the survey. The analysis yielded a reliability characterization coefficient of 0.862, demonstrating a high level of internal consistency among the evaluation variables. This coefficient suggests that the metrics  
Figure 2: Field Research Methods. (a) VR; (b) Video; (c) Picture. used for assessing signage performance were highly correlated and accurately reflected the intended evaluation framework. Consequently, this reliability measure provides a robust foundation for the credibility of the study's findings and serves as a reference point for ensuring the reliability of future experimental designs and survey instruments. Moreover, to assess the construct validity of the survey, exploratory factor analysis (EFA) was performed. The analysis yielded a Kaiser-Meyer-Olkin (KMO) value of 0.867 (\(p\)-value \(<\) 0.001), confirming the suitability of the data for factor analysis and indicating high validity. The EFA identified key factors related to signage evaluation, such as accurate readability, size, brightness, obstruction, defacement rate, location, signage arrangement, and the eye-catching quality of the information. Additionally, higher-order factors like concise clarity, guidance accuracy, information hierarchy, coherence consistency, and amount of information were also extracted. These factors explain the underlying structure of the signage evaluation metrics, ensuring that the questionnaire effectively captures the critical dimensions of pedestrian visual assessment within transportation hubs. The ICC (Intraclass Correlation Coefficient) was utilized for assessment to determine whether the findings of the same group of respondents were correlated. The mean measurement correlation coefficient ICC = 0.862 \(>\) 0.75 (\(p\)-value \(<\) 0.001). Following the reliability, validity, and correlation tests, the survey data exhibited strong internal reliability and validity, confirming the scientific and effective nature of the data collection method. The evaluation results remained consistent even when employing different study methodologies. The method based on panoramic video was found to be feasible when compared to survey and field investigation approaches. In summary, to ensure the reliability and validity of the survey scale, we initially employed EFA and reliability characterization coefficients. These methods were essential for refining the evaluation indicators used in our study. EFA identified the underlying factors of the evaluation criteria, confirming that the metrics for assessing directional signage were both reliable and valid. The results of these preliminary analyses demonstrated that the proposed evaluation indicators were effective for assessing signage within transportation hubs, thereby establishing a robust foundation for the subsequent experimental design and survey administration. With the validated and reliable indicators, we could apply the EWM to assign appropriate weights to each evaluation criterion. EWM utilized the validated factors from EFA to ascertain the relative importance of each criterion. Subsequently, the TOPSIS was employed to rank and assess the effectiveness of signage designs within the hubs, as well as across different hubs. By incorporating the weights derived from EWM, TOPSIS facilitated a comprehensive and objective analysis, allowing for the prioritization of signage options based on their performance.