# Research on Recognition and Evaluation of Traffic Guide Sign

Authors: Li Yuan; Ming-jie Cai; Tang-yi Guo; Yu Jiang
Journal: Mathematical Problems in Engineering
 (2015)

---

## Abstract

Traffic guide signs are effective only when they are clearly recognized by drivers. Three experiments were conducted in this study. In the first, the influence factors of guide sign recognition were studied. This study investigated 11 main factors with a convenience sample of drivers from Nanjing city in China. Weights of different influence factors were obtained through analytic hierarchy process (AHP). The results showed that the setting position, occlusion degree, and character size of guide sign had the most significant influence on the guide sign recognition, while other factors were less important. In the second stage, an evaluation model of guide sign recognition was developed based on weights of different factors. Four equations were presented to calculate the comprehensive score of guide sign, and the level of recognition was divided into five grades according to the comprehensive score. At last, a typical case in Nanjing was studied to verify the rationality and reliability of the evaluation model. Results from the real application indicate that the method had good applicability and can be used by traffic engineers.


---

## Body

## 1. Introduction

Traffic signs provide important information for regulating, guiding, or warning the behaviors of drivers in order to make driving safer and easier [1]. However, with the continuous development of city scale and road network, the service of traffic signs has lagged far behind. The guide sign is a type of traffic sign that help drivers reach their destinations conveniently, quickly, and comfortably and thus improve the efficiency of transportation system [2]. US Department of Transportation [3] claimed that an improvement project for traffic signs would lead to a 34% reduction in fatal accidents. However, if the guide signs cannot be clearly recognized by drivers, they serve little purpose. Therefore, there is need for detailed research of guide sign recognition. Then what factors can influence the recognition? What about the importance of different influence factors? How to evaluate the guide sign recognition? These questions are investigated in this study.Guide sign has been a hot topic of considerable interest to researchers. Ng and Chan [4] studied the influence of a symbol’s visual features (color, shape, and size) and cognitive features (familiarity, concreteness, complexity, meaningfulness, and semantic distance). Gao et al. [5] found that color and shape features extracted using vision models can perform accurate recognition for traffic signs located at a reasonable distance for still images under various viewing conditions. Al-Madani and Al-Janahi [6] investigated the relationship between drivers’ personal characteristics and their comprehension of posted signs; they found that drivers’ years of education, gender, monthly income, and nationality have significant effect on their understanding of traffic signs. There are some limitations of these studies: the research objects were mainly concerned with some basic features (especially color and shape) and personal characteristics of drivers; many other influence factors should be taken into account. Prieto and Allen [7] proposed a new method for the detection and recognition of traffic signs using self-organizing maps (SOM). Liu and Lu [8] studied the technology of guide sign setting based on front distance model which was presented to improve guide sign recognition. Zaklouta and Stanciulescu [9] presented a three-stage real-time recognition system of traffic signs, consisting of segmentation, detection, and classification phase. Souani et al. [10] proposed to implement the application of automatic recognition of road signs in real time by optimizing the techniques used in different phases of the recognition process. In this study, 11 main influence factors were selected to survey. The results are effective on guide sign of common road only; namely, other roads are not within the scope of this study.As is readily apparent in the above brief review, a wide range of methods and measures have been used to study guide sign recognition. However, the importance of different influence factors remains unknown, and little research has been done in the evaluation of guide sign recognition. The aim of this study is to discuss the importance of different factors and the evaluation method of guide sign recognition. The paper proceeds as follows: (1) to determine weights of 11 factors and (2) to establish an evaluation model of guide sign recognition.


## 2. Method

The method adopted here involved questionnaires to be completed by the drivers who were selected randomly based on stratified random sampling technique. The stratification was based on gender, age, occupation, and years of driving license.This research included three experiments. In the first, the influence factors of guide sign recognition were studied. In the second, the evaluation model of guide sign recognition was established. In the third, an example in Nanjing was used to verify the rationality and reliability of the evaluation model.


### 2.1. Participants

Sampling was necessary to a large population [11], so, in the first stage, the questionnaires were distributed to drivers from different occupations, including university students, researchers, bus drivers, and driving coaches. The ages of all participants were mainly between 20 and 60 years, and there were three groups about the ages: 18–25 years, 26–50 years, and 50 or more. The number of males and females was quite fair.


### 2.2. Survey Instrument

#### 2.2.1. Survey on Influence Factors of Guide Sign

(1) Selection of Influence Factors.The first step was to find out the main influence factors of guide sign recognition. On the basics of the literature and field survey, the main factors were summarized and divided into static elements and dynamic elements (Table 1). An entire survey was time-consuming and undesirable, so only 11 of the main influence factors were selected based on ergonomics and the screening of experts. The ergonomics is a cross discipline that regards human, machine, and environment as a whole; its task is to optimize the working conditions and obtain higher efficiency.Table 1
Main influence factors of guide sign recognition.
Influence factors
Contents
Static elements
Shape, size, ground color, setting position, sign height, color contrast, sign number, and road complexity
Dynamic elements
Static and kinetic eyesight, response time, speed, illumination, reflection, indistinct degree, occlusion degree, character number, size and complexity, weather, traffic condition, vehicles and machinery, and motor ability of driver(2) Content of Questionnaire.The questionnaire included two parts. Part A was the drivers’ personal characteristics with four closed-ended questions, including gender, age, occupation, and years of driving license (Table 2). In order to maintain comfort in providing answers, participants were not required to put their names or telephone numbers on the questionnaires.Table 2
Questionnaire sections: (a) drivers’ characteristics and (b) sample of questions.
(a)
Gender
□ Male
□ Female
Age
□ 18–25
□ 26–50
□ Over 50
Education level
□ Below university
□ University or above
Years of license
□ Less than 2 years
□ More than 2 years
(b)
What is the relative importance when “character size” is compared to “character number”?
□ 1 : 9
□ 2 : 8
□ 3 : 7
□ 4 : 6
□ 5 : 5
□ 6 : 4
□ 3 : 7
□ 8 : 2
□ 9 : 1Part B was 18 questions to evaluate the degree of importance between each two factors. They were illustrated in color along with 9 choices (shown in Table2). The questionnaire was designed based on the theory of analytic hierarchy process (AHP); 9 kinds of proportion were used to describe the relative importance.(3) Questionnaire Survey.Two forms were adopted to make the survey. Online survey seemed to be much more convenient, while field survey could ensure the diversity of participants. To gain trust and get sincere response, participants were clearly reminded that this survey was not an exam, personal information was not taken, and no legal action would be applied. During the surveys, nearly each participant was equipped with one interviewer to avoid copying, cheating, and answering as a group, and there was less misunderstanding about the content of questionnaire in this way. When a participant preferred to answer verbally, interviewers simply wrote his/her answer on the questionnaire without interfering. The process which started in Nanjing in April, 2014, took over 10 days to finish.


#### 2.2.2. Evaluation Model of Guide Sign Recognition

(1) Hierarchical Structure of Evaluation Index.According to the advice of experts and taking full consideration of psychophysical and physiological nature of a human, 11 influence factors were selected and divided into three categories. The evaluation model included three layers: target layer, rule layer, and index layer (Figure 1).Figure 1
Hierarchical structure of evaluation index.(2) Determination of Index Scores.Scores of index layer (F
i
j) were obtained by a questionnaire survey. A five-score system was used in order to facilitate the comparison and determination of index score (Table 3). The criterion of grading was based on the latest National Standards of the People’s Republic of China for Part 2 of Road Sign and Marking (GB5768-2009) issued in April 2009. There were two assumptions in this research: the design speed is between 40 and 70 km/h and the driver’s vision is 0.8.Table 3
Example of evaluation standard.
Date
Name
Index
Standard
Interval
Score
Character size
Character height is less than 25 cm
<2.0
Character height is between 25 and 40 cm
2.0~3.0
Character height is between 40 and 50 cm
3.0~4.0
Character height is more than 50 cm
4.0~5.0
Character number
Character number is more than 20
<2.0
Character number is between 13 and 20
2.0~3.0
Character number is between 7 and 12
3.0~4.0
Character number is less than 7
4.0~5.0
Information complexity
The number of destinations is more than 6
<2.0
The number of destinations is between 5 and 6
2.0~3.0
The number of destinations is between 3 and 4
3.0~4.0
The number of destinations is between 1 and 2
4.0~5.0(3) Determination of Index Weights. Weights of index layer (W
i
j) and rule layer (W
i) were obtained through AHP; the comprehensive weight directly reflected the importance of 11 influence factors that affected guide sign recognition. The comparison matrix was established based on the data of first stage. In order to assure a certain quality level of a decision, a consistency check on the comparison matrix was needed. The comparisons are assumed to be internally coherent when the consistency ratio CR ≤ 0.1; otherwise the comparisons must be repeated [12].(4) Calculation of Comprehensive Score. The comprehensive score is given by the equations below:(1)
F
i
=
∑
W
i
j
F
i
j
i
=
1,2
,
3
,
j
=
1,2
,
3,4
G
Q
I
=
∑
i
=
1
3
W
i
F
i
.


#### 2.2.3. Case Study

(1) Case Selection.In order to get a more intuitional result, two guide signs (see Figure 2) at the same location of Nanjing were selected to be research objects. The former was before reconstruction (March 2013) while the latter was after reconstruction (November 2014).Figure 2
Case of guide sign.(2) Data Collection.In order to get scores of the two guide signs, ten researchers were invited to complete the questionnaire. Scores were all accurate to the first decimal place and the average score was adopted to calculate the comprehensive score.


## 2.1. Participants

Sampling was necessary to a large population [11], so, in the first stage, the questionnaires were distributed to drivers from different occupations, including university students, researchers, bus drivers, and driving coaches. The ages of all participants were mainly between 20 and 60 years, and there were three groups about the ages: 18–25 years, 26–50 years, and 50 or more. The number of males and females was quite fair.


## 2.2. Survey Instrument

### 2.2.1. Survey on Influence Factors of Guide Sign

(1) Selection of Influence Factors.The first step was to find out the main influence factors of guide sign recognition. On the basics of the literature and field survey, the main factors were summarized and divided into static elements and dynamic elements (Table 1). An entire survey was time-consuming and undesirable, so only 11 of the main influence factors were selected based on ergonomics and the screening of experts. The ergonomics is a cross discipline that regards human, machine, and environment as a whole; its task is to optimize the working conditions and obtain higher efficiency.Table 1
Main influence factors of guide sign recognition.
Influence factors
Contents
Static elements
Shape, size, ground color, setting position, sign height, color contrast, sign number, and road complexity
Dynamic elements
Static and kinetic eyesight, response time, speed, illumination, reflection, indistinct degree, occlusion degree, character number, size and complexity, weather, traffic condition, vehicles and machinery, and motor ability of driver(2) Content of Questionnaire.The questionnaire included two parts. Part A was the drivers’ personal characteristics with four closed-ended questions, including gender, age, occupation, and years of driving license (Table 2). In order to maintain comfort in providing answers, participants were not required to put their names or telephone numbers on the questionnaires.Table 2
Questionnaire sections: (a) drivers’ characteristics and (b) sample of questions.
(a)
Gender
□ Male
□ Female
Age
□ 18–25
□ 26–50
□ Over 50
Education level
□ Below university
□ University or above
Years of license
□ Less than 2 years
□ More than 2 years
(b)
What is the relative importance when “character size” is compared to “character number”?
□ 1 : 9
□ 2 : 8
□ 3 : 7
□ 4 : 6
□ 5 : 5
□ 6 : 4
□ 3 : 7
□ 8 : 2
□ 9 : 1Part B was 18 questions to evaluate the degree of importance between each two factors. They were illustrated in color along with 9 choices (shown in Table2). The questionnaire was designed based on the theory of analytic hierarchy process (AHP); 9 kinds of proportion were used to describe the relative importance.(3) Questionnaire Survey.Two forms were adopted to make the survey. Online survey seemed to be much more convenient, while field survey could ensure the diversity of participants. To gain trust and get sincere response, participants were clearly reminded that this survey was not an exam, personal information was not taken, and no legal action would be applied. During the surveys, nearly each participant was equipped with one interviewer to avoid copying, cheating, and answering as a group, and there was less misunderstanding about the content of questionnaire in this way. When a participant preferred to answer verbally, interviewers simply wrote his/her answer on the questionnaire without interfering. The process which started in Nanjing in April, 2014, took over 10 days to finish.


### 2.2.2. Evaluation Model of Guide Sign Recognition

(1) Hierarchical Structure of Evaluation Index.According to the advice of experts and taking full consideration of psychophysical and physiological nature of a human, 11 influence factors were selected and divided into three categories. The evaluation model included three layers: target layer, rule layer, and index layer (Figure 1).Figure 1
Hierarchical structure of evaluation index.(2) Determination of Index Scores.Scores of index layer (F
i
j) were obtained by a questionnaire survey. A five-score system was used in order to facilitate the comparison and determination of index score (Table 3). The criterion of grading was based on the latest National Standards of the People’s Republic of China for Part 2 of Road Sign and Marking (GB5768-2009) issued in April 2009. There were two assumptions in this research: the design speed is between 40 and 70 km/h and the driver’s vision is 0.8.Table 3
Example of evaluation standard.
Date
Name
Index
Standard
Interval
Score
Character size
Character height is less than 25 cm
<2.0
Character height is between 25 and 40 cm
2.0~3.0
Character height is between 40 and 50 cm
3.0~4.0
Character height is more than 50 cm
4.0~5.0
Character number
Character number is more than 20
<2.0
Character number is between 13 and 20
2.0~3.0
Character number is between 7 and 12
3.0~4.0
Character number is less than 7
4.0~5.0
Information complexity
The number of destinations is more than 6
<2.0
The number of destinations is between 5 and 6
2.0~3.0
The number of destinations is between 3 and 4
3.0~4.0
The number of destinations is between 1 and 2
4.0~5.0(3) Determination of Index Weights. Weights of index layer (W
i
j) and rule layer (W
i) were obtained through AHP; the comprehensive weight directly reflected the importance of 11 influence factors that affected guide sign recognition. The comparison matrix was established based on the data of first stage. In order to assure a certain quality level of a decision, a consistency check on the comparison matrix was needed. The comparisons are assumed to be internally coherent when the consistency ratio CR ≤ 0.1; otherwise the comparisons must be repeated [12].(4) Calculation of Comprehensive Score. The comprehensive score is given by the equations below:(1)
F
i
=
∑
W
i
j
F
i
j
i
=
1,2
,
3
,
j
=
1,2
,
3,4
G
Q
I
=
∑
i
=
1
3
W
i
F
i
.


### 2.2.3. Case Study

(1) Case Selection.In order to get a more intuitional result, two guide signs (see Figure 2) at the same location of Nanjing were selected to be research objects. The former was before reconstruction (March 2013) while the latter was after reconstruction (November 2014).Figure 2
Case of guide sign.(2) Data Collection.In order to get scores of the two guide signs, ten researchers were invited to complete the questionnaire. Scores were all accurate to the first decimal place and the average score was adopted to calculate the comprehensive score.


## 2.2.1. Survey on Influence Factors of Guide Sign

(1) Selection of Influence Factors.The first step was to find out the main influence factors of guide sign recognition. On the basics of the literature and field survey, the main factors were summarized and divided into static elements and dynamic elements (Table 1). An entire survey was time-consuming and undesirable, so only 11 of the main influence factors were selected based on ergonomics and the screening of experts. The ergonomics is a cross discipline that regards human, machine, and environment as a whole; its task is to optimize the working conditions and obtain higher efficiency.Table 1
Main influence factors of guide sign recognition.
Influence factors
Contents
Static elements
Shape, size, ground color, setting position, sign height, color contrast, sign number, and road complexity
Dynamic elements
Static and kinetic eyesight, response time, speed, illumination, reflection, indistinct degree, occlusion degree, character number, size and complexity, weather, traffic condition, vehicles and machinery, and motor ability of driver(2) Content of Questionnaire.The questionnaire included two parts. Part A was the drivers’ personal characteristics with four closed-ended questions, including gender, age, occupation, and years of driving license (Table 2). In order to maintain comfort in providing answers, participants were not required to put their names or telephone numbers on the questionnaires.Table 2
Questionnaire sections: (a) drivers’ characteristics and (b) sample of questions.
(a)
Gender
□ Male
□ Female
Age
□ 18–25
□ 26–50
□ Over 50
Education level
□ Below university
□ University or above
Years of license
□ Less than 2 years
□ More than 2 years
(b)
What is the relative importance when “character size” is compared to “character number”?
□ 1 : 9
□ 2 : 8
□ 3 : 7
□ 4 : 6
□ 5 : 5
□ 6 : 4
□ 3 : 7
□ 8 : 2
□ 9 : 1Part B was 18 questions to evaluate the degree of importance between each two factors. They were illustrated in color along with 9 choices (shown in Table2). The questionnaire was designed based on the theory of analytic hierarchy process (AHP); 9 kinds of proportion were used to describe the relative importance.(3) Questionnaire Survey.Two forms were adopted to make the survey. Online survey seemed to be much more convenient, while field survey could ensure the diversity of participants. To gain trust and get sincere response, participants were clearly reminded that this survey was not an exam, personal information was not taken, and no legal action would be applied. During the surveys, nearly each participant was equipped with one interviewer to avoid copying, cheating, and answering as a group, and there was less misunderstanding about the content of questionnaire in this way. When a participant preferred to answer verbally, interviewers simply wrote his/her answer on the questionnaire without interfering. The process which started in Nanjing in April, 2014, took over 10 days to finish.


## 2.2.2. Evaluation Model of Guide Sign Recognition

(1) Hierarchical Structure of Evaluation Index.According to the advice of experts and taking full consideration of psychophysical and physiological nature of a human, 11 influence factors were selected and divided into three categories. The evaluation model included three layers: target layer, rule layer, and index layer (Figure 1).Figure 1
Hierarchical structure of evaluation index.(2) Determination of Index Scores.Scores of index layer (F
i
j) were obtained by a questionnaire survey. A five-score system was used in order to facilitate the comparison and determination of index score (Table 3). The criterion of grading was based on the latest National Standards of the People’s Republic of China for Part 2 of Road Sign and Marking (GB5768-2009) issued in April 2009. There were two assumptions in this research: the design speed is between 40 and 70 km/h and the driver’s vision is 0.8.Table 3
Example of evaluation standard.
Date
Name
Index
Standard
Interval
Score
Character size
Character height is less than 25 cm
<2.0
Character height is between 25 and 40 cm
2.0~3.0
Character height is between 40 and 50 cm
3.0~4.0
Character height is more than 50 cm
4.0~5.0
Character number
Character number is more than 20
<2.0
Character number is between 13 and 20
2.0~3.0
Character number is between 7 and 12
3.0~4.0
Character number is less than 7
4.0~5.0
Information complexity
The number of destinations is more than 6
<2.0
The number of destinations is between 5 and 6
2.0~3.0
The number of destinations is between 3 and 4
3.0~4.0
The number of destinations is between 1 and 2
4.0~5.0(3) Determination of Index Weights. Weights of index layer (W
i
j) and rule layer (W
i) were obtained through AHP; the comprehensive weight directly reflected the importance of 11 influence factors that affected guide sign recognition. The comparison matrix was established based on the data of first stage. In order to assure a certain quality level of a decision, a consistency check on the comparison matrix was needed. The comparisons are assumed to be internally coherent when the consistency ratio CR ≤ 0.1; otherwise the comparisons must be repeated [12].(4) Calculation of Comprehensive Score. The comprehensive score is given by the equations below:(1)
F
i
=
∑
W
i
j
F
i
j
i
=
1,2
,
3
,
j
=
1,2
,
3,4
G
Q
I
=
∑
i
=
1
3
W
i
F
i
.


## 2.2.3. Case Study

(1) Case Selection.In order to get a more intuitional result, two guide signs (see Figure 2) at the same location of Nanjing were selected to be research objects. The former was before reconstruction (March 2013) while the latter was after reconstruction (November 2014).Figure 2
Case of guide sign.(2) Data Collection.In order to get scores of the two guide signs, ten researchers were invited to complete the questionnaire. Scores were all accurate to the first decimal place and the average score was adopted to calculate the comprehensive score.


## 3. Results and Discussion

### 3.1. Personal Information of Participants

The questionnaires were distributed to 550 drivers and 510 drivers responded; the response rate of 93% was achieved. The major results were that (a) 57% participants were male; (b) most participants (72%) were in the age group of 26–50 years, 19% were in the age group of 18–25 years, and 9% were in the age group of over 50 years; (c) 80% participants had the education level of university or above; (d) 74% participants had more than 2-year licenses. The large proportion of highly educated participants promoted the accuracy of results according to the conclusion that drivers with higher levels of education background presented better comprehension [13].


### 3.2. Statistical Analysis of Questionnaire

(1) Internal Consistency Reliability. Cronbach’s alpha is considered an adequate measure of internal consistency. Cronbach’s alpha was calculated for each scale separately (shown in Table 4), and all statistical analysis was performed using the Statistical Package for the Social Science (SPSS). A low Cronbach’s alpha indicates a lack of correlation between the items in a scale, which makes summarizing the items unjustified. Conventionally, values from 0.6 to 0.7 are acceptable, whereas values greater than 0.7 are good [14].Table 4
Cronbach’s alpha for each scale.
Scale
Cronbach’s alpha
Reliability
Rule layer
0.790
Good
Setting form and position
0.648
Acceptable
Layout and font
0.704
Good
Color, reflection, and illumination
0.713
Good
Overall layer
0.806
Good(2) Construct Validity. A factor analysis was made to verify the construct validity of questionnaire. The Kaiser-Meyer-Olkin Measure of Sampling Adequacy (KMO) and Bartlett’s Test of Sphericity were created to test if the dataset was suitable for factor analysis [15]. The results (Table 5) showed that it was practical to make factor analysis (KMO > 0.5 and P
<
0.05). The factor analysis was done using Principle Components Analysis in the statistical program SPSS. Due to space limitations, only the result of rule layer was given and illustrated with the original output of SPSS 19.0 (shown in Table 6).Table 5
Results of KMO and Bartlett’s Test.
Scale
KMO
Probability
Rule layer
0.653
0
Setting form and position
0.686
0
Layout and font
0.691
0
Color, reflection, and illumination
0.618
0
Overall layer
0.547
0Table 6
Results of factor analysis.
(a)
KMO and Bartlett’s Test
Kaiser-Meyer-Olkin Measure of Sampling Adequacy
.653
Bartlett’s Test of Sphericity
Approx. Chi-Square
57.931
df
3
Sig.
.000
(b)
Communalities
Initial
Extraction
VAR00001
1.000
.841
VAR00002
1.000
.696
VAR00003
1.000
.676
Extraction method: Principal Component Analysis.
(c)
Total variance explained
Component
Initial eigenvalues
Extraction sums of squared loadings
Total
% of variance
Cumulative %
Total
% of variance
Cumulative %
1
2.213
73.774
73.774
2.213
73.774
73.774
2
.531
17.713
91.486
3
.255
8.514
100.000
Extraction method: Principal Component Analysis.


### 3.3. Weights of Influence Factors

Weights of rule layer reflected the significance of different categories, and weights of index layer described the relative importance of different factors in the same category, while the comprehensive weights presented an overall comparison. Weights were all accurate to the third decimal place (Table7). Due to the tedious process of calculation, results of consistency check were not included here.Table 7
Weights of different influence factors.
Weight of rule layer (W
i)
Influence factor
Weight of index layer (W
i
j)
Comprehension weight
Setting form and position (W
1
=
0.414)
Setting position
0.338
0.140
Sign number in one place
0.185
0.077
Occlusion degree
0.313
0.130
Sign height
0.164
0.068
Layout and font (W
2
=
0.345)
Character size
0.367
0.127
Character number
0.306
0.106
Information complexity
0.327
0.113
Color, reflection, and illumination (W
3
=
0.241)
Indistinct degree
0.339
0.082
Reflection performance
0.244
0.059
Illumination equipment
0.226
0.054
Color contrast
0.191
0.046


### 3.4. Evaluation Model

(1) Calculation of Comprehensive Score.Substituting weights of index layer and rule layer into (1) yielded(2)
F
1
=
0.338
F
11
+
0.185
F
12
+
0.313
F
13
+
0.164
F
14
,
F
2
=
0.367
F
21
+
0.306
F
22
+
0.327
F
23
,
F
3
=
0.339
F
31
+
0.244
F
32
+
0.226
F
33
+
0.191
F
34
,
G
Q
I
=
0.414
F
1
+
0.345
F
2
+
0.241
F
3
.(2) Grading of Guide Sign Recognition.The comprehensive score was divided into five grades corresponding to different levels of recognition (Table 8).Table 8
Grading of guide sign recognition.
Level
Comprehensive score (GQI)
Color
Evaluation
A
4.0~5.0
Green
Very good
B
3.0~4.0
Blue
Good
C
2.0~3.0
Yellow
Ordinary
D
1.0~2.0
Orange
Poor
E
<1.0
Red
Very poor


### 3.5. Case Evaluation

(1) Scores of Index.The method adopted here combined with qualitative evaluation and quantitative calculation; the results (shown in Table 9) presented an objective comparison between the two guide signs.Table 9
Scores of evaluation index.
Index
Score
Before reconstruction
After reconstruction
Setting position
2.6
2.6
Sign number in one place
1.2
1.8
Occlusion degree
4.8
4.9
Sign height
4.2
4.5
Character size
0.8
4.3
Character number
0.6
1.8
Information complexity
0.9
1.7
Indistinct degree
4.4
4.8
Reflection performance
4.2
4.5
Illumination equipment
3.9
4.2
Color contrast
4.1
4.4(2) Level of Recognition.Based on model (2) and scores of evaluation index (see Table 9), the comprehensive scores of the two guide signs were obtained (Table 10). The result shows that the reconstruction project has improved its recognition to some degree. However, the level of recognition after reconstruction is “B” rather than “A”; it seems to not be so satisfactory as expected. The reasons may be as follows: (a) too many destinations increase the complexity of information; (b) different kinds of traffic signs may weaken drivers’ recognition.Table 10
Level of recognition.
Guide sign
Comprehensive score
Level
Evaluation
Before reconstruction
2.6
C
Ordinary
After reconstruction
3.5
B
Good(3) Further Improvement.In order to give drivers plenty of time to understand information and take effective measures, they should be noticed in advance. Therefore, two ways may contribute to the improvement of guide sign recognition: (a) a sign in advance would be effective according to the conclusion that early warnings should be used for reduced recognition [16]; (b) the regulatory sign should be moved to the entrance of the road so that drivers can take measures earlier and avoid wasting time.


### 3.6. Limitations

Despite the success of revealing importance of different influence factors and establishing an evaluation model of guide sign recognition, there were several limitations to the experimental design used in this study. First, the sample size of questionnaire survey is not enough due to the large number of drivers in Nanjing. However, at least, it shed some light on the topic. Second, there are many factors that can affect guide sign recognition and only 11 factors were selected to survey. Third, the improvement of guide sign has not been studied in detail; it would be the focus of future research. Fourth, warning signs and regulatory signs are as important as guide sign; they should be considered in later study.


## 3.1. Personal Information of Participants

The questionnaires were distributed to 550 drivers and 510 drivers responded; the response rate of 93% was achieved. The major results were that (a) 57% participants were male; (b) most participants (72%) were in the age group of 26–50 years, 19% were in the age group of 18–25 years, and 9% were in the age group of over 50 years; (c) 80% participants had the education level of university or above; (d) 74% participants had more than 2-year licenses. The large proportion of highly educated participants promoted the accuracy of results according to the conclusion that drivers with higher levels of education background presented better comprehension [13].


## 3.2. Statistical Analysis of Questionnaire

(1) Internal Consistency Reliability. Cronbach’s alpha is considered an adequate measure of internal consistency. Cronbach’s alpha was calculated for each scale separately (shown in Table 4), and all statistical analysis was performed using the Statistical Package for the Social Science (SPSS). A low Cronbach’s alpha indicates a lack of correlation between the items in a scale, which makes summarizing the items unjustified. Conventionally, values from 0.6 to 0.7 are acceptable, whereas values greater than 0.7 are good [14].Table 4
Cronbach’s alpha for each scale.
Scale
Cronbach’s alpha
Reliability
Rule layer
0.790
Good
Setting form and position
0.648
Acceptable
Layout and font
0.704
Good
Color, reflection, and illumination
0.713
Good
Overall layer
0.806
Good(2) Construct Validity. A factor analysis was made to verify the construct validity of questionnaire. The Kaiser-Meyer-Olkin Measure of Sampling Adequacy (KMO) and Bartlett’s Test of Sphericity were created to test if the dataset was suitable for factor analysis [15]. The results (Table 5) showed that it was practical to make factor analysis (KMO > 0.5 and P
<
0.05). The factor analysis was done using Principle Components Analysis in the statistical program SPSS. Due to space limitations, only the result of rule layer was given and illustrated with the original output of SPSS 19.0 (shown in Table 6).Table 5
Results of KMO and Bartlett’s Test.
Scale
KMO
Probability
Rule layer
0.653
0
Setting form and position
0.686
0
Layout and font
0.691
0
Color, reflection, and illumination
0.618
0
Overall layer
0.547
0Table 6
Results of factor analysis.
(a)
KMO and Bartlett’s Test
Kaiser-Meyer-Olkin Measure of Sampling Adequacy
.653
Bartlett’s Test of Sphericity
Approx. Chi-Square
57.931
df
3
Sig.
.000
(b)
Communalities
Initial
Extraction
VAR00001
1.000
.841
VAR00002
1.000
.696
VAR00003
1.000
.676
Extraction method: Principal Component Analysis.
(c)
Total variance explained
Component
Initial eigenvalues
Extraction sums of squared loadings
Total
% of variance
Cumulative %
Total
% of variance
Cumulative %
1
2.213
73.774
73.774
2.213
73.774
73.774
2
.531
17.713
91.486
3
.255
8.514
100.000
Extraction method: Principal Component Analysis.


## 3.3. Weights of Influence Factors

Weights of rule layer reflected the significance of different categories, and weights of index layer described the relative importance of different factors in the same category, while the comprehensive weights presented an overall comparison. Weights were all accurate to the third decimal place (Table7). Due to the tedious process of calculation, results of consistency check were not included here.Table 7
Weights of different influence factors.
Weight of rule layer (W
i)
Influence factor
Weight of index layer (W
i
j)
Comprehension weight
Setting form and position (W
1
=
0.414)
Setting position
0.338
0.140
Sign number in one place
0.185
0.077
Occlusion degree
0.313
0.130
Sign height
0.164
0.068
Layout and font (W
2
=
0.345)
Character size
0.367
0.127
Character number
0.306
0.106
Information complexity
0.327
0.113
Color, reflection, and illumination (W
3
=
0.241)
Indistinct degree
0.339
0.082
Reflection performance
0.244
0.059
Illumination equipment
0.226
0.054
Color contrast
0.191
0.046


## 3.4. Evaluation Model

(1) Calculation of Comprehensive Score.Substituting weights of index layer and rule layer into (1) yielded(2)
F
1
=
0.338
F
11
+
0.185
F
12
+
0.313
F
13
+
0.164
F
14
,
F
2
=
0.367
F
21
+
0.306
F
22
+
0.327
F
23
,
F
3
=
0.339
F
31
+
0.244
F
32
+
0.226
F
33
+
0.191
F
34
,
G
Q
I
=
0.414
F
1
+
0.345
F
2
+
0.241
F
3
.(2) Grading of Guide Sign Recognition.The comprehensive score was divided into five grades corresponding to different levels of recognition (Table 8).Table 8
Grading of guide sign recognition.
Level
Comprehensive score (GQI)
Color
Evaluation
A
4.0~5.0
Green
Very good
B
3.0~4.0
Blue
Good
C
2.0~3.0
Yellow
Ordinary
D
1.0~2.0
Orange
Poor
E
<1.0
Red
Very poor


## 3.5. Case Evaluation

(1) Scores of Index.The method adopted here combined with qualitative evaluation and quantitative calculation; the results (shown in Table 9) presented an objective comparison between the two guide signs.Table 9
Scores of evaluation index.
Index
Score
Before reconstruction
After reconstruction
Setting position
2.6
2.6
Sign number in one place
1.2
1.8
Occlusion degree
4.8
4.9
Sign height
4.2
4.5
Character size
0.8
4.3
Character number
0.6
1.8
Information complexity
0.9
1.7
Indistinct degree
4.4
4.8
Reflection performance
4.2
4.5
Illumination equipment
3.9
4.2
Color contrast
4.1
4.4(2) Level of Recognition.Based on model (2) and scores of evaluation index (see Table 9), the comprehensive scores of the two guide signs were obtained (Table 10). The result shows that the reconstruction project has improved its recognition to some degree. However, the level of recognition after reconstruction is “B” rather than “A”; it seems to not be so satisfactory as expected. The reasons may be as follows: (a) too many destinations increase the complexity of information; (b) different kinds of traffic signs may weaken drivers’ recognition.Table 10
Level of recognition.
Guide sign
Comprehensive score
Level
Evaluation
Before reconstruction
2.6
C
Ordinary
After reconstruction
3.5
B
Good(3) Further Improvement.In order to give drivers plenty of time to understand information and take effective measures, they should be noticed in advance. Therefore, two ways may contribute to the improvement of guide sign recognition: (a) a sign in advance would be effective according to the conclusion that early warnings should be used for reduced recognition [16]; (b) the regulatory sign should be moved to the entrance of the road so that drivers can take measures earlier and avoid wasting time.


## 3.6. Limitations

Despite the success of revealing importance of different influence factors and establishing an evaluation model of guide sign recognition, there were several limitations to the experimental design used in this study. First, the sample size of questionnaire survey is not enough due to the large number of drivers in Nanjing. However, at least, it shed some light on the topic. Second, there are many factors that can affect guide sign recognition and only 11 factors were selected to survey. Third, the improvement of guide sign has not been studied in detail; it would be the focus of future research. Fourth, warning signs and regulatory signs are as important as guide sign; they should be considered in later study.


## 4. Conclusion

The experiment was successful in studying the specific effects of different influence factors and the evaluation model of guide sign recognition with a convenience sample of drivers in Nanjing. There were some limitations in the study and some of the very basic questions need further research. Nevertheless, the findings provided the following useful information for helping researchers understand how factors affect guide sign recognition and propose effective measures.(1)
Among the 11 factors surveyed in this study, the setting position, occlusion degree, and character size of guide sign had the most significant influence on its recognition, and weights of them were 0.140, 0.130, and 0.127, respectively.
(2)
The evaluation model of guide sign recognition was based on AHP method and questionnaire survey; the comprehensive score was given by (2). In consideration of the traffic environment, cost, and some other factors, the level of “B” or above would be acceptable.
(3)
The recognition level of the case in this study was raised from “C” to “B”; namely, its recognition was distinctly improved because of the reconstruction project.



---

*Source: 808151-2015-09-07.xml*