# Using Hybrid Model to Evaluate Performance of Innovation and Technology Professionals in Marine Logistics Industry

Authors: Qunzhen Qu; Kuan-Yu Chen; Yu-Min Wei; Yanjun Liu; Sang-Bing Tsai; Weiwei Dong
Journal: Mathematical Problems in Engineering
 (2015)

---

## Abstract

With the development of marine logistics industry to grow, the government and corporate more and more attach importance to the performance evaluation of innovation and technology professionals. Combine the characteristics of marine logistics industry and innovative technology professionals to design a performance evaluation index of marine logistics industry in innovation and technology professionals, with the Analytic Hierarchy Process (AHP) to determine the weights of the various performance indicatorsf and through the establishment of fuzzy comprehensive evaluation model to make the problems of complex performance evaluation quantification and then come to their performance evaluation results, and provide reference methods and recommendations for innovation and technology professionals in performance evaluation theory and practice of marine logistics industry.


---

## Body

## 1. Introduction

Marine logistics industry is an important part of marine industries, which refers to using of the sea water, ocean space, or sea products as the production process of logistics industry, including ocean transportation, port handling, warehousing, port value-added services, and wholesale and retail trade industry. It plays a very important role in the development of marine economy [1–3]. Under the vigorous opportunity of construction of international shipping center and innovation and technology professionals as the high-end talent, its performance evaluation system for the whole development situation has practical application value. Innovation and technology professionals refer to those who have high scientific quality, breaking through the existing theory, viewpoint, method, and technique in order to obtain the creative achievements and through the creative scientific research achievements to promote scientific and technological progress and contribute to social development and human progress [4, 5]. President Hu Jin-tao discussed the importance of innovation and technology professionals’ development in China in the Chinese Academy of Sciences and Chinese Academy of Engineering Academician Conference, held firmly and consistently to train innovation and technology professionals, which is the inevitable requirement of improving the independent innovation ability and the building of an innovative country. We must adhere to the talent resource as the first resource of strategic thinking, stepping up construction of innovation and technology professionals team [5].


## 2. Performance Evaluation of Marine Logistics Industry in Innovation and Technology Professionals

### 2.1. Design of Performance Evaluation System

The performance evaluation of innovation and technology professionals is a comprehensive, complex problem affected by multiple indicators. The establishment of evaluation index should follow the “organizational goals consistency,” “the reliability and validity,” “integrity and controllability,” and the principle of “combining the scientific nature and operability” [2, 3]. There is plenty of literature review and a lot of experience for performance evaluation, combined with the existence of the innovative talents of science and technology and the characteristics of marine logistics industry, based on key performance indicators (KPI) and objective management, from the three aspects of job performance, work ability, and work attitude, to design the innovative talents of science and technology’s performance evaluation index of marine logistics industry.


### 2.2. The Construction of Performance Evaluation Index

#### 2.2.1. Job Performance

The performance index is generated by the working behavior results, which directly reflects the ultimate goal of performance management. These indicators can be the key job responsibilities for the position or a stage of the project and also be a year’s comprehensive performance [6, 7], according to the characteristics of the marine logistics industry and the innovative talents of science and technology, which can be designed from the two aspects of funding and technical profit and customer satisfaction. From the perspective of funding and technical profit, it mainly reflects that the scientific and technological personnel through innovative research developed product or project to gain national recognition and use, at the same time, advances in technology which can bring benefits to the enterprise and cost savings, mainly selecting the research funding of national gift or related equipment, new technology to reduce the cost of the contribution rate, project implementation conversion rate, scientific and technological achievements conversion rate, and the budget rate of research funding as five tertiary indicators. From the perspective of customer satisfaction, it mainly reflects whether the customer is satisfied with the product and project of research or not and whether there is an effect on promoting the status of enterprise in the industry or not, mainly selecting the customer market share and customer complaint rate as two tertiary indicators.


#### 2.2.2. Work Ability

Work ability index which reflects a person in a position of a set of standardized requirements (different position needs different abilities) according to the characteristics of the innovative talents of science and technology can be designed from social influence competence (social), core competence (enterprise), and the ability of studying development (itself). From the social perspective, it mainly reflects its research results’ influence on the whole social, mainly selecting the number of papers by SCI, EI, and ISTP retrieval, the number of published works, reputation in the industry, success rate of project application, and teaching students’ satisfaction as five tertiary indicators. From the perspective of enterprise, it reflects that the core competence of talents of science and technology has to bring benefits to the enterprise, mainly selecting the scientific research ability, keen insight and flexibility, logical thinking ability, innovation ability, and business expansion ability as five tertiary indicators. From the perspective of itself, it reflects the talents of science and technology through their own efforts to learn about the development situation of domestic and foreign industry and bring more people to understand and enter the marine logistics industry, in order to provide the excellent talents for the long-term development of enterprises, mainly selecting the number of people entering the international academic conference, number of people studying abroad, number of training and mining ocean logistics staff, number of marine logistics lectures and participants, and the building of marine logistics team as five tertiary indicators.


#### 2.2.3. Work Attitude

Work attitude reflects the tendencies of personnel for the behavioral evaluation, according to the characteristics of the innovative talents of science and technology, which can be designed from the two aspects of job satisfaction and the team cooperation. Job satisfaction reflects, in the process of working in the organization, benign feelings of mental state for the work itself and its related aspects, mainly selecting the confidentiality, sense of responsibility, enthusiasm for work, and discipline for projects of the new marine logistics industry as four tertiary indicators. Team cooperation reflects if team members have the consciousness of cooperation and communicate with each other, thus improving overall research and development ability. The sharing of knowledge and cooperation spirit are mainly selected as two tertiary indicators. In an ordered form, the index for performance evaluation of marine logistics industry in innovation and technology professionals is shown in Table1.Table 1
Index for performance evaluation of marine logistics industry in innovation and technology professionals.
Goal indicators
Level indicators
Secondary indicators
Tertiary indicators
Performance of marine logistics industry      in innovation and technology professionalsV
Job performanceV
1
Funding and technical profitV
11
Research funding of national gift or related equipmentV
111
New technology to reduce the cost of the contribution rateV
112
Project implementation conversion rateV
113
Scientific and technological achievements conversion rateV
114
Budget rate of research fundingV
115
Customer satisfactionV
12
Customer market shareV
121
Customer complaint rateV
122
Work abilityV
2
Social influence competenceV
21
Number of papers by SCI, EI, and ISTP retrievalV
211
Number of published worksV
212
Reputation in the industryV
213
Success rate of project applicationV
214
Teaching students' satisfactionV
215
Core competenceV
22
Scientific research abilityV
221
Keen insight and flexibilityV
222
Logical thinking abilityV
223
Innovation abilityV
224
Business expansion abilityV
225
Ability of studying developmentV
23
Number of people entering the international academic conferenceV
231
Number of people studying abroadV
232
Number of training and mining ocean logistics staffV
233
Number of marine logistics lectures and participantsV
234
Building of marine logistics teamV
235
Work attitudeV
3
Job satisfactionV
31
ConfidentialityV
311
Sense of responsibilityV
312
Enthusiasm for workV
313
DisciplineV
314
Team cooperationV
32
Sharing of knowledgeV
321
Cooperation spiritV
322


## 2.1. Design of Performance Evaluation System

The performance evaluation of innovation and technology professionals is a comprehensive, complex problem affected by multiple indicators. The establishment of evaluation index should follow the “organizational goals consistency,” “the reliability and validity,” “integrity and controllability,” and the principle of “combining the scientific nature and operability” [2, 3]. There is plenty of literature review and a lot of experience for performance evaluation, combined with the existence of the innovative talents of science and technology and the characteristics of marine logistics industry, based on key performance indicators (KPI) and objective management, from the three aspects of job performance, work ability, and work attitude, to design the innovative talents of science and technology’s performance evaluation index of marine logistics industry.


## 2.2. The Construction of Performance Evaluation Index

### 2.2.1. Job Performance

The performance index is generated by the working behavior results, which directly reflects the ultimate goal of performance management. These indicators can be the key job responsibilities for the position or a stage of the project and also be a year’s comprehensive performance [6, 7], according to the characteristics of the marine logistics industry and the innovative talents of science and technology, which can be designed from the two aspects of funding and technical profit and customer satisfaction. From the perspective of funding and technical profit, it mainly reflects that the scientific and technological personnel through innovative research developed product or project to gain national recognition and use, at the same time, advances in technology which can bring benefits to the enterprise and cost savings, mainly selecting the research funding of national gift or related equipment, new technology to reduce the cost of the contribution rate, project implementation conversion rate, scientific and technological achievements conversion rate, and the budget rate of research funding as five tertiary indicators. From the perspective of customer satisfaction, it mainly reflects whether the customer is satisfied with the product and project of research or not and whether there is an effect on promoting the status of enterprise in the industry or not, mainly selecting the customer market share and customer complaint rate as two tertiary indicators.


### 2.2.2. Work Ability

Work ability index which reflects a person in a position of a set of standardized requirements (different position needs different abilities) according to the characteristics of the innovative talents of science and technology can be designed from social influence competence (social), core competence (enterprise), and the ability of studying development (itself). From the social perspective, it mainly reflects its research results’ influence on the whole social, mainly selecting the number of papers by SCI, EI, and ISTP retrieval, the number of published works, reputation in the industry, success rate of project application, and teaching students’ satisfaction as five tertiary indicators. From the perspective of enterprise, it reflects that the core competence of talents of science and technology has to bring benefits to the enterprise, mainly selecting the scientific research ability, keen insight and flexibility, logical thinking ability, innovation ability, and business expansion ability as five tertiary indicators. From the perspective of itself, it reflects the talents of science and technology through their own efforts to learn about the development situation of domestic and foreign industry and bring more people to understand and enter the marine logistics industry, in order to provide the excellent talents for the long-term development of enterprises, mainly selecting the number of people entering the international academic conference, number of people studying abroad, number of training and mining ocean logistics staff, number of marine logistics lectures and participants, and the building of marine logistics team as five tertiary indicators.


### 2.2.3. Work Attitude

Work attitude reflects the tendencies of personnel for the behavioral evaluation, according to the characteristics of the innovative talents of science and technology, which can be designed from the two aspects of job satisfaction and the team cooperation. Job satisfaction reflects, in the process of working in the organization, benign feelings of mental state for the work itself and its related aspects, mainly selecting the confidentiality, sense of responsibility, enthusiasm for work, and discipline for projects of the new marine logistics industry as four tertiary indicators. Team cooperation reflects if team members have the consciousness of cooperation and communicate with each other, thus improving overall research and development ability. The sharing of knowledge and cooperation spirit are mainly selected as two tertiary indicators. In an ordered form, the index for performance evaluation of marine logistics industry in innovation and technology professionals is shown in Table1.Table 1
Index for performance evaluation of marine logistics industry in innovation and technology professionals.
Goal indicators
Level indicators
Secondary indicators
Tertiary indicators
Performance of marine logistics industry      in innovation and technology professionalsV
Job performanceV
1
Funding and technical profitV
11
Research funding of national gift or related equipmentV
111
New technology to reduce the cost of the contribution rateV
112
Project implementation conversion rateV
113
Scientific and technological achievements conversion rateV
114
Budget rate of research fundingV
115
Customer satisfactionV
12
Customer market shareV
121
Customer complaint rateV
122
Work abilityV
2
Social influence competenceV
21
Number of papers by SCI, EI, and ISTP retrievalV
211
Number of published worksV
212
Reputation in the industryV
213
Success rate of project applicationV
214
Teaching students' satisfactionV
215
Core competenceV
22
Scientific research abilityV
221
Keen insight and flexibilityV
222
Logical thinking abilityV
223
Innovation abilityV
224
Business expansion abilityV
225
Ability of studying developmentV
23
Number of people entering the international academic conferenceV
231
Number of people studying abroadV
232
Number of training and mining ocean logistics staffV
233
Number of marine logistics lectures and participantsV
234
Building of marine logistics teamV
235
Work attitudeV
3
Job satisfactionV
31
ConfidentialityV
311
Sense of responsibilityV
312
Enthusiasm for workV
313
DisciplineV
314
Team cooperationV
32
Sharing of knowledgeV
321
Cooperation spiritV
322


## 2.2.1. Job Performance

The performance index is generated by the working behavior results, which directly reflects the ultimate goal of performance management. These indicators can be the key job responsibilities for the position or a stage of the project and also be a year’s comprehensive performance [6, 7], according to the characteristics of the marine logistics industry and the innovative talents of science and technology, which can be designed from the two aspects of funding and technical profit and customer satisfaction. From the perspective of funding and technical profit, it mainly reflects that the scientific and technological personnel through innovative research developed product or project to gain national recognition and use, at the same time, advances in technology which can bring benefits to the enterprise and cost savings, mainly selecting the research funding of national gift or related equipment, new technology to reduce the cost of the contribution rate, project implementation conversion rate, scientific and technological achievements conversion rate, and the budget rate of research funding as five tertiary indicators. From the perspective of customer satisfaction, it mainly reflects whether the customer is satisfied with the product and project of research or not and whether there is an effect on promoting the status of enterprise in the industry or not, mainly selecting the customer market share and customer complaint rate as two tertiary indicators.


## 2.2.2. Work Ability

Work ability index which reflects a person in a position of a set of standardized requirements (different position needs different abilities) according to the characteristics of the innovative talents of science and technology can be designed from social influence competence (social), core competence (enterprise), and the ability of studying development (itself). From the social perspective, it mainly reflects its research results’ influence on the whole social, mainly selecting the number of papers by SCI, EI, and ISTP retrieval, the number of published works, reputation in the industry, success rate of project application, and teaching students’ satisfaction as five tertiary indicators. From the perspective of enterprise, it reflects that the core competence of talents of science and technology has to bring benefits to the enterprise, mainly selecting the scientific research ability, keen insight and flexibility, logical thinking ability, innovation ability, and business expansion ability as five tertiary indicators. From the perspective of itself, it reflects the talents of science and technology through their own efforts to learn about the development situation of domestic and foreign industry and bring more people to understand and enter the marine logistics industry, in order to provide the excellent talents for the long-term development of enterprises, mainly selecting the number of people entering the international academic conference, number of people studying abroad, number of training and mining ocean logistics staff, number of marine logistics lectures and participants, and the building of marine logistics team as five tertiary indicators.


## 2.2.3. Work Attitude

Work attitude reflects the tendencies of personnel for the behavioral evaluation, according to the characteristics of the innovative talents of science and technology, which can be designed from the two aspects of job satisfaction and the team cooperation. Job satisfaction reflects, in the process of working in the organization, benign feelings of mental state for the work itself and its related aspects, mainly selecting the confidentiality, sense of responsibility, enthusiasm for work, and discipline for projects of the new marine logistics industry as four tertiary indicators. Team cooperation reflects if team members have the consciousness of cooperation and communicate with each other, thus improving overall research and development ability. The sharing of knowledge and cooperation spirit are mainly selected as two tertiary indicators. In an ordered form, the index for performance evaluation of marine logistics industry in innovation and technology professionals is shown in Table1.Table 1
Index for performance evaluation of marine logistics industry in innovation and technology professionals.
Goal indicators
Level indicators
Secondary indicators
Tertiary indicators
Performance of marine logistics industry      in innovation and technology professionalsV
Job performanceV
1
Funding and technical profitV
11
Research funding of national gift or related equipmentV
111
New technology to reduce the cost of the contribution rateV
112
Project implementation conversion rateV
113
Scientific and technological achievements conversion rateV
114
Budget rate of research fundingV
115
Customer satisfactionV
12
Customer market shareV
121
Customer complaint rateV
122
Work abilityV
2
Social influence competenceV
21
Number of papers by SCI, EI, and ISTP retrievalV
211
Number of published worksV
212
Reputation in the industryV
213
Success rate of project applicationV
214
Teaching students' satisfactionV
215
Core competenceV
22
Scientific research abilityV
221
Keen insight and flexibilityV
222
Logical thinking abilityV
223
Innovation abilityV
224
Business expansion abilityV
225
Ability of studying developmentV
23
Number of people entering the international academic conferenceV
231
Number of people studying abroadV
232
Number of training and mining ocean logistics staffV
233
Number of marine logistics lectures and participantsV
234
Building of marine logistics teamV
235
Work attitudeV
3
Job satisfactionV
31
ConfidentialityV
311
Sense of responsibilityV
312
Enthusiasm for workV
313
DisciplineV
314
Team cooperationV
32
Sharing of knowledgeV
321
Cooperation spiritV
322


## 3. The Construction of Model for Performance Evaluation of Marine Logistics Industry in Innovation and Technology Professionals

In the study of performance evaluation system, many scholars use different evaluation methods, such as the Analytic Hierarchy Process, Grey Correlation Evaluation Method, Fuzzy Comprehensive Evaluation Method, Method of Data Envelopment, The Neural Network, and Factor Analysis Method. This research adopts the Analytic Hierarchy Process and Fuzzy Comprehensive Evaluation Method. In the early 1970s, the United States well-known operations research Professor Satty (T. L. Satty) at the University of Pittsburgh was the first to put forward the Analytic Hierarchy Process, making research on the theory and practical application of the Analytic Hierarchy Process in 1994 [8–11].For the determination of index weight, most studies used subjective judgment; it makes the degree of the indexes for evaluation lack logic and consistency. The Analytic Hierarchy Process (AHP) is a systematic method for multicriteria decision-making (MCDM). This method can be used to logically solve complex, unstructured economic, social, and managerial decision-making problems. To a great extent, this approach ensures that the results appraise evaluation logic and rationality and reduce the interference of subjective factors and then make the weights of index system of incline reasonable, in order to improve the accuracy of the appraisal [12–14]. At the meantime, because specialists have different opinion on performance evaluation of marine logistics industry in innovation and technology professionals, it is difficult to directly use statistical methods to determine the specific judgment value of these factors; therefore, based on the above reasons, this research adopts the Analytic Hierarchy Process and Fuzzy Comprehensive Evaluation Method.


### 3.1. Build Mathematical Model

The mathematical model is as follows:(1)
Establish quantitative scale of importance and determine the relative importance of various factors and quantitative index.
(2)
It is the hierarchical evaluation index.
(3)
It is made by the experts of the relative importance between various factors and then in accordance with Satty’s 1~9 scales [8, 15, 16] to assign the value and statistics experts’ opinions and compare the results of the relative importance of the various factors and fill in the judgment matrix.
(4)
Calculate the weight of each factor.
(5)
Check consistency.
(6)
Build the evaluation set.U
=
U
1
,
U
2
,
…
,
U
m, and, among them, U
1
,
U
2
,
…
,
U
m, means m kinds of comments; for example, U
=
e
x
c
e
l
l
e
n
t
,
g
o
o
d
,
m
e
d
i
u
m
,
p
a
s
s
i
n
g
,
f
a
i
l.
(7)
Build factor set, divided into a subset of the factors setV, as a set of second-level factors V
=
V
1
,
V
2
,
…
,
V
n and as V
i
=
V
i
1
,
V
i
2
,
…
,
V
i
k
i, i
=
1,2
,
…
,
n.
(8)
Determine the weight of evaluation index.W
=
W
1
,
W
2
,
…
,
W
m, ∑
k
=
1
m
W
=
1, and 0
<
W
k
<
1. Among them, W represents m factors index made by (
W
1
,
W
2
,
…
,
W
m
).
(9)
Build evaluation matrix. Assume thei’s single factor evaluation vector is R
i
=
r
i
1
,
r
i
2
,
…
,
r
i
m; it can be seen as a fuzzy subset of U, and it means the degree of membership of the i factor evaluation for the k level; n factors evaluation matrix is(1)
R
1
R
2
⋮
R
4
=
r
11
r
12
⋯
r
1
m
r
21
r
22
⋯
r
2
m
⋮
⋮
⋮
r
n
1
r
n
2
⋯
r
n
m
.
(10)
Comprehensive evaluation: in determining the membership matrixR and evaluation of vector W, we can use the comprehensive evaluation of fuzzy transformation: B
=
W
∘
R, where “∘” on behalf of the operation is “choosing big or small” operator. In the four common models—M
=
∧
,
∨—make B
=
b
1
,
b
2
,
…
,
b
m
=
A
∘
R, b
j
=
∨
a
i
∧
r
i
j
= max
⁡
m
i
n
a
1
,
r
1
j
,
m
i
n
a
2
,
r
2
j
,
…
,
m
i
n
a
n
,
r
n
j.


### 3.2. Case Study

The Shanghai performance of marine logistics industry in innovation and technology professionals, according to the above index of performance evaluation system, gives a sample to illustrate the application of the Analytic Hierarchy Process and Fuzzy Comprehensive Evaluation Method [17–19]:(1) Establish the importance of the quantitative scale: “1” represents equally important, that is, the same importance as the two indicators; “3” represents more important, that is, an indicator of a little more importance than another; “5” represents obviously important, an indicator with another indicator which has obvious importance; “7” represents very important, that is, very important compared to an indicator with another indicator; “9” represents absolute importance, that is, an indicator of the importance of completely overwhelming another indicator. In the study, the Analytic Hierarchy Process is with a ratio of 1 to 9 scales, because this ratio is more in line with people’s mental habits during judgment [20–22].(2) Statistics expert’s scoring on the importance of the evaluation elements builds a judgment matrix, as the funding and technical profitV
11, Table 2.Table 2
The judge matrix ofV
11’ subfactors.
FactorV
11
V
111
V
112
V
113
V
114
V
115
V
111
1
1/3
1/5
1/7
1/3
V
112
3
1
1/5
1/5
3
V
113
5
5
1
1/3
3
V
114
7
5
3
1
7
V
115
3
1/3
1/3
1/7
1(3) Calculating the weight, element normalization, and each row is as shown in Table3.Table 3
Evaluation results ofV
11’  subfactors.
Project
Normalized results
Sum of rows
Weight
V
111
0.05
0.03
0.04
0.08
0.02
0.22
0.044
V
112
0.16
0.08
0.04
0.11
0.21
0.6
0.12
V
113
0.26
0.43
0.21
0.18
0.21
1.29
0.258
V
114
0.37
0.43
0.64
0.55
0.49
2.48
0.496
V
115
0.16
0.03
0.07
0.08
0.07
0.41
0.082(4) Check the consistency of the matrix.For the consistency of the matrix, we can make simple estimates, making weighted vector right by judgment matrix, and then get a new vector. And then, in turn, we use this new vector of each weight divided by the corresponding weight vector component and then get a new vector, divided by the number of components; getting the value is the maximum characteristic approximation (λ
m
a
x); this value is much closer to the consistency of judgment matrix which is better [23–27]. Using this method to get λ
m
a
x of V
11 factors approximation is 5.38, and the matrix of order number 5 suggests that the consistency of expert scoring is higher; the result is reasonable and effective.(5) The same as above, get the weight of each factor, such as in Table4. At the same time, by calculating the λ
m
a
x values close to the order number, show that the results are reasonable and effective.Table 4
The weight of each factor and its subfactors.
Project
Weight
V
1
0.63
V
2
0.26
V
3
0.11
V
11
0.75
V
12
0.25
V
121
0.83
V
122
0.17
V
211
0.114
V
212
0.076
V
213
0.226
V
221
0.31
V
222
0.15
V
223
0.15
V
224
0.47
V
225
0.04
V
231
0.066
V
232
0.132
V
233
0.504
V
234
0.034
V
235
0.264
V
311
0.29
V
312
0.49
V
313
0.15
V
314
0.07
V
21
0.2
V
214
0.532
V
215
0.052
V
321
0.25
V
322
0.75
V
31
0.75
V
32
0.25
V
22
0.6
V
23
0.2(6) Build the evaluation set. The results of the evaluation of each indicator for performance evaluation of marine logistics industry in innovation and technology professionals are divided into 5 levels—excellent, good, medium, general, and poor—and then this performance evaluation of marine logistics industry in innovation and technology professionals’ remark set isU
=
e
x
c
e
l
l
e
n
t
,
g
o
o
d
,
m
e
d
i
u
m
,
g
e
n
e
r
a
l
,
p
o
o
r.(7) Determine evaluation indicators and their weights. That performance evaluation of marine logistics industry in innovation and technology professionals includes two level indicators: the experts statistical results such as in Table5 and weight in the above application of Analytic Hierarchy Process which has been worked out.Table 5
Evaluation index weight and expert scoring results.
Indicators and weights
Excellent
Good
Medium
General
Poor
Job performanceV
1  (0.63)
Funding and technical profitV
11  (0.75)
Research funding of national gift or related equipmentV
111 (0.044)
1
3
3
2
1
New technology to reduce the cost of the contribution rateV
112 (0.12)
2
3
3
1
1
Project implementation conversion rateV
113 (0.258)
1
3
4
2
0
Scientific and technological achievements conversion rateV
114 (0.496)
2
2
3
2
1
Budget rate of research fundingV
115 (0.082)
1
4
2
2
1
Customer satisfactionV
12  (0.25)
Customer market shareV
121 (0.83)
2
3
2
1
1
Customer complaint rateV
122 (0.17)
3
2
3
1
1
Work abilityV
2  (0.26)
Social influence competenceV
21  (0.2)
Number of papers by SCI, EI, and ISTP retrievalV
211 (0.114)
3
4
2
1
0
Number of published worksV
212 (0.076)
2
3
3
2
0
Reputation in the industryV
213 (0.226)
1
2
3
2
2
Success rate of project applicationV
214 (0.532)
2
4
1
2
1
Teaching students’ satisfactionV
215 (0.052)
3
2
2
2
1
Core competenceV
22  (0.6)
Scientific research abilityV
221 (0.311)
2
3
3
1
1
Keen insight and flexibilityV
222 (0.152)
2
2
3
2
1
Logical thinking abilityV
223 (0.152)
2
1
4
2
1
Innovation abilityV
224 (0.469)
3
3
2
1
1
Business expansion abilityV
225 (0.038)
2
2
2
2
2
Ability of studying developmentV
23  (0.2)
Number of people entering the international academic conferenceV
231 (0.066)
3
3
2
1
1
Number of people studying abroadV
232 (0.132)
2
4
2
2
0
Number of training and mining ocean logistics staffV
233 (0.504)
2
3
4
1
0
Number of marine logistics lectures and participantsV
234 (0.034)
3
3
3
1
0
Building of marine logistics teamV
235 (0.264)
2
4
2
1
1
Work attitudeV
3  (0.11)
Job satisfactionV
31  (0.75)
ConfidentialityV
311 (0.29)
2
3
2
3
0
Sense of responsibilityV
312 (0.49)
4
3
1
1
1
Enthusiasm for workV
313 (0.15)
3
2
1
2
2
DisciplineV
314 (0.07)
3
3
1
2
1
Team cooperationV
32  (0.25)
Sharing of knowledgeV
321 (0.25)
4
2
2
1
1
Cooperation spiritV
322 (0.75)
2
4
3
1
0(8) Build three level indicators’ evaluation matrix. From Table5, for research funding of national gift or related equipment V
111, one expert thinks it is excellent, three consider it is good, three describe it as medium, two consider it general, and one thinks it be poor, so its evaluation index vector R
111
=
0.1
0.3
0.3
0.2
0.1; in the same way, funding and technical profit V
11 for other three indexes of evaluation vector in turn is(2)
R
112
=
0.2
0.3
0.3
0.1
0.1
,
R
113
=
0.1
0.3
0.4
0.2
0
,
R
114
=
0.2
0.2
0.3
0.2
0.1
,
R
115
=
0.1
0.4
0.2
0.2
0.1
,and then(3)
R
11
=
0.1
0.3
0.3
0.2
0.1
0.2
0.3
0.3
0.1
0.1
0.1
0.3
0.4
0.2
0
0.2
0.2
0.3
0.2
0.1
0.1
0.4
0.2
0.2
0.1
,and, in the same way,(4)
R
12
=
0.2
0.3
0.2
0.1
0.1
0.3
0.2
0.3
0.1
0.1
,
R
21
=
0.3
0.4
0.2
0.1
0
0.2
0.3
0.3
0.2
0
0.1
0.2
0.3
0.2
0.2
0.2
0.4
0.1
0.2
0.1
0.3
0.2
0.2
0.2
0.1
,
R
22
=
0.2
0.3
0.3
0.1
0.1
0.2
0.2
0.3
0.2
0.1
0.2
0.1
0.4
0.2
0.1
0.3
0.3
0.2
0.1
0.1
0.2
0.2
0.2
0.2
0.2
,
R
23
=
0.3
0.3
0.2
0.1
0.1
0.2
0.4
0.2
0.2
0
0.2
0.3
0.4
0.1
0
0.3
0.3
0.3
0.1
0
0.2
0.4
0.2
0.1
0.1
,
R
31
=
0.2
0.3
0.2
0.3
0
0.4
0.3
0.1
0.1
0.1
0.3
0.2
0.1
0.2
0.2
0.3
0.3
0.1
0.2
0.1
,
R
32
=
0.4
0.2
0.2
0.1
0.1
0.2
0.4
0.3
0.1
0
.(9) Build the secondary evaluation matrix. Table5 shows the three levels of indicators weight vector, respectively: (5)
W
11
=
0.044
0.12
0.258
0.496
0.082
,
W
12
=
0.83
0.17
,
W
21
=
0.114
0.076
0.226
0.532
0.052
,
W
22
=
0.311
0.152
0.152
0.469
0.038
,
W
23
=
0.066
0.132
0.504
0.034
0.264
,
W
31
=
0.29
0.49
0.15
0.07
,
W
32
=
0.25
0.75
.Based onB
=
W
∘
R, the following can be concluded:(6)
B
11
=
W
11
∘
R
11
=
0.044
0.12
0.258
0.496
0.082
∘
0.1
0.3
0.3
0.2
0.1
0.2
0.3
0.3
0.1
0.1
0.1
0.3
0.4
0.2
0
0.2
0.2
0.3
0.2
0.1
0.1
0.4
0.2
0.2
0.1
=
0.2
0.258
0.3
0.2
0.1
,
B
12
=
0.2
0.3
0.2
0.1
0.1
,
B
21
=
0.2
0.4
0.226
0.2
0.2
,
B
22
=
0.3
0.3
0.3
0.152
0.1
,
B
23
=
0.2
0.3
0.4
0.1
0.1
,
B
31
=
0.4
0.3
0.2
0.29
0.15
,
B
32
=
0.25
0.4
0.3
0.1
0.1
,and then(7)
R
1
=
0.2
0.258
0.3
0.2
0.1
0.2
0.3
0.2
0.1
0.1
,
R
2
=
0.2
0.4
0.226
0.2
0.2
0.3
0.3
0.3
0.152
0.1
0.2
0.3
0.4
0.1
0.1
,
R
3
=
0.4
0.3
0.2
0.29
0.15
0.25
0.4
0.3
0.1
0.1
.(10) Construction level evaluation matrix is(8)
W
1
=
0.75
0.25
,
W
2
=
0.2
0.6
0.2
,
W
3
=
0.75
0.25
,and then(9)
R
=
0.2
0.258
0.3
0.2
0.1
0.3
0.3
0.3
0.2
0.2
0.4
0.3
0.25
0.29
0.15
.(11) Calculate the final results of the evaluation.W
=
0.63
0.26
0.11; B
=
W
∘
R
=
0.26
0.26
0.3
0.2
0.2; by normalization, B
=
0.21
0.21
0.24
0.17
0.17.According to the principle of maximum degree of membership, that performance evaluation level of marine logistics industry in innovation and technology professionals is “medium.” From the view of the probability theory, about 21% of the experts believe that the performance is very good, 24% of the experts believe that it is medium, 17% of the experts believe that it is general, and 17% of the experts believe that it is poor.


## 3.1. Build Mathematical Model

The mathematical model is as follows:(1)
Establish quantitative scale of importance and determine the relative importance of various factors and quantitative index.
(2)
It is the hierarchical evaluation index.
(3)
It is made by the experts of the relative importance between various factors and then in accordance with Satty’s 1~9 scales [8, 15, 16] to assign the value and statistics experts’ opinions and compare the results of the relative importance of the various factors and fill in the judgment matrix.
(4)
Calculate the weight of each factor.
(5)
Check consistency.
(6)
Build the evaluation set.U
=
U
1
,
U
2
,
…
,
U
m, and, among them, U
1
,
U
2
,
…
,
U
m, means m kinds of comments; for example, U
=
e
x
c
e
l
l
e
n
t
,
g
o
o
d
,
m
e
d
i
u
m
,
p
a
s
s
i
n
g
,
f
a
i
l.
(7)
Build factor set, divided into a subset of the factors setV, as a set of second-level factors V
=
V
1
,
V
2
,
…
,
V
n and as V
i
=
V
i
1
,
V
i
2
,
…
,
V
i
k
i, i
=
1,2
,
…
,
n.
(8)
Determine the weight of evaluation index.W
=
W
1
,
W
2
,
…
,
W
m, ∑
k
=
1
m
W
=
1, and 0
<
W
k
<
1. Among them, W represents m factors index made by (
W
1
,
W
2
,
…
,
W
m
).
(9)
Build evaluation matrix. Assume thei’s single factor evaluation vector is R
i
=
r
i
1
,
r
i
2
,
…
,
r
i
m; it can be seen as a fuzzy subset of U, and it means the degree of membership of the i factor evaluation for the k level; n factors evaluation matrix is(1)
R
1
R
2
⋮
R
4
=
r
11
r
12
⋯
r
1
m
r
21
r
22
⋯
r
2
m
⋮
⋮
⋮
r
n
1
r
n
2
⋯
r
n
m
.
(10)
Comprehensive evaluation: in determining the membership matrixR and evaluation of vector W, we can use the comprehensive evaluation of fuzzy transformation: B
=
W
∘
R, where “∘” on behalf of the operation is “choosing big or small” operator. In the four common models—M
=
∧
,
∨—make B
=
b
1
,
b
2
,
…
,
b
m
=
A
∘
R, b
j
=
∨
a
i
∧
r
i
j
= max
⁡
m
i
n
a
1
,
r
1
j
,
m
i
n
a
2
,
r
2
j
,
…
,
m
i
n
a
n
,
r
n
j.


## 3.2. Case Study

The Shanghai performance of marine logistics industry in innovation and technology professionals, according to the above index of performance evaluation system, gives a sample to illustrate the application of the Analytic Hierarchy Process and Fuzzy Comprehensive Evaluation Method [17–19]:(1) Establish the importance of the quantitative scale: “1” represents equally important, that is, the same importance as the two indicators; “3” represents more important, that is, an indicator of a little more importance than another; “5” represents obviously important, an indicator with another indicator which has obvious importance; “7” represents very important, that is, very important compared to an indicator with another indicator; “9” represents absolute importance, that is, an indicator of the importance of completely overwhelming another indicator. In the study, the Analytic Hierarchy Process is with a ratio of 1 to 9 scales, because this ratio is more in line with people’s mental habits during judgment [20–22].(2) Statistics expert’s scoring on the importance of the evaluation elements builds a judgment matrix, as the funding and technical profitV
11, Table 2.Table 2
The judge matrix ofV
11’ subfactors.
FactorV
11
V
111
V
112
V
113
V
114
V
115
V
111
1
1/3
1/5
1/7
1/3
V
112
3
1
1/5
1/5
3
V
113
5
5
1
1/3
3
V
114
7
5
3
1
7
V
115
3
1/3
1/3
1/7
1(3) Calculating the weight, element normalization, and each row is as shown in Table3.Table 3
Evaluation results ofV
11’  subfactors.
Project
Normalized results
Sum of rows
Weight
V
111
0.05
0.03
0.04
0.08
0.02
0.22
0.044
V
112
0.16
0.08
0.04
0.11
0.21
0.6
0.12
V
113
0.26
0.43
0.21
0.18
0.21
1.29
0.258
V
114
0.37
0.43
0.64
0.55
0.49
2.48
0.496
V
115
0.16
0.03
0.07
0.08
0.07
0.41
0.082(4) Check the consistency of the matrix.For the consistency of the matrix, we can make simple estimates, making weighted vector right by judgment matrix, and then get a new vector. And then, in turn, we use this new vector of each weight divided by the corresponding weight vector component and then get a new vector, divided by the number of components; getting the value is the maximum characteristic approximation (λ
m
a
x); this value is much closer to the consistency of judgment matrix which is better [23–27]. Using this method to get λ
m
a
x of V
11 factors approximation is 5.38, and the matrix of order number 5 suggests that the consistency of expert scoring is higher; the result is reasonable and effective.(5) The same as above, get the weight of each factor, such as in Table4. At the same time, by calculating the λ
m
a
x values close to the order number, show that the results are reasonable and effective.Table 4
The weight of each factor and its subfactors.
Project
Weight
V
1
0.63
V
2
0.26
V
3
0.11
V
11
0.75
V
12
0.25
V
121
0.83
V
122
0.17
V
211
0.114
V
212
0.076
V
213
0.226
V
221
0.31
V
222
0.15
V
223
0.15
V
224
0.47
V
225
0.04
V
231
0.066
V
232
0.132
V
233
0.504
V
234
0.034
V
235
0.264
V
311
0.29
V
312
0.49
V
313
0.15
V
314
0.07
V
21
0.2
V
214
0.532
V
215
0.052
V
321
0.25
V
322
0.75
V
31
0.75
V
32
0.25
V
22
0.6
V
23
0.2(6) Build the evaluation set. The results of the evaluation of each indicator for performance evaluation of marine logistics industry in innovation and technology professionals are divided into 5 levels—excellent, good, medium, general, and poor—and then this performance evaluation of marine logistics industry in innovation and technology professionals’ remark set isU
=
e
x
c
e
l
l
e
n
t
,
g
o
o
d
,
m
e
d
i
u
m
,
g
e
n
e
r
a
l
,
p
o
o
r.(7) Determine evaluation indicators and their weights. That performance evaluation of marine logistics industry in innovation and technology professionals includes two level indicators: the experts statistical results such as in Table5 and weight in the above application of Analytic Hierarchy Process which has been worked out.Table 5
Evaluation index weight and expert scoring results.
Indicators and weights
Excellent
Good
Medium
General
Poor
Job performanceV
1  (0.63)
Funding and technical profitV
11  (0.75)
Research funding of national gift or related equipmentV
111 (0.044)
1
3
3
2
1
New technology to reduce the cost of the contribution rateV
112 (0.12)
2
3
3
1
1
Project implementation conversion rateV
113 (0.258)
1
3
4
2
0
Scientific and technological achievements conversion rateV
114 (0.496)
2
2
3
2
1
Budget rate of research fundingV
115 (0.082)
1
4
2
2
1
Customer satisfactionV
12  (0.25)
Customer market shareV
121 (0.83)
2
3
2
1
1
Customer complaint rateV
122 (0.17)
3
2
3
1
1
Work abilityV
2  (0.26)
Social influence competenceV
21  (0.2)
Number of papers by SCI, EI, and ISTP retrievalV
211 (0.114)
3
4
2
1
0
Number of published worksV
212 (0.076)
2
3
3
2
0
Reputation in the industryV
213 (0.226)
1
2
3
2
2
Success rate of project applicationV
214 (0.532)
2
4
1
2
1
Teaching students’ satisfactionV
215 (0.052)
3
2
2
2
1
Core competenceV
22  (0.6)
Scientific research abilityV
221 (0.311)
2
3
3
1
1
Keen insight and flexibilityV
222 (0.152)
2
2
3
2
1
Logical thinking abilityV
223 (0.152)
2
1
4
2
1
Innovation abilityV
224 (0.469)
3
3
2
1
1
Business expansion abilityV
225 (0.038)
2
2
2
2
2
Ability of studying developmentV
23  (0.2)
Number of people entering the international academic conferenceV
231 (0.066)
3
3
2
1
1
Number of people studying abroadV
232 (0.132)
2
4
2
2
0
Number of training and mining ocean logistics staffV
233 (0.504)
2
3
4
1
0
Number of marine logistics lectures and participantsV
234 (0.034)
3
3
3
1
0
Building of marine logistics teamV
235 (0.264)
2
4
2
1
1
Work attitudeV
3  (0.11)
Job satisfactionV
31  (0.75)
ConfidentialityV
311 (0.29)
2
3
2
3
0
Sense of responsibilityV
312 (0.49)
4
3
1
1
1
Enthusiasm for workV
313 (0.15)
3
2
1
2
2
DisciplineV
314 (0.07)
3
3
1
2
1
Team cooperationV
32  (0.25)
Sharing of knowledgeV
321 (0.25)
4
2
2
1
1
Cooperation spiritV
322 (0.75)
2
4
3
1
0(8) Build three level indicators’ evaluation matrix. From Table5, for research funding of national gift or related equipment V
111, one expert thinks it is excellent, three consider it is good, three describe it as medium, two consider it general, and one thinks it be poor, so its evaluation index vector R
111
=
0.1
0.3
0.3
0.2
0.1; in the same way, funding and technical profit V
11 for other three indexes of evaluation vector in turn is(2)
R
112
=
0.2
0.3
0.3
0.1
0.1
,
R
113
=
0.1
0.3
0.4
0.2
0
,
R
114
=
0.2
0.2
0.3
0.2
0.1
,
R
115
=
0.1
0.4
0.2
0.2
0.1
,and then(3)
R
11
=
0.1
0.3
0.3
0.2
0.1
0.2
0.3
0.3
0.1
0.1
0.1
0.3
0.4
0.2
0
0.2
0.2
0.3
0.2
0.1
0.1
0.4
0.2
0.2
0.1
,and, in the same way,(4)
R
12
=
0.2
0.3
0.2
0.1
0.1
0.3
0.2
0.3
0.1
0.1
,
R
21
=
0.3
0.4
0.2
0.1
0
0.2
0.3
0.3
0.2
0
0.1
0.2
0.3
0.2
0.2
0.2
0.4
0.1
0.2
0.1
0.3
0.2
0.2
0.2
0.1
,
R
22
=
0.2
0.3
0.3
0.1
0.1
0.2
0.2
0.3
0.2
0.1
0.2
0.1
0.4
0.2
0.1
0.3
0.3
0.2
0.1
0.1
0.2
0.2
0.2
0.2
0.2
,
R
23
=
0.3
0.3
0.2
0.1
0.1
0.2
0.4
0.2
0.2
0
0.2
0.3
0.4
0.1
0
0.3
0.3
0.3
0.1
0
0.2
0.4
0.2
0.1
0.1
,
R
31
=
0.2
0.3
0.2
0.3
0
0.4
0.3
0.1
0.1
0.1
0.3
0.2
0.1
0.2
0.2
0.3
0.3
0.1
0.2
0.1
,
R
32
=
0.4
0.2
0.2
0.1
0.1
0.2
0.4
0.3
0.1
0
.(9) Build the secondary evaluation matrix. Table5 shows the three levels of indicators weight vector, respectively: (5)
W
11
=
0.044
0.12
0.258
0.496
0.082
,
W
12
=
0.83
0.17
,
W
21
=
0.114
0.076
0.226
0.532
0.052
,
W
22
=
0.311
0.152
0.152
0.469
0.038
,
W
23
=
0.066
0.132
0.504
0.034
0.264
,
W
31
=
0.29
0.49
0.15
0.07
,
W
32
=
0.25
0.75
.Based onB
=
W
∘
R, the following can be concluded:(6)
B
11
=
W
11
∘
R
11
=
0.044
0.12
0.258
0.496
0.082
∘
0.1
0.3
0.3
0.2
0.1
0.2
0.3
0.3
0.1
0.1
0.1
0.3
0.4
0.2
0
0.2
0.2
0.3
0.2
0.1
0.1
0.4
0.2
0.2
0.1
=
0.2
0.258
0.3
0.2
0.1
,
B
12
=
0.2
0.3
0.2
0.1
0.1
,
B
21
=
0.2
0.4
0.226
0.2
0.2
,
B
22
=
0.3
0.3
0.3
0.152
0.1
,
B
23
=
0.2
0.3
0.4
0.1
0.1
,
B
31
=
0.4
0.3
0.2
0.29
0.15
,
B
32
=
0.25
0.4
0.3
0.1
0.1
,and then(7)
R
1
=
0.2
0.258
0.3
0.2
0.1
0.2
0.3
0.2
0.1
0.1
,
R
2
=
0.2
0.4
0.226
0.2
0.2
0.3
0.3
0.3
0.152
0.1
0.2
0.3
0.4
0.1
0.1
,
R
3
=
0.4
0.3
0.2
0.29
0.15
0.25
0.4
0.3
0.1
0.1
.(10) Construction level evaluation matrix is(8)
W
1
=
0.75
0.25
,
W
2
=
0.2
0.6
0.2
,
W
3
=
0.75
0.25
,and then(9)
R
=
0.2
0.258
0.3
0.2
0.1
0.3
0.3
0.3
0.2
0.2
0.4
0.3
0.25
0.29
0.15
.(11) Calculate the final results of the evaluation.W
=
0.63
0.26
0.11; B
=
W
∘
R
=
0.26
0.26
0.3
0.2
0.2; by normalization, B
=
0.21
0.21
0.24
0.17
0.17.According to the principle of maximum degree of membership, that performance evaluation level of marine logistics industry in innovation and technology professionals is “medium.” From the view of the probability theory, about 21% of the experts believe that the performance is very good, 24% of the experts believe that it is medium, 17% of the experts believe that it is general, and 17% of the experts believe that it is poor.


## 4. Conclusions and Recommendations

With the development of marine logistics industry to grow, the government and corporate more and more attach importance to the performance evaluation of innovation and technology professionals. The study combines the characteristics of marine logistics industry and innovative technology professionals to design a performance evaluation index of marine logistics industry in innovation and technology professionals. We use the mathematical model of performance evaluation of complex talent problem in order to carry on the effective performance appraisal and provide opinions for the government and enterprises in the marine logistics talents’ introduction, training, and incentives.From the results of performance evaluation of marine logistics industry in innovation and technology professionals, its performance does not reach the excellent level. The government and enterprise should provide proper incentives for innovative talents of science and technology and then improve the level of its performance. It has a very important effect for marine logistics industry development.The results demonstrated that the method proposed in this study provides theoretical contributions and can be applied to business.



---

*Source: 361275-2015-12-24.xml*