# A Holistic Review of Public-Private Partnership Literature Published between 2008 and 2018

Authors: Liang Ma; Junning Li; Ruoyu Jin; Yongjian Ke
Journal: Advances in Civil Engineering
 (2019)

---

## Abstract

Adopting a holistic approach in the review of the public-private partnership (PPP) literature published since 2008 by incorporating scientometric analysis and further systematic analysis, this study aims to provide the big picture of the state-of-the-art research in PPP by addressing major issues and suggesting research trends in PPP. Following a three-step research methodology, this study started from a bibliometric analysis with science mapping to provide the state-of-the-art information on PPP research keywords, scholars, journal articles, institutions, and countries. A further systematic review was also conducted to identify future research directions of PPP in project management. The review of the existing literature in PPP revealed that there had been insufficient systematic approach in summarizing the research topics and proposing new research trends in PPP-related project management. It was further indicated that sustainability and innovation in PPP could be further studied, such as integrating building information modeling with PPP. Factors related to barriers in PPP implementation would continue growing. Future research directions in PPP were also proposed following the systematic review, for example, comparative studies of PPP practice between developing and developed countries. The current study provides a comprehensive approach by integrating bibliometric analysis, science mapping, and qualitative analysis in the latest PPP research. It reveals the contemporary research themes in PPP and provides directions for near-future directions of PPP research in project management.


---

## Body

## 1. Introduction

Public-private partnership (PPP) refers to the procurement approach where the project is executed with a broader span of contractual relationships between the public and private sectors to provide an asset and/or a service [1]. It is a procurement model to deliver public infrastructure and/or service crossing various sectors including transportation, water treatment, energy, environment, health, and education [2–5]. PPP is believed to provide benefits to the public sector, private sector, and consumers by involving the participation of the government and the private financing initiatives [4]. However, conflicting opinions exist considering the negotiation efficiency, service quality, and accountability within PPPs [6]. PPP-based research has aroused wide interests in recent decades [6, 7]. Both developing and developed countries have actively been inviting private sectors to be involved in constructing infrastructure projects [8, 9].Although PPP is still at the initial stages in meeting infrastructure development needs for many developing countries [10], new scenarios, findings, and designs have been proposed, adopted, or explored in the PPP field [11]. Case studies of PPP projects have widely been adopted crossing industries leading to new topics and paved the way forward for PPP research [6], including developing PPP-related frameworks [12], project financing [13], critical success factors (CSFs) [14], concession-related issues [15], and risk allocation and management [16]. Despite of these multiple PPP studies conducted, there has been insufficient attention on outlining the framework and development trends of PPP research [6]. Although certain effort has been paid to explore the research trends in PPP through content analysis of renowned construction journals, such as studies conducted by Al-Sharif and Kaka [17] and Ke et al. [18], Song et al. [6] argued that these studies had relied on subjective judgements which might be unreliable due to the possible misinterpretations and misunderstanding on the part of the researchers.Literature review is an expedient approach to gain in-depth understanding of a research field [19]. Existing review-based studies in PPP focused on either a certain industry or a wider scope crossing industries. The reviews of Ke et al. [18] and Tang et al. [7] on PPP projects focused on the construction industry. Similarly, Wang et al.’s [20] review of the PPP literature was restricted to the field of public administration. de Castro e Silva Neto et al. [21] started applying bibliometric analysis into the review of PPP studies crossing multiple project sectors such as transportation, health, and energy. But the study of de Castro e Silva Neto et al. [21] was a statistical summary of the existing literature without a deeper analysis (e.g., research trends in PPP). Song et al. [6] adopted the scientometric analysis of PPP-related research in a wide scope covering subjects of engineering, business and economics, and public administration. Researchers in this study believe that these review-based studies can be extended with a more comprehensive coverage, such as research methodology applied in existing PPP studies, the major research focus areas in the last ten years, and the expectations of research directions for the future work. So far limited reviews have linked PPP within the context of project management across multiple industries or sectors with a holistic approach by combining bibliometric analysis, science mapping, and further qualitative analysis.Continuing from these previous review-based studies in PPP, this study contributes to the body of knowledge by (1) starting from a bibliometric analysis and science mapping of the existing literature since 2008 focusing on PPP in project management, (2) adopting a systematic review of the selected literature sample to summarize and analyze research methods, countries/regions where the PPP studies were performed, project sectors, and key issues within PPP, and (3) analyzing mainstream research topics and recommending future PPP research directions. This study integrates bibliometric analysis, science mapping, quantitative measurements of productive scholars, institutions, countries in PPP research, and systematic review in a holistic approach.


## 2. Methodology

This study adopted a bibliometric analysis of the PPP-based literature followed by the science mapping defined by Tijssen and van Raan [22] and Cobo et al. [23]. A bibliometric analysis examines the bibliographical material from an objective and quantitative perspective which is useful to organize information in a specific field [24, 25]. A bibliometric analysis, by using keywords, allows the analysis of details in main topics within a domain and relationships at the microlevel [26]. Compared to other literature review techniques, bibliometrics provides more objective and reliable analyses [27]. Science mapping describes and diagnoses research policy purposes and processes immense reservoirs of bibliometric data [22]. It displays the structural and dynamic aspects of a scientific research [23, 28] and represents spatially how disciplines, fields, and individual articles or authors relate to one another [29]. Following several existing studies adopting a comprehensive review workflow [30–32], the overall research steps in this review-based study of PPP are described in Figure 1, which consists of bibliometric analysis through literature search, science mapping, and follow-up systematic review.Figure 1
The description of research steps in PPP literature review.


### 2.1. Bibliometric Analysis

Keyword search was performed inScopus, which was identified by Aghaei Chadegani et al. [33] as the literature source with a wider coverage of journals and more recent publications compared to other search engines such as Web of Science. Scopus has also been recommended by other studies [19, 34] and [35] within the project management field as the literature source. The literature search was set initially by inputting keywords in Scopus denoted below:TITLE-ABS-KEY (“public-private partnership” OR “public-private partnerships” OR “public private partnership” OR “public private partnerships” OR “Public/private Partnerships”).The scope of the search was limited to those published in recent ten years (i.e., from 2008 to 2018), and only journal articles published in English were included in the first-round search. Sources from conference proceedings were excluded. As suggested in [36], conference papers have been published in large number but little has been gained by including them, given the extra amount of complexity added to the analyses. According to Figure 1, after obtaining all journal articles through keyword search, the second-round refinement of the literature was performed to remove articles that did not fall into the project management field. Project management, as defined by multiple studies [37–40], generally involves the monitoring and control of project performance in terms of cost, time, quality, and risks. Following the second-round refinement, a third-round checking was performed to further remove articles which did not focus on PPP-related research themes. In other words, although PPP or relevant terms were mentioned in the article, they were not the focus of the study in project management.


### 2.2. Science Mapping

The text mining software tool,VOSViewer [41], was adopted to generate the bibliometric map of PPP. In recent years, VOSViewer has been applied in scientometric analysis in the field of project management, such as building information modeling [34], building control [42], and offsite construction [35]. The scientometric review method can also be applied in other research topics [43]. As recommended by Hosseini et al. [35] and Park and Nagy [42], VOSViewer was utilized in this research to (1) import the literature source from Scopus to VOSViewer, (2) compute the frequency and co-occurrence of keywords, (3) extract the citation relationship among articles, authors, publication sources, and institutions, and (4) cluster and visualize keywords, publication sources, and institutions by co-occurrences.


### 2.3. Systematic Review

Following the bibliometric analysis and science mapping, the systematic review was performed to summarize the current research focus areas in PPP-related project management and to provide suggestions for near-future research trends in PPP themes. Following the suggestions of Tang et al. [7] and de Castro e Silva Neto et al. [21], this study categorized and summarized key issues (e.g., contract performance, financing, and concession) within the refined PPP literature aiming to generate new insights into state-of-the-art research focuses. Besides, project sectors [21] and regions/countries of PPP studies [6] were also categorized and summarized together with methodologies adopted in the literature sample.


## 2.1. Bibliometric Analysis

Keyword search was performed inScopus, which was identified by Aghaei Chadegani et al. [33] as the literature source with a wider coverage of journals and more recent publications compared to other search engines such as Web of Science. Scopus has also been recommended by other studies [19, 34] and [35] within the project management field as the literature source. The literature search was set initially by inputting keywords in Scopus denoted below:TITLE-ABS-KEY (“public-private partnership” OR “public-private partnerships” OR “public private partnership” OR “public private partnerships” OR “Public/private Partnerships”).The scope of the search was limited to those published in recent ten years (i.e., from 2008 to 2018), and only journal articles published in English were included in the first-round search. Sources from conference proceedings were excluded. As suggested in [36], conference papers have been published in large number but little has been gained by including them, given the extra amount of complexity added to the analyses. According to Figure 1, after obtaining all journal articles through keyword search, the second-round refinement of the literature was performed to remove articles that did not fall into the project management field. Project management, as defined by multiple studies [37–40], generally involves the monitoring and control of project performance in terms of cost, time, quality, and risks. Following the second-round refinement, a third-round checking was performed to further remove articles which did not focus on PPP-related research themes. In other words, although PPP or relevant terms were mentioned in the article, they were not the focus of the study in project management.


## 2.2. Science Mapping

The text mining software tool,VOSViewer [41], was adopted to generate the bibliometric map of PPP. In recent years, VOSViewer has been applied in scientometric analysis in the field of project management, such as building information modeling [34], building control [42], and offsite construction [35]. The scientometric review method can also be applied in other research topics [43]. As recommended by Hosseini et al. [35] and Park and Nagy [42], VOSViewer was utilized in this research to (1) import the literature source from Scopus to VOSViewer, (2) compute the frequency and co-occurrence of keywords, (3) extract the citation relationship among articles, authors, publication sources, and institutions, and (4) cluster and visualize keywords, publication sources, and institutions by co-occurrences.


## 2.3. Systematic Review

Following the bibliometric analysis and science mapping, the systematic review was performed to summarize the current research focus areas in PPP-related project management and to provide suggestions for near-future research trends in PPP themes. Following the suggestions of Tang et al. [7] and de Castro e Silva Neto et al. [21], this study categorized and summarized key issues (e.g., contract performance, financing, and concession) within the refined PPP literature aiming to generate new insights into state-of-the-art research focuses. Besides, project sectors [21] and regions/countries of PPP studies [6] were also categorized and summarized together with methodologies adopted in the literature sample.


## 3. Results and Discussion

By performing the literature search inScopus, originally 2,340 journal articles published from 2008 to 2018 were found. The majority of the literature in this sample was published from 2008 to 2018 and was hence considered a ten-year span. Reading through the abstract of these selected journal articles, those with PPP in the abstract or keywords but falling out of the scope of project management were excluded to narrow down the search scope. For example, Vasmant’s [44] study in the biomedical field, though with PPP-relevant terminology in the abstract and keyword list, did not fall into the category of PPP in project management. Also, those with PPP in the abstract or keyword list but not focusing on PPP-related study were also further excluded. For example, Whyte and Lobo’s [45] study focused on the application digital technology in a PPP type of infrastructure project. Although PPP was mentioned in the abstract, it was not the focus of the research. Therefore, journal articles such as Whyte and Lobo [45] was removed from the reference list. Ultimately, totally 1,209 journal articles were selected as the literature sample for this research.


### 3.1. An Overview of the PPP Literature Sample

The numbers of journal articles published from 2008 to 2018 in the literature sample are summarized in Figure2.Figure 2
Number of journal articles published from 2008 to 2018.It can be seen in Figure2 that generally the number of yearly number of articles has slowly been increasing from 2008 to 2017, with a significant increase in 2018 to reach 353 articles. It could be inferred that the academic research of PPP themes in project management has been remaining or even becoming more popular in recent years. The sources of these articles are visualized in Figure 3 and further described in Table 1.Figure 3
Mapping of sources of journal articles within this research. Note: Journal names are presented in Figure2 using acronyms or abbreviation. The full name of journals can be found in Table 1.Table 1
Analysis of sources in PPP.
Source
Acronym or abbreviation in Figure3
Total link strength
Number of articles
Total citations
Average citations
Built Environment Project and Asset Management
BEPAM
66
22
85
3.9
Construction Management and Economics
Constr. Manage. Econ.
188
27
522
19.3
Engineering, Construction and Architectural Management
ECAM
46
11
119
10.8
Proceedings of Institution of Civil Engineers: Management, Procurement and Law
ICE: MPL
7
17
32
1.9
International Journal of Project Management
Int. J. Proj. Manage.
366
45
887
19.7
International Journal of Strategic Property Management
Int. J. Strateg. Prop. Manage.
112
17
127
7.5
Journal of Cleaner Production
J. Clean. Prod.
33
10
37
3.7
Journal of Management in Engineering
J. Manage. Eng.
113
33
365
11.1
Journal of Construction Engineering and Management
J. Constr. Eng. Manage.
193
41
723
17.6
Journal of Infrastructure Systems
J. Infrastruct. Syst
107
23
182
7.9
Journal of Financial Management of Property and Construction
JFMPC
26
17
103
6.1
Research in Transportation Economics
Res. Transp. Econ.
15
21
136
6.5
Sustainability (Switzerland)
Sustainability
99
39
66
1.7
Transport Policy
Trans. Policy
29
10
90
9.0
Total link strength corresponds to Figure3 and indicates the interrelatedness between the given journal and other peer journals.Setting the minimum number of articles and minimum citations of a source to be 10 and 10, respectively inVOSViewer, totally 14 sources met the requirements and visualized in Figure 3. It should be noticed that there is not really a standardized quantification for the threshold values of article number and citations [46]. However, following the scientometric analysis guide in other project management related studies (e.g., Oraee et al.) [34, 35, 46] and considering the context of this PPP literature sample, the minimum number of articles and citations were determined. Similar threshold values for keywords, coauthorship, articles, institutions, and countries in PPP-related research could also be determined in the consistent approach following these prior studies. A larger font size in Figure 3 indicates more articles published in the given source. The connection lines indicate the citation between the pair of given sources. For example, it can be found in Figure 3 that International Journal of Project Management (i.e., Int. J. Proj. Manage.) has a strong cocitation with Journal of Construction Engineering and Management (i.e., J. Constr. Eng. Manage.) in the PPP area. Detailed number of articles, link strength, and citations are listed in Table 1.Based on the link strength, number of articles published, number of citations, and average citation per article listed in Table1, the most influential sources in the PPP field would be International Journal of Project Management, followed by Construction Management and Economics, Journal of Construction Engineering and Management, and Journal of Management in Engineering. Other journals indicating the project sectors, including Journal of Infrastructure Systems and Research in Transportation Economics, although not with high total link strength, are also the main sources of the PPP literature considering the number of articles published in these two journals. Among the infrastructure sector, transportation is one of the main sectors that PPP research has focused on. Besides Research in Transportation Economics which contributes to 21 articles in this literature sample, other PPP-related research were found in the transportation sector in sources such as Transportation Research Part A: Policy and Practice, Transportation Research Part D: Transport and Environment, and Transportation Journal.


### 3.2. Science Mapping

Continuing usingVOSViewer as the science mapping tool, the following sientometric analysis was performed in terms of research keywords in the selected PPP literature sample, coauthorship, highly cited journal articles in PPP, and highly productive research organizations and countries in the field of PPP.


#### 3.2.1. Co-Occurrence of Keywords

Keywords represent the core contents of existing studies and describe the areas researched within the boundaries of a domain [47]. According to van Eck and Waltman [48], a network of keywords provides the picture of knowledge in terms of patterns, relationships, and intellectual organization of research topics. From totally 2,669 keywords extracted through the literature database, with the minimum number of occurrences set at 5 using Author Keywords, and by removing some generic keywords (e.g., “PPP,” “public-private partnerships,” and “project,”), originally 99 keywords were generated. By further merging keywords with consistent semantic meanings (e.g., “case study” and “case studies”) and categorizing keywords (e.g., “risk analysis,” “risk management,” and “risk assessment” were all categorized into “risk allocation and management”), finally 72 keywords were generated. This corresponding network was created using VOSViewer in Figure 4.Figure 4
Co-occurrence of keywords.The following can be indicated from the node size and connection lines: (1) Risk allocation and management (RAM) is one of the most frequently studied research topics in PPP projects. Other key research topics in PPP involve procurement, critical success factors (CSF), financing, concession, regulation, contracting, value for money (VFM), and governance. (2) Infrastructure, including roads and water, is the sector that PPP research has frequently focused on. (3) Some widely applied research methods used in PPP-based project management include case study, simulation, data mining, game theory, and fuzzy synthetic evaluation. (4) Besides developed countries (e.g., U.K., Australia, and Spain), PPP has also widely been studied in developing countries such as China, India, Ghana, Malaysia, and Nigeria. (5) The project participants (e.g., government and stakeholder) in both public and private sectors were also one key issue studied. (6) Sustainability and innovation were another two frequently studied issues in PPP research. A more quantitative analysis of these main keywords is summarized in Table2.Table 2
Summaries of most frequently studied keywords in PPP.
Studied keywords
Total link strength
Frequency
Average year published
Average citations
Risk Allocation and Management (RAM)
88
132
2013
12
Infrastructure
88
124
2014
11
Procurement
36
47
2013
13
Mainland China
34
43
2014
20
Financing
30
42
2013
9
Concession
26
37
2014
6
Sustainability
23
37
2016
3
Critical Success Factors
20
32
2015
13
Value for Money
20
32
2013
9
Developing Countries
25
30
2015
4
Transportation
18
29
2015
5
Government
19
27
2015
5
Real Option
19
27
2014
11
Contracting
15
26
2015
4
Australia
25
25
2013
11
Roads
17
24
2014
10
Water Sector
21
24
2012
7
Governance
13
23
2015
4
Case Study
11
18
2015
9
India
14
17
2014
6
Hong Kong
15
16
2013
15
Stakeholder
12
16
2015
10
Game Theory
9
14
2016
3
Monte Carlo Simulation
9
13
2016
5
Ghana
7
12
2017
3
Innovation
6
11
2015
6It should be noticed that only part of the most frequently studied keywords from the total sample of 72 are listed in Table2. Most keywords appear in the literature from 2011 to 2014, indicating that most of them have been in the research community before 2014. Only a few other keywords including “game theory,” “Monte Carlo simulation,” and “data mining” appear, coming to the research community more recently with the average publication year in 2015. The correlation analysis among total link strength, frequency, and average citation of the totally 72 keywords revealed that the total link strength is highly correlated to the frequency of the keyword, with a Pearson correlation coefficient at 0.991. However, the average citation of a keyword is not affected by its frequency of being studied in the literature, with a Pearson correlation coefficient at 0.214 and corresponding p value at 0.071 between the average citation and the frequency. This weak relationship between frequency and average citation can be proved in the example of RAM, which has the highest frequency of being studied in the literature. Nevertheless, keywords that receive highest average citations is “Mainland China,” followed by Hong Kong, CSF, and “procurement.” It can be inferred that research topics related to CSF and procurement tend to have higher impact on the academic community of PPP, although RAM tends to be the most popular research topic.


#### 3.2.2. Coauthorship Analysis

Awareness of the existing scientific collaboration networks in a research field enhances the access to funds, specialties, and expertise, improves productivity, and helps researchers reduce isolation [35]. The science mapping in VOSViewer was also used to identify the most productive scholars and the research collaboration among them. With totally 2,396 authors extracted from the literature sample and 3 articles and 30 citations set as the minimum criteria, totally 72 authors were found meeting the threshold. The coauthorship analysis is visualized in Figure 5.Figure 5
Coauthorship analysis.It can be indicated from the clusters represented by different colors of nodes, node sizes, and connection lines among scholars shown in Figure5 that Chan A. P. C., as the most productive author in PPP, has strong collaboration with Ameyaw E. E. and Oseu-Kyer R. Chan A. P. C. has also collaboration with the research network consisting of Ke Y., Wang S., Zou P. X. W., and Lam P. T. I. The other three PPP-based research networks tend to work more closely within their own groups. These three research groups are: (1) network consisting of Love P. E. D., Liu, J., Regan M., Smith J., and Cheah, C. Y. J.; (2) network comprised of Xu Y., Yeung J. F. Y., and Cheng H.; and (3) collaboration among Skiniewski M. J., Yuan J., and Li Q. More detailed description of these main active scholars in PPP field is provided in Table 3.Table 3
List of active scholars in PPP research.
Author
Total link strength
Number of articles
Total citations
Average publication year
Average citation
Ameyaw E. E.
8
10
59
2016
5.9
Chan A. P. C.
52
57
1069
2014
18.8
Chan D. W. M.
5
5
290
2010
58.0
Cheah C. Y. J.
5
5
43
2015
8.6
Cheng H.
2
3
36
2011
12.0
Cheung E.
14
15
490
2011
32.7
Garvin M. J.
2
4
55
2014
13.8
Kajewski S.
6
6
109
2010
18.2
Ke Y.
16
20
688
2012
34.4
Lam P. T. I.
9
10
367
2012
36.7
Li Q.
6
6
149
2012
24.8
Liu J.
14
17
131
2016
7.7
Liu T.
8
8
52
2015
6.5
Liu Y.
2
4
30
2017
7.5
Love P. E. D.
12
12
104
2015
8.7
Molenaar K. R.
1
3
44
2016
14.7
Osei-Kyei R.
15
15
63
2017
4.2
Regan M.
8
8
110
2014
13.8
Skibniewski M. J.
10
13
193
2014
14.8
Smith J.
13
13
133
2015
10.2
Wang S.
15
17
474
2013
27.9
Wang Y.
4
14
44
2016
3.1
Wilkinson S.
6
6
52
2014
8.7
Xiong W.
9
10
31
2016
3.1
Xu Y.
10
10
202
2013
20.2
Yeung J. F. Y.
8
8
254
2012
31.8
Yuan J.
7
7
129
2014
18.4
Zhang X.
3
13
127
2014
9.8
Zhao X.
2
5
70
2017
14.0
Zou P. X. W.
2
3
57
2011
19.0Totally 30 productive authors are listed in Table3. Their average publication years of articles range from 2011 to 2017. Scholars such as Zou P. X. W., Cheng H., and Cheung E. have more of their PPP articles published in earlier years around 2011. In comparison, some scholars are more recently active researchers in the PPP field. For example, Osei-Kyei R. and Ameyaw E. E. have their work published more recently in 2017 and 2016, respectively. The four major parameters of scholars’ PPP research outputs, namely, total link strength, number of articles published, total citations in the academic community, and average citation per article, are analyzed of their internal correlations. Table 4 summarizes the correlation analysis results.Table 4
The Pearson correlation analysis among parameters related to authors’ impact on PPP research community.
Correlation analysis
Total link strength
Number of articles
Total citations
Average citation
Total link strength
r = 0.965; p=0.000
r = 0.835; p=0.000
r = 0.093; p=0.626
Number of articles
r = 0.830; p=0.000
r = 0.034; p=0.857
Total citations
r = 0.522; p=0.003
r is the Pearson correlation between the selected pair of authors’ parameters, and a corresponding p value lower than 0.05 would indicate a significant relationship between the pair of parameters.It is found from Table4 that average citation per article is not related to the total link strength or number of articles published by a scholar. However, it has significant correlation with the total citations. For example, Chan D. W. M., although having only published five articles, has the highest average citation at 58.0 and also high total citations at 290. An author who has published more articles will have also a higher impact on the research community measured by total link strength (e.g., Chan A. P. C.).


#### 3.2.3. Citation of Articles

Published PPP-related articles were also mapped based on the citation numbers received. With the minimum number of citations of an article set at 30, totally 64 meet the threshold. These articles receiving most citations are visualized in Figure6.Figure 6
Science mapping of PPP articles.It can be found from Figure6 that these most influential PPP articles in recent ten years were published from 2008 to 2012. Many of these published studies were led by active scholars included in Figure 5 and Table 3, such as Ke Y., Chan A. P. C., Yuan J., and Xu Y. These top 15 articles receiving the highest citations are listed in Table 5.Table 5
List of PPP articles with high citations.
Article
Title
Number of links
Number of citations
Ke et al. [49]
Preferred risk allocation in China’s public–private partnership (PPP) projects
8
116
Chan et al. [50]
Critical success factors for PPPs in infrastructure developments: Chinese perspective
1
105
Tang et al. [7]
A review of studies on public–private partnership projects in the construction industry
2
93
Yuan et al. [51]
Selection of performance objectives and key performance indicators in public–private partnership projects to achieve value for money
3
82
Xu et al. [52]
Developing a risk assessment model for PPP projects in China—a fuzzy synthetic evaluation approach
6
80
Jin and Doloi [53]
Interpreting risk allocation mechanism in public–private partnership projects: An empirical study in a transaction cost economics perspective
8
75
Ke et al. [18]
Research trends of public-private partnership in construction journals
3
74
Jacobson and Choi [54]
Success factors: public works and public-private partnerships
2
70
Roumboutsos a Anagnostopoulos [57]
Public–private partnership projects in Greece: risk ranking and preferred risk allocation
6
61
Chan et al. [16]
Empirical study of risk assessment and allocation of public-private partnership projects in China
4
60
Xu et al. [51]
Developing a fuzzy risk allocation model for PPP projects in China
1
55
Iyer and Sagheer [57]
Hierarchical structuring of PPP risks using interpretative structural modeling
1
54
Jin and Zhang [58]
Modeling optimal risk allocation in PPP projects using artificial neural networks
2
53
Hwang et al. [59]
Public-private partnership projects in Singapore: factors, critical risks and preferred risk allocation from the perspective of contractors
5
51
Raisbeck et al. [60]
Comparative performance of PPPs and traditional procurement in Australia
1
49The number of links listed in Table5 indicated the interrelatedness of the article to others in the selected sample of highly cited articles. An article with more links indicates that it is more highly cited or citing other articles in the sample. However, it differs from the number of citation in that the latter shows the overall impact of the article to the whole research community. These two parameters are not correlated. For example, the article published by Chan et al. [50] received one of the highest citations in PPP field, although it is with only one link among these articles in the network shown in Figure 6. In contrast, the article published by Jin and Doloi [53] was cited by only 75 times, but it has eight links with other articles shown in Figure 6, indicating its higher degree of interrelatedness with the rest of the articles.


#### 3.2.4. Institutions Productive in PPP Research

Adopting VOSViewer, institutions were analyzed of their contributions to the research outputs of PPP. By setting the minimum number of articles at 3 and minimum citations at 30 as threshold values to screen the totally 2,182 institutions, 14 of them were identified as most research active organizations in PPP.Figure7 conveys the information that Hong Kong-based universities, including Hong Kong Polytechnic University (HK Poly U), Hong Kong University of Science and Technology, and Hong Kong Baptist University, are active in PPP research. These three universities have developed their research collaboration with peer institutions in the mainland of China. For example, HK Poly U has displayed strong collaboration with Tsinghua University, Zhejiang Sci-Tech University, and Southeast University in China. The closer geographic distance could be one factor driving the collaboration for these universities among Taiwan, Hong Kong, and mainland of China (i.e., HK Poly U, National Taiwan University, and Tsinghua University China). In comparison, Australian universities, including Bond University, Queensland University of Technology, and Curtin University, seem more closely collaborating among themselves by forming their own cluster, although they have developed certain collaboration with peer institutions from other continents, including University of Maryland, Southeast University China, and HK Poly U.Figure 7
Mapping of organizations active in PPP research.


#### 3.2.5. Countries or Regions Active in PPP Research

Similar to the study of institutions productive in PPP research, countries that have been active in PPP research were also analyzed. Setting the minimum number of articles published at 5, minimum citations received at 30, totally 32 out of 96 countries met the threshold. These countries where most PPP researchers were based are visualized in Figure8.Figure 8
Mapping of countries/regions where PPP researchers were located.It can be inferred from Figure8 that PPP researchers have widely distributed crossing developing and developed countries. Developed countries including U.K., U.S., and Australia have largely contributed to the PPP research field. Researchers from developing countries, as indicated by both Figures 4 and 8, have also been active in PPP research, such as China, India, Malaysia, and Ghana. These quantitative measurements of countries where PPP researchers are located are summarized in Table 6.Table 6
Countries or regions where PPP researchers are based.
Country/region
Total link strength
Number of articles
Number of citations
Average publication year
Average citation
Mainland China
1740
180
1428
2016
7.9
U.S.
683
159
958
2015
6.0
Australia
1211
126
1077
2015
8.5
UK
591
125
895
2014
7.2
Hong Kong
1250
93
1289
2014
13.9
Netherlands
276
61
676
2014
11.1
India
218
57
305
2015
5.4
Russian Federation
58
51
56
2016
1.1
Italy
247
47
269
2015
5.7
Spain
161
45
197
2015
4.4
Canada
138
44
255
2015
5.8
Malaysia
216
37
158
2015
4.3
Germany
97
30
186
2013
6.2
Belgium
121
27
122
2016
4.5
Singapore
320
26
347
2013
13.3
Taiwan
274
26
151
2015
5.8
France
107
25
286
2014
11.4
South Korea
120
23
123
2016
5.3
Brazil
55
22
96
2015
4.4
Portugal
109
22
171
2014
7.8
Not all 32 countries are listed in Table6 but the top 20 countries with most PPP articles published are listed.Table6 shows that China is the country that is most productive in PPP research in terms of total link strength, number of PPP journal articles published, and total citations. With China as the exception, developed countries or regions are mainstream contributors to PPP research. As can be seen in Table 6, U.S., U.K., Australia, Hong Kong, and Netherlands are also highly productive in PPP studies. The average publication year of articles generally range from 2011 to 2014 among the 32 countries, with the exception that Russia and Belgium are with articles published around 2015. It is inferred that these two countries have more recently become active in PPP research. A correlation analysis among the four parameters (i.e., total link strength, number of articles published, total citations, and average citations) is performed and summarized in Table 7.Table 7
Pearson correlation analysis among parameters related to countries/regions’ impacts on PPP research.
Correlation analysis
Total link strength
Number of articles
Number of citations
Average citation
Total link strength
r = 0.871; p=0.000
r = 0.947; p=0.000
r = 0.324; p=0.070
Number of articles
r = 0.920; p=0.000
r = 0.101; p=0.582
Number of citations
r = 0.404; p=0.022Table7 demonstrates that these four parameters are generally significantly correlated to each other, except that the number of articles published from a country is not correlated to the average citation per article. Overall, a country’s impact to the global PPP research community can be measured by either total link strength, number of published journal articles, total citations, or average citation.


### 3.3. Systematic Review

Based on the analysis from science mapping, systematic review was performed to the literature sample in terms of the research methodology, project sectors, studied regions/countries, and qualitative analysis of key issues within PPP. It should be noticed that studied region/countries differ from science mapping shown in Figure8, where the countries refer to where the authors of the published literature were based. The studied countries or regions in this section refer to whether the PPP-related study was performed in the context of a certain country or region. An example explaining the difference could be the study of Osei-Kyei and Chan [61]; while the researchers were located in Hong Kong, the studied country included Ghana.


#### 3.3.1. Summary of Research Methods

The 1,209 articles were summarized of their research methods. As indicated by Figure4, case studies and other modeling methods (e.g., fuzzy synthetic evaluation) were widely been applied in PPP studies. These main research methods listed in Table 8 include case studies, research modeling and framework, questionnaire survey, interview, literature review, and others.Table 8
Summary of research methodologies in the literature sample.
Research method
Number of articles
Percentage
Case study
375
29.0
Modeling or framework/model development
398
31.0
Questionnaire survey
113
8.7
Interview
105
8.1
Review
54
4.2
Others
248
19.0
The total percentage may be summed up to be over 100%, as some studies may adopt more than one method. The case that the summed percentage may be higher than 100% also applies to Tables 9 and 10 where the project sectors and key issues in PPP are summarized respectively.Other methods listed in Table8 refer to those without specified methods or generally with qualitative analysis. For example, in the study of Brthen and Odeck [62], an overview of various toll road projects was provided followed by discussions on socioeconomic efficiency via public funding. Similar qualitative analysis can be found in PPP studies including Sohail and Maslyukivska [63], Tang and Lo [64], Mahalingam et al. [65], Petersen [66], and Deshpande and Rokade [67]. It can be found from Table 8 that case studies and modeling are the mainstream research methods implemented in PPP research, followed by questionnaire-based survey and interview to PPP-related professionals. Case studies have been chosen as the research methodology due to the exploratory nature of the research, the limited amount of similar previous research, and the intent to develop knowledge on a contemporary phenomenon [68, 69]. Modeling approach has also widely been applied in PPP-involved projects to achieve optimized project performance by considering uncertainties and risks during the project delivery process. Examples of modelling approach in PPP projects include Carbonara and Pellegrino [70] where Monte Carlo simulation was employed, Osei-Kyei and Chan [61] who adopted fuzzy synthetic evaluation method, and Roumboutsos et al. [71] who applied the game theoretic model. Previous studies had also focused on establishing, developing, and testing frameworks for PPP projects, such as Shrestha et al.’s [72] work to build the framework to examine risk allocation for PPP water projects in China. Questionnaire survey, interviews, and review are not unique in PPP research but commonly adopted methods in the field of project management.


#### 3.3.2. Project Sectors

Project sectors targeted in the PPP literature sample are summarized in Table9.Table 9
Summary of project sectors in the PPP literature.
Project sectors
Number of articles
Percentage
Transportation
162
13.4
Water
62
5.1
Healthcare
63
5.2
Other construction projects
42
3.5
Public housing
27
2.2
Education
27
2.2
Agriculture
31
2.6
Energy
36
3.0
Waste recycling
15
1.2
Information and communication technology
11
1.0
Preventation/postdisaster projects
6
0.5
Tourism
17
1.4
Physical culture and sport
5
0.4
Apparel and textile industry
1
0.1
Prison
3
0.2
Unspecified
700
58.0
Other construction projects include museum and building construction.Consistent to the statistical summary performed by de Castro e Silva Neto et al. [21], the majority of PPP studies did not specify the project sectors. As indicated from the science mapping presented in Figure 4, infrastructure was one of the most frequently studied keywords in the PPP literature. Among the infrastructure projects, transportation was the sector that was most widely studied according to this study and that of de Castro e Silva Neto et al. [21]. Consistently between these two studies, PPP projects were found applied in multiple sectors including health, education, housing, energy, agriculture, and communication. However, unlike the study of de Castro e Silva Neto et al. [21], who found that the health sector was the second most widely studied sector in PPP, this research identified the water sector as the second most frequently studied sector followed by the health sector. This difference could be due to the years and types of the literature selected. This study only chose journal articles published within the recent ten years, and de Castro e Silva Neto et al. [21] used the literature including both journal articles and conference papers published from 1990 to 2014. It seems that journal articles have been focusing more on infrastructure project sectors, including transportation and water and waste management.


#### 3.3.3. Studied Regions/Countries

The countries or regions where PPP studies were conducted were also summarized. Around 40% of the selected studies did not specify countries. For the remaining studies falling into the context of certain countries or regions, the frequencies of countries targeted in the literature sample are presented in Figure9.Figure 9
Frequencies of countries that have been studied in the literature sample.It is shown in Figure9 that China is the country that has been studied most frequently from the selected literature. Figure 8 and Table 6 show that China was the country where scholars had published most PPP-related articles, and Figure 9 further infers that China is also the country that has received the highest attention on PPP research. This could be due to fact indicated by Zhang et al. [73] and Yang et al. [74] that PPP has been gaining wide implementation and aroused a wide attention from Chinese industry, government, and academia in the last decade.


#### 3.3.4. Qualitative Analysis of Key Issues

Following the studies of Tang et al. [7] and de Castro e Silva Neto et al. [21], as well as key research topics mapped in Figure 4 and Table 2, key issues that have been studied in the literature sample are listed in Table 10.Table 10
Summary of key issues in the literature sample.
Key issues
References
Number of articles
Percentage
Project governance (PG)
Guarini and Battisti [75]; Opara and Elloumi [76]
303
22.7
Risk allocation and management (RAM)
[77, 78]
166
12.4
Critical success factors (CSF)
[79, 80]
120
9.0
Performance evaluation (PE)
[81, 82]
114
8.7
PPP models and applications (PMA)
[83, 84]
188
14.1
Economics and financing (EF)
[85, 86]
91
6.8
Contract management (CM)
[87, 88]
82
6.1
Procurement management (PM)
[89, 90]
45
3.4
Legislation and legal issues (LLI)
[91, 92]
40
3.0
Hindering PPP factors (HPF)
[93, 94]
34
2.5
Innovation in PPP (IP)
[95, 96]
46
3.4
Value for money (VFM)
[97, 98]
26
2.0
Concession-related models, pricing, and periods (CMPP)
[99, 100]
18
1.3
Others
[101, 102]
62
4.6Each key issue in Table10 is accompanied with examples of studies from the literature sample. Other key issues studied in the PPP literature include sustainability [103], general summary of PPP project experience [104], overview of PPP research trends [18], application conditions of PPP [105], comparative analysis of PPP [106], and public involvement [107]. Table 10 conveys the information that project governance and risk-related topics have been the most frequently studied issues in the last ten years. Other key issues which were also predicted by Tang et al. [7] that would receive wide concern in PPP research include financing and costs, CSF, risk allocation and management (RAM), concession-related issues (e.g., concession period), contract management (CM), development of PPP models, and applications. Taking RAM, for example, which is always an active research topic for PPP projects [7], most studies of RAM paid attention to which and to what extent of the risks should be allocated to the relevant stakeholders, i.e., government or private side, and few studies focused on designing or carrying out a realistic risk sharing strategy or reasonable risk sharing ratio between the two parties [73].


## 3.1. An Overview of the PPP Literature Sample

The numbers of journal articles published from 2008 to 2018 in the literature sample are summarized in Figure2.Figure 2
Number of journal articles published from 2008 to 2018.It can be seen in Figure2 that generally the number of yearly number of articles has slowly been increasing from 2008 to 2017, with a significant increase in 2018 to reach 353 articles. It could be inferred that the academic research of PPP themes in project management has been remaining or even becoming more popular in recent years. The sources of these articles are visualized in Figure 3 and further described in Table 1.Figure 3
Mapping of sources of journal articles within this research. Note: Journal names are presented in Figure2 using acronyms or abbreviation. The full name of journals can be found in Table 1.Table 1
Analysis of sources in PPP.
Source
Acronym or abbreviation in Figure3
Total link strength
Number of articles
Total citations
Average citations
Built Environment Project and Asset Management
BEPAM
66
22
85
3.9
Construction Management and Economics
Constr. Manage. Econ.
188
27
522
19.3
Engineering, Construction and Architectural Management
ECAM
46
11
119
10.8
Proceedings of Institution of Civil Engineers: Management, Procurement and Law
ICE: MPL
7
17
32
1.9
International Journal of Project Management
Int. J. Proj. Manage.
366
45
887
19.7
International Journal of Strategic Property Management
Int. J. Strateg. Prop. Manage.
112
17
127
7.5
Journal of Cleaner Production
J. Clean. Prod.
33
10
37
3.7
Journal of Management in Engineering
J. Manage. Eng.
113
33
365
11.1
Journal of Construction Engineering and Management
J. Constr. Eng. Manage.
193
41
723
17.6
Journal of Infrastructure Systems
J. Infrastruct. Syst
107
23
182
7.9
Journal of Financial Management of Property and Construction
JFMPC
26
17
103
6.1
Research in Transportation Economics
Res. Transp. Econ.
15
21
136
6.5
Sustainability (Switzerland)
Sustainability
99
39
66
1.7
Transport Policy
Trans. Policy
29
10
90
9.0
Total link strength corresponds to Figure3 and indicates the interrelatedness between the given journal and other peer journals.Setting the minimum number of articles and minimum citations of a source to be 10 and 10, respectively inVOSViewer, totally 14 sources met the requirements and visualized in Figure 3. It should be noticed that there is not really a standardized quantification for the threshold values of article number and citations [46]. However, following the scientometric analysis guide in other project management related studies (e.g., Oraee et al.) [34, 35, 46] and considering the context of this PPP literature sample, the minimum number of articles and citations were determined. Similar threshold values for keywords, coauthorship, articles, institutions, and countries in PPP-related research could also be determined in the consistent approach following these prior studies. A larger font size in Figure 3 indicates more articles published in the given source. The connection lines indicate the citation between the pair of given sources. For example, it can be found in Figure 3 that International Journal of Project Management (i.e., Int. J. Proj. Manage.) has a strong cocitation with Journal of Construction Engineering and Management (i.e., J. Constr. Eng. Manage.) in the PPP area. Detailed number of articles, link strength, and citations are listed in Table 1.Based on the link strength, number of articles published, number of citations, and average citation per article listed in Table1, the most influential sources in the PPP field would be International Journal of Project Management, followed by Construction Management and Economics, Journal of Construction Engineering and Management, and Journal of Management in Engineering. Other journals indicating the project sectors, including Journal of Infrastructure Systems and Research in Transportation Economics, although not with high total link strength, are also the main sources of the PPP literature considering the number of articles published in these two journals. Among the infrastructure sector, transportation is one of the main sectors that PPP research has focused on. Besides Research in Transportation Economics which contributes to 21 articles in this literature sample, other PPP-related research were found in the transportation sector in sources such as Transportation Research Part A: Policy and Practice, Transportation Research Part D: Transport and Environment, and Transportation Journal.


## 3.2. Science Mapping

Continuing usingVOSViewer as the science mapping tool, the following sientometric analysis was performed in terms of research keywords in the selected PPP literature sample, coauthorship, highly cited journal articles in PPP, and highly productive research organizations and countries in the field of PPP.


### 3.2.1. Co-Occurrence of Keywords

Keywords represent the core contents of existing studies and describe the areas researched within the boundaries of a domain [47]. According to van Eck and Waltman [48], a network of keywords provides the picture of knowledge in terms of patterns, relationships, and intellectual organization of research topics. From totally 2,669 keywords extracted through the literature database, with the minimum number of occurrences set at 5 using Author Keywords, and by removing some generic keywords (e.g., “PPP,” “public-private partnerships,” and “project,”), originally 99 keywords were generated. By further merging keywords with consistent semantic meanings (e.g., “case study” and “case studies”) and categorizing keywords (e.g., “risk analysis,” “risk management,” and “risk assessment” were all categorized into “risk allocation and management”), finally 72 keywords were generated. This corresponding network was created using VOSViewer in Figure 4.Figure 4
Co-occurrence of keywords.The following can be indicated from the node size and connection lines: (1) Risk allocation and management (RAM) is one of the most frequently studied research topics in PPP projects. Other key research topics in PPP involve procurement, critical success factors (CSF), financing, concession, regulation, contracting, value for money (VFM), and governance. (2) Infrastructure, including roads and water, is the sector that PPP research has frequently focused on. (3) Some widely applied research methods used in PPP-based project management include case study, simulation, data mining, game theory, and fuzzy synthetic evaluation. (4) Besides developed countries (e.g., U.K., Australia, and Spain), PPP has also widely been studied in developing countries such as China, India, Ghana, Malaysia, and Nigeria. (5) The project participants (e.g., government and stakeholder) in both public and private sectors were also one key issue studied. (6) Sustainability and innovation were another two frequently studied issues in PPP research. A more quantitative analysis of these main keywords is summarized in Table2.Table 2
Summaries of most frequently studied keywords in PPP.
Studied keywords
Total link strength
Frequency
Average year published
Average citations
Risk Allocation and Management (RAM)
88
132
2013
12
Infrastructure
88
124
2014
11
Procurement
36
47
2013
13
Mainland China
34
43
2014
20
Financing
30
42
2013
9
Concession
26
37
2014
6
Sustainability
23
37
2016
3
Critical Success Factors
20
32
2015
13
Value for Money
20
32
2013
9
Developing Countries
25
30
2015
4
Transportation
18
29
2015
5
Government
19
27
2015
5
Real Option
19
27
2014
11
Contracting
15
26
2015
4
Australia
25
25
2013
11
Roads
17
24
2014
10
Water Sector
21
24
2012
7
Governance
13
23
2015
4
Case Study
11
18
2015
9
India
14
17
2014
6
Hong Kong
15
16
2013
15
Stakeholder
12
16
2015
10
Game Theory
9
14
2016
3
Monte Carlo Simulation
9
13
2016
5
Ghana
7
12
2017
3
Innovation
6
11
2015
6It should be noticed that only part of the most frequently studied keywords from the total sample of 72 are listed in Table2. Most keywords appear in the literature from 2011 to 2014, indicating that most of them have been in the research community before 2014. Only a few other keywords including “game theory,” “Monte Carlo simulation,” and “data mining” appear, coming to the research community more recently with the average publication year in 2015. The correlation analysis among total link strength, frequency, and average citation of the totally 72 keywords revealed that the total link strength is highly correlated to the frequency of the keyword, with a Pearson correlation coefficient at 0.991. However, the average citation of a keyword is not affected by its frequency of being studied in the literature, with a Pearson correlation coefficient at 0.214 and corresponding p value at 0.071 between the average citation and the frequency. This weak relationship between frequency and average citation can be proved in the example of RAM, which has the highest frequency of being studied in the literature. Nevertheless, keywords that receive highest average citations is “Mainland China,” followed by Hong Kong, CSF, and “procurement.” It can be inferred that research topics related to CSF and procurement tend to have higher impact on the academic community of PPP, although RAM tends to be the most popular research topic.


### 3.2.2. Coauthorship Analysis

Awareness of the existing scientific collaboration networks in a research field enhances the access to funds, specialties, and expertise, improves productivity, and helps researchers reduce isolation [35]. The science mapping in VOSViewer was also used to identify the most productive scholars and the research collaboration among them. With totally 2,396 authors extracted from the literature sample and 3 articles and 30 citations set as the minimum criteria, totally 72 authors were found meeting the threshold. The coauthorship analysis is visualized in Figure 5.Figure 5
Coauthorship analysis.It can be indicated from the clusters represented by different colors of nodes, node sizes, and connection lines among scholars shown in Figure5 that Chan A. P. C., as the most productive author in PPP, has strong collaboration with Ameyaw E. E. and Oseu-Kyer R. Chan A. P. C. has also collaboration with the research network consisting of Ke Y., Wang S., Zou P. X. W., and Lam P. T. I. The other three PPP-based research networks tend to work more closely within their own groups. These three research groups are: (1) network consisting of Love P. E. D., Liu, J., Regan M., Smith J., and Cheah, C. Y. J.; (2) network comprised of Xu Y., Yeung J. F. Y., and Cheng H.; and (3) collaboration among Skiniewski M. J., Yuan J., and Li Q. More detailed description of these main active scholars in PPP field is provided in Table 3.Table 3
List of active scholars in PPP research.
Author
Total link strength
Number of articles
Total citations
Average publication year
Average citation
Ameyaw E. E.
8
10
59
2016
5.9
Chan A. P. C.
52
57
1069
2014
18.8
Chan D. W. M.
5
5
290
2010
58.0
Cheah C. Y. J.
5
5
43
2015
8.6
Cheng H.
2
3
36
2011
12.0
Cheung E.
14
15
490
2011
32.7
Garvin M. J.
2
4
55
2014
13.8
Kajewski S.
6
6
109
2010
18.2
Ke Y.
16
20
688
2012
34.4
Lam P. T. I.
9
10
367
2012
36.7
Li Q.
6
6
149
2012
24.8
Liu J.
14
17
131
2016
7.7
Liu T.
8
8
52
2015
6.5
Liu Y.
2
4
30
2017
7.5
Love P. E. D.
12
12
104
2015
8.7
Molenaar K. R.
1
3
44
2016
14.7
Osei-Kyei R.
15
15
63
2017
4.2
Regan M.
8
8
110
2014
13.8
Skibniewski M. J.
10
13
193
2014
14.8
Smith J.
13
13
133
2015
10.2
Wang S.
15
17
474
2013
27.9
Wang Y.
4
14
44
2016
3.1
Wilkinson S.
6
6
52
2014
8.7
Xiong W.
9
10
31
2016
3.1
Xu Y.
10
10
202
2013
20.2
Yeung J. F. Y.
8
8
254
2012
31.8
Yuan J.
7
7
129
2014
18.4
Zhang X.
3
13
127
2014
9.8
Zhao X.
2
5
70
2017
14.0
Zou P. X. W.
2
3
57
2011
19.0Totally 30 productive authors are listed in Table3. Their average publication years of articles range from 2011 to 2017. Scholars such as Zou P. X. W., Cheng H., and Cheung E. have more of their PPP articles published in earlier years around 2011. In comparison, some scholars are more recently active researchers in the PPP field. For example, Osei-Kyei R. and Ameyaw E. E. have their work published more recently in 2017 and 2016, respectively. The four major parameters of scholars’ PPP research outputs, namely, total link strength, number of articles published, total citations in the academic community, and average citation per article, are analyzed of their internal correlations. Table 4 summarizes the correlation analysis results.Table 4
The Pearson correlation analysis among parameters related to authors’ impact on PPP research community.
Correlation analysis
Total link strength
Number of articles
Total citations
Average citation
Total link strength
r = 0.965; p=0.000
r = 0.835; p=0.000
r = 0.093; p=0.626
Number of articles
r = 0.830; p=0.000
r = 0.034; p=0.857
Total citations
r = 0.522; p=0.003
r is the Pearson correlation between the selected pair of authors’ parameters, and a corresponding p value lower than 0.05 would indicate a significant relationship between the pair of parameters.It is found from Table4 that average citation per article is not related to the total link strength or number of articles published by a scholar. However, it has significant correlation with the total citations. For example, Chan D. W. M., although having only published five articles, has the highest average citation at 58.0 and also high total citations at 290. An author who has published more articles will have also a higher impact on the research community measured by total link strength (e.g., Chan A. P. C.).


### 3.2.3. Citation of Articles

Published PPP-related articles were also mapped based on the citation numbers received. With the minimum number of citations of an article set at 30, totally 64 meet the threshold. These articles receiving most citations are visualized in Figure6.Figure 6
Science mapping of PPP articles.It can be found from Figure6 that these most influential PPP articles in recent ten years were published from 2008 to 2012. Many of these published studies were led by active scholars included in Figure 5 and Table 3, such as Ke Y., Chan A. P. C., Yuan J., and Xu Y. These top 15 articles receiving the highest citations are listed in Table 5.Table 5
List of PPP articles with high citations.
Article
Title
Number of links
Number of citations
Ke et al. [49]
Preferred risk allocation in China’s public–private partnership (PPP) projects
8
116
Chan et al. [50]
Critical success factors for PPPs in infrastructure developments: Chinese perspective
1
105
Tang et al. [7]
A review of studies on public–private partnership projects in the construction industry
2
93
Yuan et al. [51]
Selection of performance objectives and key performance indicators in public–private partnership projects to achieve value for money
3
82
Xu et al. [52]
Developing a risk assessment model for PPP projects in China—a fuzzy synthetic evaluation approach
6
80
Jin and Doloi [53]
Interpreting risk allocation mechanism in public–private partnership projects: An empirical study in a transaction cost economics perspective
8
75
Ke et al. [18]
Research trends of public-private partnership in construction journals
3
74
Jacobson and Choi [54]
Success factors: public works and public-private partnerships
2
70
Roumboutsos a Anagnostopoulos [57]
Public–private partnership projects in Greece: risk ranking and preferred risk allocation
6
61
Chan et al. [16]
Empirical study of risk assessment and allocation of public-private partnership projects in China
4
60
Xu et al. [51]
Developing a fuzzy risk allocation model for PPP projects in China
1
55
Iyer and Sagheer [57]
Hierarchical structuring of PPP risks using interpretative structural modeling
1
54
Jin and Zhang [58]
Modeling optimal risk allocation in PPP projects using artificial neural networks
2
53
Hwang et al. [59]
Public-private partnership projects in Singapore: factors, critical risks and preferred risk allocation from the perspective of contractors
5
51
Raisbeck et al. [60]
Comparative performance of PPPs and traditional procurement in Australia
1
49The number of links listed in Table5 indicated the interrelatedness of the article to others in the selected sample of highly cited articles. An article with more links indicates that it is more highly cited or citing other articles in the sample. However, it differs from the number of citation in that the latter shows the overall impact of the article to the whole research community. These two parameters are not correlated. For example, the article published by Chan et al. [50] received one of the highest citations in PPP field, although it is with only one link among these articles in the network shown in Figure 6. In contrast, the article published by Jin and Doloi [53] was cited by only 75 times, but it has eight links with other articles shown in Figure 6, indicating its higher degree of interrelatedness with the rest of the articles.


### 3.2.4. Institutions Productive in PPP Research

Adopting VOSViewer, institutions were analyzed of their contributions to the research outputs of PPP. By setting the minimum number of articles at 3 and minimum citations at 30 as threshold values to screen the totally 2,182 institutions, 14 of them were identified as most research active organizations in PPP.Figure7 conveys the information that Hong Kong-based universities, including Hong Kong Polytechnic University (HK Poly U), Hong Kong University of Science and Technology, and Hong Kong Baptist University, are active in PPP research. These three universities have developed their research collaboration with peer institutions in the mainland of China. For example, HK Poly U has displayed strong collaboration with Tsinghua University, Zhejiang Sci-Tech University, and Southeast University in China. The closer geographic distance could be one factor driving the collaboration for these universities among Taiwan, Hong Kong, and mainland of China (i.e., HK Poly U, National Taiwan University, and Tsinghua University China). In comparison, Australian universities, including Bond University, Queensland University of Technology, and Curtin University, seem more closely collaborating among themselves by forming their own cluster, although they have developed certain collaboration with peer institutions from other continents, including University of Maryland, Southeast University China, and HK Poly U.Figure 7
Mapping of organizations active in PPP research.


### 3.2.5. Countries or Regions Active in PPP Research

Similar to the study of institutions productive in PPP research, countries that have been active in PPP research were also analyzed. Setting the minimum number of articles published at 5, minimum citations received at 30, totally 32 out of 96 countries met the threshold. These countries where most PPP researchers were based are visualized in Figure8.Figure 8
Mapping of countries/regions where PPP researchers were located.It can be inferred from Figure8 that PPP researchers have widely distributed crossing developing and developed countries. Developed countries including U.K., U.S., and Australia have largely contributed to the PPP research field. Researchers from developing countries, as indicated by both Figures 4 and 8, have also been active in PPP research, such as China, India, Malaysia, and Ghana. These quantitative measurements of countries where PPP researchers are located are summarized in Table 6.Table 6
Countries or regions where PPP researchers are based.
Country/region
Total link strength
Number of articles
Number of citations
Average publication year
Average citation
Mainland China
1740
180
1428
2016
7.9
U.S.
683
159
958
2015
6.0
Australia
1211
126
1077
2015
8.5
UK
591
125
895
2014
7.2
Hong Kong
1250
93
1289
2014
13.9
Netherlands
276
61
676
2014
11.1
India
218
57
305
2015
5.4
Russian Federation
58
51
56
2016
1.1
Italy
247
47
269
2015
5.7
Spain
161
45
197
2015
4.4
Canada
138
44
255
2015
5.8
Malaysia
216
37
158
2015
4.3
Germany
97
30
186
2013
6.2
Belgium
121
27
122
2016
4.5
Singapore
320
26
347
2013
13.3
Taiwan
274
26
151
2015
5.8
France
107
25
286
2014
11.4
South Korea
120
23
123
2016
5.3
Brazil
55
22
96
2015
4.4
Portugal
109
22
171
2014
7.8
Not all 32 countries are listed in Table6 but the top 20 countries with most PPP articles published are listed.Table6 shows that China is the country that is most productive in PPP research in terms of total link strength, number of PPP journal articles published, and total citations. With China as the exception, developed countries or regions are mainstream contributors to PPP research. As can be seen in Table 6, U.S., U.K., Australia, Hong Kong, and Netherlands are also highly productive in PPP studies. The average publication year of articles generally range from 2011 to 2014 among the 32 countries, with the exception that Russia and Belgium are with articles published around 2015. It is inferred that these two countries have more recently become active in PPP research. A correlation analysis among the four parameters (i.e., total link strength, number of articles published, total citations, and average citations) is performed and summarized in Table 7.Table 7
Pearson correlation analysis among parameters related to countries/regions’ impacts on PPP research.
Correlation analysis
Total link strength
Number of articles
Number of citations
Average citation
Total link strength
r = 0.871; p=0.000
r = 0.947; p=0.000
r = 0.324; p=0.070
Number of articles
r = 0.920; p=0.000
r = 0.101; p=0.582
Number of citations
r = 0.404; p=0.022Table7 demonstrates that these four parameters are generally significantly correlated to each other, except that the number of articles published from a country is not correlated to the average citation per article. Overall, a country’s impact to the global PPP research community can be measured by either total link strength, number of published journal articles, total citations, or average citation.


## 3.2.1. Co-Occurrence of Keywords

Keywords represent the core contents of existing studies and describe the areas researched within the boundaries of a domain [47]. According to van Eck and Waltman [48], a network of keywords provides the picture of knowledge in terms of patterns, relationships, and intellectual organization of research topics. From totally 2,669 keywords extracted through the literature database, with the minimum number of occurrences set at 5 using Author Keywords, and by removing some generic keywords (e.g., “PPP,” “public-private partnerships,” and “project,”), originally 99 keywords were generated. By further merging keywords with consistent semantic meanings (e.g., “case study” and “case studies”) and categorizing keywords (e.g., “risk analysis,” “risk management,” and “risk assessment” were all categorized into “risk allocation and management”), finally 72 keywords were generated. This corresponding network was created using VOSViewer in Figure 4.Figure 4
Co-occurrence of keywords.The following can be indicated from the node size and connection lines: (1) Risk allocation and management (RAM) is one of the most frequently studied research topics in PPP projects. Other key research topics in PPP involve procurement, critical success factors (CSF), financing, concession, regulation, contracting, value for money (VFM), and governance. (2) Infrastructure, including roads and water, is the sector that PPP research has frequently focused on. (3) Some widely applied research methods used in PPP-based project management include case study, simulation, data mining, game theory, and fuzzy synthetic evaluation. (4) Besides developed countries (e.g., U.K., Australia, and Spain), PPP has also widely been studied in developing countries such as China, India, Ghana, Malaysia, and Nigeria. (5) The project participants (e.g., government and stakeholder) in both public and private sectors were also one key issue studied. (6) Sustainability and innovation were another two frequently studied issues in PPP research. A more quantitative analysis of these main keywords is summarized in Table2.Table 2
Summaries of most frequently studied keywords in PPP.
Studied keywords
Total link strength
Frequency
Average year published
Average citations
Risk Allocation and Management (RAM)
88
132
2013
12
Infrastructure
88
124
2014
11
Procurement
36
47
2013
13
Mainland China
34
43
2014
20
Financing
30
42
2013
9
Concession
26
37
2014
6
Sustainability
23
37
2016
3
Critical Success Factors
20
32
2015
13
Value for Money
20
32
2013
9
Developing Countries
25
30
2015
4
Transportation
18
29
2015
5
Government
19
27
2015
5
Real Option
19
27
2014
11
Contracting
15
26
2015
4
Australia
25
25
2013
11
Roads
17
24
2014
10
Water Sector
21
24
2012
7
Governance
13
23
2015
4
Case Study
11
18
2015
9
India
14
17
2014
6
Hong Kong
15
16
2013
15
Stakeholder
12
16
2015
10
Game Theory
9
14
2016
3
Monte Carlo Simulation
9
13
2016
5
Ghana
7
12
2017
3
Innovation
6
11
2015
6It should be noticed that only part of the most frequently studied keywords from the total sample of 72 are listed in Table2. Most keywords appear in the literature from 2011 to 2014, indicating that most of them have been in the research community before 2014. Only a few other keywords including “game theory,” “Monte Carlo simulation,” and “data mining” appear, coming to the research community more recently with the average publication year in 2015. The correlation analysis among total link strength, frequency, and average citation of the totally 72 keywords revealed that the total link strength is highly correlated to the frequency of the keyword, with a Pearson correlation coefficient at 0.991. However, the average citation of a keyword is not affected by its frequency of being studied in the literature, with a Pearson correlation coefficient at 0.214 and corresponding p value at 0.071 between the average citation and the frequency. This weak relationship between frequency and average citation can be proved in the example of RAM, which has the highest frequency of being studied in the literature. Nevertheless, keywords that receive highest average citations is “Mainland China,” followed by Hong Kong, CSF, and “procurement.” It can be inferred that research topics related to CSF and procurement tend to have higher impact on the academic community of PPP, although RAM tends to be the most popular research topic.


## 3.2.2. Coauthorship Analysis

Awareness of the existing scientific collaboration networks in a research field enhances the access to funds, specialties, and expertise, improves productivity, and helps researchers reduce isolation [35]. The science mapping in VOSViewer was also used to identify the most productive scholars and the research collaboration among them. With totally 2,396 authors extracted from the literature sample and 3 articles and 30 citations set as the minimum criteria, totally 72 authors were found meeting the threshold. The coauthorship analysis is visualized in Figure 5.Figure 5
Coauthorship analysis.It can be indicated from the clusters represented by different colors of nodes, node sizes, and connection lines among scholars shown in Figure5 that Chan A. P. C., as the most productive author in PPP, has strong collaboration with Ameyaw E. E. and Oseu-Kyer R. Chan A. P. C. has also collaboration with the research network consisting of Ke Y., Wang S., Zou P. X. W., and Lam P. T. I. The other three PPP-based research networks tend to work more closely within their own groups. These three research groups are: (1) network consisting of Love P. E. D., Liu, J., Regan M., Smith J., and Cheah, C. Y. J.; (2) network comprised of Xu Y., Yeung J. F. Y., and Cheng H.; and (3) collaboration among Skiniewski M. J., Yuan J., and Li Q. More detailed description of these main active scholars in PPP field is provided in Table 3.Table 3
List of active scholars in PPP research.
Author
Total link strength
Number of articles
Total citations
Average publication year
Average citation
Ameyaw E. E.
8
10
59
2016
5.9
Chan A. P. C.
52
57
1069
2014
18.8
Chan D. W. M.
5
5
290
2010
58.0
Cheah C. Y. J.
5
5
43
2015
8.6
Cheng H.
2
3
36
2011
12.0
Cheung E.
14
15
490
2011
32.7
Garvin M. J.
2
4
55
2014
13.8
Kajewski S.
6
6
109
2010
18.2
Ke Y.
16
20
688
2012
34.4
Lam P. T. I.
9
10
367
2012
36.7
Li Q.
6
6
149
2012
24.8
Liu J.
14
17
131
2016
7.7
Liu T.
8
8
52
2015
6.5
Liu Y.
2
4
30
2017
7.5
Love P. E. D.
12
12
104
2015
8.7
Molenaar K. R.
1
3
44
2016
14.7
Osei-Kyei R.
15
15
63
2017
4.2
Regan M.
8
8
110
2014
13.8
Skibniewski M. J.
10
13
193
2014
14.8
Smith J.
13
13
133
2015
10.2
Wang S.
15
17
474
2013
27.9
Wang Y.
4
14
44
2016
3.1
Wilkinson S.
6
6
52
2014
8.7
Xiong W.
9
10
31
2016
3.1
Xu Y.
10
10
202
2013
20.2
Yeung J. F. Y.
8
8
254
2012
31.8
Yuan J.
7
7
129
2014
18.4
Zhang X.
3
13
127
2014
9.8
Zhao X.
2
5
70
2017
14.0
Zou P. X. W.
2
3
57
2011
19.0Totally 30 productive authors are listed in Table3. Their average publication years of articles range from 2011 to 2017. Scholars such as Zou P. X. W., Cheng H., and Cheung E. have more of their PPP articles published in earlier years around 2011. In comparison, some scholars are more recently active researchers in the PPP field. For example, Osei-Kyei R. and Ameyaw E. E. have their work published more recently in 2017 and 2016, respectively. The four major parameters of scholars’ PPP research outputs, namely, total link strength, number of articles published, total citations in the academic community, and average citation per article, are analyzed of their internal correlations. Table 4 summarizes the correlation analysis results.Table 4
The Pearson correlation analysis among parameters related to authors’ impact on PPP research community.
Correlation analysis
Total link strength
Number of articles
Total citations
Average citation
Total link strength
r = 0.965; p=0.000
r = 0.835; p=0.000
r = 0.093; p=0.626
Number of articles
r = 0.830; p=0.000
r = 0.034; p=0.857
Total citations
r = 0.522; p=0.003
r is the Pearson correlation between the selected pair of authors’ parameters, and a corresponding p value lower than 0.05 would indicate a significant relationship between the pair of parameters.It is found from Table4 that average citation per article is not related to the total link strength or number of articles published by a scholar. However, it has significant correlation with the total citations. For example, Chan D. W. M., although having only published five articles, has the highest average citation at 58.0 and also high total citations at 290. An author who has published more articles will have also a higher impact on the research community measured by total link strength (e.g., Chan A. P. C.).


## 3.2.3. Citation of Articles

Published PPP-related articles were also mapped based on the citation numbers received. With the minimum number of citations of an article set at 30, totally 64 meet the threshold. These articles receiving most citations are visualized in Figure6.Figure 6
Science mapping of PPP articles.It can be found from Figure6 that these most influential PPP articles in recent ten years were published from 2008 to 2012. Many of these published studies were led by active scholars included in Figure 5 and Table 3, such as Ke Y., Chan A. P. C., Yuan J., and Xu Y. These top 15 articles receiving the highest citations are listed in Table 5.Table 5
List of PPP articles with high citations.
Article
Title
Number of links
Number of citations
Ke et al. [49]
Preferred risk allocation in China’s public–private partnership (PPP) projects
8
116
Chan et al. [50]
Critical success factors for PPPs in infrastructure developments: Chinese perspective
1
105
Tang et al. [7]
A review of studies on public–private partnership projects in the construction industry
2
93
Yuan et al. [51]
Selection of performance objectives and key performance indicators in public–private partnership projects to achieve value for money
3
82
Xu et al. [52]
Developing a risk assessment model for PPP projects in China—a fuzzy synthetic evaluation approach
6
80
Jin and Doloi [53]
Interpreting risk allocation mechanism in public–private partnership projects: An empirical study in a transaction cost economics perspective
8
75
Ke et al. [18]
Research trends of public-private partnership in construction journals
3
74
Jacobson and Choi [54]
Success factors: public works and public-private partnerships
2
70
Roumboutsos a Anagnostopoulos [57]
Public–private partnership projects in Greece: risk ranking and preferred risk allocation
6
61
Chan et al. [16]
Empirical study of risk assessment and allocation of public-private partnership projects in China
4
60
Xu et al. [51]
Developing a fuzzy risk allocation model for PPP projects in China
1
55
Iyer and Sagheer [57]
Hierarchical structuring of PPP risks using interpretative structural modeling
1
54
Jin and Zhang [58]
Modeling optimal risk allocation in PPP projects using artificial neural networks
2
53
Hwang et al. [59]
Public-private partnership projects in Singapore: factors, critical risks and preferred risk allocation from the perspective of contractors
5
51
Raisbeck et al. [60]
Comparative performance of PPPs and traditional procurement in Australia
1
49The number of links listed in Table5 indicated the interrelatedness of the article to others in the selected sample of highly cited articles. An article with more links indicates that it is more highly cited or citing other articles in the sample. However, it differs from the number of citation in that the latter shows the overall impact of the article to the whole research community. These two parameters are not correlated. For example, the article published by Chan et al. [50] received one of the highest citations in PPP field, although it is with only one link among these articles in the network shown in Figure 6. In contrast, the article published by Jin and Doloi [53] was cited by only 75 times, but it has eight links with other articles shown in Figure 6, indicating its higher degree of interrelatedness with the rest of the articles.


## 3.2.4. Institutions Productive in PPP Research

Adopting VOSViewer, institutions were analyzed of their contributions to the research outputs of PPP. By setting the minimum number of articles at 3 and minimum citations at 30 as threshold values to screen the totally 2,182 institutions, 14 of them were identified as most research active organizations in PPP.Figure7 conveys the information that Hong Kong-based universities, including Hong Kong Polytechnic University (HK Poly U), Hong Kong University of Science and Technology, and Hong Kong Baptist University, are active in PPP research. These three universities have developed their research collaboration with peer institutions in the mainland of China. For example, HK Poly U has displayed strong collaboration with Tsinghua University, Zhejiang Sci-Tech University, and Southeast University in China. The closer geographic distance could be one factor driving the collaboration for these universities among Taiwan, Hong Kong, and mainland of China (i.e., HK Poly U, National Taiwan University, and Tsinghua University China). In comparison, Australian universities, including Bond University, Queensland University of Technology, and Curtin University, seem more closely collaborating among themselves by forming their own cluster, although they have developed certain collaboration with peer institutions from other continents, including University of Maryland, Southeast University China, and HK Poly U.Figure 7
Mapping of organizations active in PPP research.


## 3.2.5. Countries or Regions Active in PPP Research

Similar to the study of institutions productive in PPP research, countries that have been active in PPP research were also analyzed. Setting the minimum number of articles published at 5, minimum citations received at 30, totally 32 out of 96 countries met the threshold. These countries where most PPP researchers were based are visualized in Figure8.Figure 8
Mapping of countries/regions where PPP researchers were located.It can be inferred from Figure8 that PPP researchers have widely distributed crossing developing and developed countries. Developed countries including U.K., U.S., and Australia have largely contributed to the PPP research field. Researchers from developing countries, as indicated by both Figures 4 and 8, have also been active in PPP research, such as China, India, Malaysia, and Ghana. These quantitative measurements of countries where PPP researchers are located are summarized in Table 6.Table 6
Countries or regions where PPP researchers are based.
Country/region
Total link strength
Number of articles
Number of citations
Average publication year
Average citation
Mainland China
1740
180
1428
2016
7.9
U.S.
683
159
958
2015
6.0
Australia
1211
126
1077
2015
8.5
UK
591
125
895
2014
7.2
Hong Kong
1250
93
1289
2014
13.9
Netherlands
276
61
676
2014
11.1
India
218
57
305
2015
5.4
Russian Federation
58
51
56
2016
1.1
Italy
247
47
269
2015
5.7
Spain
161
45
197
2015
4.4
Canada
138
44
255
2015
5.8
Malaysia
216
37
158
2015
4.3
Germany
97
30
186
2013
6.2
Belgium
121
27
122
2016
4.5
Singapore
320
26
347
2013
13.3
Taiwan
274
26
151
2015
5.8
France
107
25
286
2014
11.4
South Korea
120
23
123
2016
5.3
Brazil
55
22
96
2015
4.4
Portugal
109
22
171
2014
7.8
Not all 32 countries are listed in Table6 but the top 20 countries with most PPP articles published are listed.Table6 shows that China is the country that is most productive in PPP research in terms of total link strength, number of PPP journal articles published, and total citations. With China as the exception, developed countries or regions are mainstream contributors to PPP research. As can be seen in Table 6, U.S., U.K., Australia, Hong Kong, and Netherlands are also highly productive in PPP studies. The average publication year of articles generally range from 2011 to 2014 among the 32 countries, with the exception that Russia and Belgium are with articles published around 2015. It is inferred that these two countries have more recently become active in PPP research. A correlation analysis among the four parameters (i.e., total link strength, number of articles published, total citations, and average citations) is performed and summarized in Table 7.Table 7
Pearson correlation analysis among parameters related to countries/regions’ impacts on PPP research.
Correlation analysis
Total link strength
Number of articles
Number of citations
Average citation
Total link strength
r = 0.871; p=0.000
r = 0.947; p=0.000
r = 0.324; p=0.070
Number of articles
r = 0.920; p=0.000
r = 0.101; p=0.582
Number of citations
r = 0.404; p=0.022Table7 demonstrates that these four parameters are generally significantly correlated to each other, except that the number of articles published from a country is not correlated to the average citation per article. Overall, a country’s impact to the global PPP research community can be measured by either total link strength, number of published journal articles, total citations, or average citation.


## 3.3. Systematic Review

Based on the analysis from science mapping, systematic review was performed to the literature sample in terms of the research methodology, project sectors, studied regions/countries, and qualitative analysis of key issues within PPP. It should be noticed that studied region/countries differ from science mapping shown in Figure8, where the countries refer to where the authors of the published literature were based. The studied countries or regions in this section refer to whether the PPP-related study was performed in the context of a certain country or region. An example explaining the difference could be the study of Osei-Kyei and Chan [61]; while the researchers were located in Hong Kong, the studied country included Ghana.


### 3.3.1. Summary of Research Methods

The 1,209 articles were summarized of their research methods. As indicated by Figure4, case studies and other modeling methods (e.g., fuzzy synthetic evaluation) were widely been applied in PPP studies. These main research methods listed in Table 8 include case studies, research modeling and framework, questionnaire survey, interview, literature review, and others.Table 8
Summary of research methodologies in the literature sample.
Research method
Number of articles
Percentage
Case study
375
29.0
Modeling or framework/model development
398
31.0
Questionnaire survey
113
8.7
Interview
105
8.1
Review
54
4.2
Others
248
19.0
The total percentage may be summed up to be over 100%, as some studies may adopt more than one method. The case that the summed percentage may be higher than 100% also applies to Tables 9 and 10 where the project sectors and key issues in PPP are summarized respectively.Other methods listed in Table8 refer to those without specified methods or generally with qualitative analysis. For example, in the study of Brthen and Odeck [62], an overview of various toll road projects was provided followed by discussions on socioeconomic efficiency via public funding. Similar qualitative analysis can be found in PPP studies including Sohail and Maslyukivska [63], Tang and Lo [64], Mahalingam et al. [65], Petersen [66], and Deshpande and Rokade [67]. It can be found from Table 8 that case studies and modeling are the mainstream research methods implemented in PPP research, followed by questionnaire-based survey and interview to PPP-related professionals. Case studies have been chosen as the research methodology due to the exploratory nature of the research, the limited amount of similar previous research, and the intent to develop knowledge on a contemporary phenomenon [68, 69]. Modeling approach has also widely been applied in PPP-involved projects to achieve optimized project performance by considering uncertainties and risks during the project delivery process. Examples of modelling approach in PPP projects include Carbonara and Pellegrino [70] where Monte Carlo simulation was employed, Osei-Kyei and Chan [61] who adopted fuzzy synthetic evaluation method, and Roumboutsos et al. [71] who applied the game theoretic model. Previous studies had also focused on establishing, developing, and testing frameworks for PPP projects, such as Shrestha et al.’s [72] work to build the framework to examine risk allocation for PPP water projects in China. Questionnaire survey, interviews, and review are not unique in PPP research but commonly adopted methods in the field of project management.


### 3.3.2. Project Sectors

Project sectors targeted in the PPP literature sample are summarized in Table9.Table 9
Summary of project sectors in the PPP literature.
Project sectors
Number of articles
Percentage
Transportation
162
13.4
Water
62
5.1
Healthcare
63
5.2
Other construction projects
42
3.5
Public housing
27
2.2
Education
27
2.2
Agriculture
31
2.6
Energy
36
3.0
Waste recycling
15
1.2
Information and communication technology
11
1.0
Preventation/postdisaster projects
6
0.5
Tourism
17
1.4
Physical culture and sport
5
0.4
Apparel and textile industry
1
0.1
Prison
3
0.2
Unspecified
700
58.0
Other construction projects include museum and building construction.Consistent to the statistical summary performed by de Castro e Silva Neto et al. [21], the majority of PPP studies did not specify the project sectors. As indicated from the science mapping presented in Figure 4, infrastructure was one of the most frequently studied keywords in the PPP literature. Among the infrastructure projects, transportation was the sector that was most widely studied according to this study and that of de Castro e Silva Neto et al. [21]. Consistently between these two studies, PPP projects were found applied in multiple sectors including health, education, housing, energy, agriculture, and communication. However, unlike the study of de Castro e Silva Neto et al. [21], who found that the health sector was the second most widely studied sector in PPP, this research identified the water sector as the second most frequently studied sector followed by the health sector. This difference could be due to the years and types of the literature selected. This study only chose journal articles published within the recent ten years, and de Castro e Silva Neto et al. [21] used the literature including both journal articles and conference papers published from 1990 to 2014. It seems that journal articles have been focusing more on infrastructure project sectors, including transportation and water and waste management.


### 3.3.3. Studied Regions/Countries

The countries or regions where PPP studies were conducted were also summarized. Around 40% of the selected studies did not specify countries. For the remaining studies falling into the context of certain countries or regions, the frequencies of countries targeted in the literature sample are presented in Figure9.Figure 9
Frequencies of countries that have been studied in the literature sample.It is shown in Figure9 that China is the country that has been studied most frequently from the selected literature. Figure 8 and Table 6 show that China was the country where scholars had published most PPP-related articles, and Figure 9 further infers that China is also the country that has received the highest attention on PPP research. This could be due to fact indicated by Zhang et al. [73] and Yang et al. [74] that PPP has been gaining wide implementation and aroused a wide attention from Chinese industry, government, and academia in the last decade.


### 3.3.4. Qualitative Analysis of Key Issues

Following the studies of Tang et al. [7] and de Castro e Silva Neto et al. [21], as well as key research topics mapped in Figure 4 and Table 2, key issues that have been studied in the literature sample are listed in Table 10.Table 10
Summary of key issues in the literature sample.
Key issues
References
Number of articles
Percentage
Project governance (PG)
Guarini and Battisti [75]; Opara and Elloumi [76]
303
22.7
Risk allocation and management (RAM)
[77, 78]
166
12.4
Critical success factors (CSF)
[79, 80]
120
9.0
Performance evaluation (PE)
[81, 82]
114
8.7
PPP models and applications (PMA)
[83, 84]
188
14.1
Economics and financing (EF)
[85, 86]
91
6.8
Contract management (CM)
[87, 88]
82
6.1
Procurement management (PM)
[89, 90]
45
3.4
Legislation and legal issues (LLI)
[91, 92]
40
3.0
Hindering PPP factors (HPF)
[93, 94]
34
2.5
Innovation in PPP (IP)
[95, 96]
46
3.4
Value for money (VFM)
[97, 98]
26
2.0
Concession-related models, pricing, and periods (CMPP)
[99, 100]
18
1.3
Others
[101, 102]
62
4.6Each key issue in Table10 is accompanied with examples of studies from the literature sample. Other key issues studied in the PPP literature include sustainability [103], general summary of PPP project experience [104], overview of PPP research trends [18], application conditions of PPP [105], comparative analysis of PPP [106], and public involvement [107]. Table 10 conveys the information that project governance and risk-related topics have been the most frequently studied issues in the last ten years. Other key issues which were also predicted by Tang et al. [7] that would receive wide concern in PPP research include financing and costs, CSF, risk allocation and management (RAM), concession-related issues (e.g., concession period), contract management (CM), development of PPP models, and applications. Taking RAM, for example, which is always an active research topic for PPP projects [7], most studies of RAM paid attention to which and to what extent of the risks should be allocated to the relevant stakeholders, i.e., government or private side, and few studies focused on designing or carrying out a realistic risk sharing strategy or reasonable risk sharing ratio between the two parties [73].


## 3.3.1. Summary of Research Methods

The 1,209 articles were summarized of their research methods. As indicated by Figure4, case studies and other modeling methods (e.g., fuzzy synthetic evaluation) were widely been applied in PPP studies. These main research methods listed in Table 8 include case studies, research modeling and framework, questionnaire survey, interview, literature review, and others.Table 8
Summary of research methodologies in the literature sample.
Research method
Number of articles
Percentage
Case study
375
29.0
Modeling or framework/model development
398
31.0
Questionnaire survey
113
8.7
Interview
105
8.1
Review
54
4.2
Others
248
19.0
The total percentage may be summed up to be over 100%, as some studies may adopt more than one method. The case that the summed percentage may be higher than 100% also applies to Tables 9 and 10 where the project sectors and key issues in PPP are summarized respectively.Other methods listed in Table8 refer to those without specified methods or generally with qualitative analysis. For example, in the study of Brthen and Odeck [62], an overview of various toll road projects was provided followed by discussions on socioeconomic efficiency via public funding. Similar qualitative analysis can be found in PPP studies including Sohail and Maslyukivska [63], Tang and Lo [64], Mahalingam et al. [65], Petersen [66], and Deshpande and Rokade [67]. It can be found from Table 8 that case studies and modeling are the mainstream research methods implemented in PPP research, followed by questionnaire-based survey and interview to PPP-related professionals. Case studies have been chosen as the research methodology due to the exploratory nature of the research, the limited amount of similar previous research, and the intent to develop knowledge on a contemporary phenomenon [68, 69]. Modeling approach has also widely been applied in PPP-involved projects to achieve optimized project performance by considering uncertainties and risks during the project delivery process. Examples of modelling approach in PPP projects include Carbonara and Pellegrino [70] where Monte Carlo simulation was employed, Osei-Kyei and Chan [61] who adopted fuzzy synthetic evaluation method, and Roumboutsos et al. [71] who applied the game theoretic model. Previous studies had also focused on establishing, developing, and testing frameworks for PPP projects, such as Shrestha et al.’s [72] work to build the framework to examine risk allocation for PPP water projects in China. Questionnaire survey, interviews, and review are not unique in PPP research but commonly adopted methods in the field of project management.


## 3.3.2. Project Sectors

Project sectors targeted in the PPP literature sample are summarized in Table9.Table 9
Summary of project sectors in the PPP literature.
Project sectors
Number of articles
Percentage
Transportation
162
13.4
Water
62
5.1
Healthcare
63
5.2
Other construction projects
42
3.5
Public housing
27
2.2
Education
27
2.2
Agriculture
31
2.6
Energy
36
3.0
Waste recycling
15
1.2
Information and communication technology
11
1.0
Preventation/postdisaster projects
6
0.5
Tourism
17
1.4
Physical culture and sport
5
0.4
Apparel and textile industry
1
0.1
Prison
3
0.2
Unspecified
700
58.0
Other construction projects include museum and building construction.Consistent to the statistical summary performed by de Castro e Silva Neto et al. [21], the majority of PPP studies did not specify the project sectors. As indicated from the science mapping presented in Figure 4, infrastructure was one of the most frequently studied keywords in the PPP literature. Among the infrastructure projects, transportation was the sector that was most widely studied according to this study and that of de Castro e Silva Neto et al. [21]. Consistently between these two studies, PPP projects were found applied in multiple sectors including health, education, housing, energy, agriculture, and communication. However, unlike the study of de Castro e Silva Neto et al. [21], who found that the health sector was the second most widely studied sector in PPP, this research identified the water sector as the second most frequently studied sector followed by the health sector. This difference could be due to the years and types of the literature selected. This study only chose journal articles published within the recent ten years, and de Castro e Silva Neto et al. [21] used the literature including both journal articles and conference papers published from 1990 to 2014. It seems that journal articles have been focusing more on infrastructure project sectors, including transportation and water and waste management.


## 3.3.3. Studied Regions/Countries

The countries or regions where PPP studies were conducted were also summarized. Around 40% of the selected studies did not specify countries. For the remaining studies falling into the context of certain countries or regions, the frequencies of countries targeted in the literature sample are presented in Figure9.Figure 9
Frequencies of countries that have been studied in the literature sample.It is shown in Figure9 that China is the country that has been studied most frequently from the selected literature. Figure 8 and Table 6 show that China was the country where scholars had published most PPP-related articles, and Figure 9 further infers that China is also the country that has received the highest attention on PPP research. This could be due to fact indicated by Zhang et al. [73] and Yang et al. [74] that PPP has been gaining wide implementation and aroused a wide attention from Chinese industry, government, and academia in the last decade.


## 3.3.4. Qualitative Analysis of Key Issues

Following the studies of Tang et al. [7] and de Castro e Silva Neto et al. [21], as well as key research topics mapped in Figure 4 and Table 2, key issues that have been studied in the literature sample are listed in Table 10.Table 10
Summary of key issues in the literature sample.
Key issues
References
Number of articles
Percentage
Project governance (PG)
Guarini and Battisti [75]; Opara and Elloumi [76]
303
22.7
Risk allocation and management (RAM)
[77, 78]
166
12.4
Critical success factors (CSF)
[79, 80]
120
9.0
Performance evaluation (PE)
[81, 82]
114
8.7
PPP models and applications (PMA)
[83, 84]
188
14.1
Economics and financing (EF)
[85, 86]
91
6.8
Contract management (CM)
[87, 88]
82
6.1
Procurement management (PM)
[89, 90]
45
3.4
Legislation and legal issues (LLI)
[91, 92]
40
3.0
Hindering PPP factors (HPF)
[93, 94]
34
2.5
Innovation in PPP (IP)
[95, 96]
46
3.4
Value for money (VFM)
[97, 98]
26
2.0
Concession-related models, pricing, and periods (CMPP)
[99, 100]
18
1.3
Others
[101, 102]
62
4.6Each key issue in Table10 is accompanied with examples of studies from the literature sample. Other key issues studied in the PPP literature include sustainability [103], general summary of PPP project experience [104], overview of PPP research trends [18], application conditions of PPP [105], comparative analysis of PPP [106], and public involvement [107]. Table 10 conveys the information that project governance and risk-related topics have been the most frequently studied issues in the last ten years. Other key issues which were also predicted by Tang et al. [7] that would receive wide concern in PPP research include financing and costs, CSF, risk allocation and management (RAM), concession-related issues (e.g., concession period), contract management (CM), development of PPP models, and applications. Taking RAM, for example, which is always an active research topic for PPP projects [7], most studies of RAM paid attention to which and to what extent of the risks should be allocated to the relevant stakeholders, i.e., government or private side, and few studies focused on designing or carrying out a realistic risk sharing strategy or reasonable risk sharing ratio between the two parties [73].


## 4. Discussion on the Findings

Based on the three research steps illustrated in Figure1, this review-based study adopted a bibliometric analysis of journal articles published within the last ten years in the PPP field. Science mapping was applied to explore the research keywords, influential researchers, articles, journal sources, institutions, and countries that had been with high impacts in PPP. The further systematic review of the literature sample provided the statistical summary of the studied countries or regions, research methods, project sectors, and key issues from the selected PPP literature sample.PPP-based studies in project management have been undergoing a steady increase in the last few years. These few journals, includingInternational Journal of Project Management, Construction Management and Economics, Journal of Construction Engineering and Management, and Journal of Management in Engineering, play major roles in PPP research, based on their total link strength, number of articles published in PPP, and citations in the academic community. Research keywords within the PPP literature could be categorized into key issues (e.g., governance), countries (e.g., China), research method (e.g., case study), and project sectors (e.g., transportation). Sustainability and innovation had also been concerned in PPP research. As a sustainable concept, BIM (i.e., building information modeling) was perceived to have significant correlations with PPP projects [108]. Love et al. [109] and Ren and Li [110] proposed utilizing BIM as the digital approach to assist the decision-making in VFM within PPP projects. It is indicated that although most PPP studies have focused on the managerial aspects of project management, sustainability and innovation integrated with PPP could be emerging research topics for the future PPP study.The science mapping of PPP articles, scholars, institutions, and countries indicated that China had generated the most outputs in PPP, in terms of the number of articles published, citations, and total link strength. It was found that these parameters to quantify the impact of a country or an individual scholar on PPP research was generally significantly correlated to each other, meaning that either the total link strength, number of publications, or citation numbers can be used to measure the contribution of the individual scholar, institution, or the country. Chan A. P. C. and his affiliation (i.e., Hong Kong Polytechnic University) are the most productive scholar and institution, respectively, in PPP field during the recent ten years. It is inferred that through the research collaboration with Chan A. P. C., Ameway E. E. and Osei-Kyei R. become rising researchers in more recent years. It can be further indicated that collaboration among scholars and institutions could drive the movement of PPP research in joint efforts.Although developed countries, such as U.K., U.S., and Australia, have been contributing to more of the existing PPP studies, it is expected that more PPP studies will be carried out in developing countries (e.g., China, India, Ghana, Indonesia, and Nigeria). Some comparative studies between developed countries/regions and their developing counterparts (e.g., [111]) can be expected for the future study in PPP, as political, legislation, and cultural aspects within certain developing countries (e.g., China) would affect the implementation of PPP. When adopting PPP in project management, public and private sectors should consider the regional or the country’s context.Though recently published PPP studies indicated a certain degree of variety within key issues identified in Table10, a review of these key issues showed that governance, risk management, and CSF represented the most widely studied topics in PPP, these under-represented issues (e.g., hindering factors) could be continued in the future. Hindering factors that cause difficulties or barriers (e.g., uncertainty in decision-making) in PPP implementation would be the ongoing research direction by applying various research methods, such as questionnaire survey and modeling.


## 5. Conclusions

The bibliometric analysis and systematic review of PPP journal articles published revealed that PPP is still steadily growing in the recent ten years. Visualized science mapping and quantitative measurement using parameters (e.g., number of citations) provided the information of popular research keywords, productive PPP scholars, articles with high impacts, and institutions and countries contributing to the PPP research community. The visualized mapping was extended by a follow-up systematic review, based on the summaries of research methods, project sectors, countries that PPP studies focused on, and key issues within PPP research. Major findings from this holistic review-based study can be summarized below:(1)
The most frequently adopted research keywords from the recent ten years’ PPP literature could be categorized as key issues (e.g., governance), countries (e.g., Australia), research methods (e.g., case study), industry sectors (e.g., water), and others (e.g., sustainability and innovation).(2)
Sustainability and innovation, such as PPP linked to BIM, could be one of the future research topics.(3)
Hindering factors focusing on barriers and challenges encountered in PPP implementation would be an increasingly studied key issue in PPP research.(4)
Although these more traditional key issues, such as risk management and concession, remain continuing research topics in PPP, a variety of key issues in PPP research can be expected, involving some new emerging topics, for example, the comparative study of PPP adoption between developing and developed countries.(5)
China would be the country where more PPP research are carried out in the near future. Collaboration will continue between China-based researchers and their international peers in PPP.(6)
Case study and modeling/framework are main research methods in PPP research, followed by the traditional questionnaire survey and interview. Qualitative analysis is also being widely applied in PPP studies.(7)
Transportation and water treatment are the two main infrastructure sectors with highest numbers of PPP studies. Linked to sustainability, it could be expected that energy and environment-related projects including waste recycling and diversion projects could receive more attention in PPP research.Besides the major findings, this study also contributes to the existing knowledge in PPP by providing the following suggestions for future research:(1)
Technological innovation and integration with PPP projects(2)
Modeling or framework established to address hindering factors affecting PPP implementation under certain cultural or legislation context(3)
Studies tailoring the experience from developed countries to their developing counterparts(4)
Integrating multiple key issues in PPP, for example, how would legislation and legal issues affect the procurement, which would lead to performance evaluation



---

*Source: 7094653-2019-09-05.xml*