# Microservice security: a systematic literature review

Davide Berardi, Saverio Giallorenzo, Jacopo Mauro, Andrea Melis, Fabrizio Montesi, Marco Prandini

<figure><img src="image_1.png" /></figure>

## To cite this version:

Davide Berardi, Saverio Giallorenzo, Jacopo Mauro, Andrea Melis, Fabrizio Montesi, et al., Microservice security: a systematic literature review. PeerJ Computer Science, 2022, 7, pp.e779. 10.7717/peerj-cs.779. hal-03915125

HAL Id: hal-03915125

https://inria.hal.science/hal-03915125

Submitted on 29 Dec 2022

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

<figure><img src="image_2.png" /></figure>
# Microservice security: a systematic literature review

Davide Berardi<fnref n="1" />, Saverio Giallorenzo<fnref n="1" />,<fnref n="2" />, Jacopo Mauro<fnref n="3" />, Andrea Melis<fnref n="1" />, Fabrizio Montesi<fnref n="3" /> and Marco Prandini<fnref n="1" />

## ABSTRACT

Microservices is an emerging paradigm for developing distributed systems. With their widespread adoption, more and more work investigated the relation between microservices and security. Alas, the literature on this subject does not form a well-defined *corpus*: it is spread over many venues and composed of contributions mainly addressing specific scenarios or needs. In this work, we conduct a systematic review of the field, gathering 290 relevant publications—at the time of writing, the largest curated dataset on the topic. We analyse our dataset along two lines: (a) quantitatively, through publication metadata, which allows us to chart publication outlets, communities, approaches, and tackled issues; (b) qualitatively, through 20 research questions used to provide an aggregated overview of the literature and to spot gaps left open. We summarise our analyses in the conclusion in the form of a call for action to address the main open challenges.

**Subjects** Emerging Technologies, Security and Privacy, Software Engineering

**Keywords** Threat model, Software development, Infrastructure-as-a-service, Service deployment, Service composition, Service discovery, Privacy, Authentication, Intrusion detection and prevention, Authentication and authorization

## INTRODUCTION

Microservices is an emerging development paradigm, where software is built as a composition of multiple services (the “microservices”). Each microservice implements the business logic of a component of the application and is independently executable and deployable. Microservices interact with each other *via* message-passing APIs (Dragoni et al., 2017).

Over the last 6 years, microservices have become a popular topic and one of the go-to approaches for many cloud computing projects. According to Web of Science, more than 1,000 articles about microservices have been published since 2014. The year 2020 accounts for more than 400 of them, which points out that interest in the topic is still rising. Microservices are popular because they bring substantial advantages with respect to scalability in cloud environments and flexibility in the process of software development. By separating application components as independent services, software designers can specialise each component by using a dedicated technology and then integrate all such heterogeneous components *via* technology-agnostic APIs.

Submitted 25 May 2021
Accepted 20 October 2021
Published 5 January 2022

Corresponding author
Marco Prandini,
marco.prandini@unibo.it

Academic editor
Wenbing Zhao

Additional Information and Declarations can be found on page 46

DOI 10.7717/peerj-cs.779

cc Copyright
2022 Berardi et al.

Distributed under
Creative Commons CC-BY 4.0

OPEN ACCESS

<footnote n="1">¹ Department of Computer Science and Engineering, University of Bologna, Bologna, Italy</footnote>

<footnote n="2">² INRIA, Sophia Antipolis, France</footnote>

<footnote n="3">³ Department of Mathematics and Computer Science, University of Southern Denmark, Odense, Denmark</footnote>
Alas, the advantages of microservices come at a cost: distributed systems are hard to manage, and increasing the number of services of an application gives malicious actors a larger attack surface (Dragoni et al., 2017). Several security concerns that are particularly relevant for microservices have been identified by Chandramouli (2019), and early research has already shown that the application of standard patterns for system reliability needs to take new parameters into consideration—like the locations at which the patterns are deployed (Montesi & Weber, 2018).

The importance of security in microservices creates the need for understanding and analysing the state of the art for securing this kind of architectures. It is particularly important to understand which problems are especially relevant for microservice systems, and how existing techniques can contribute to addressing them. However, there is still a lack of systematic investigations of studies at the intersection of security and microservice architectures.

Here, we aim to fill that gap by presenting a systematic review of the state of the art of microservice security. We followed a structured approach, which led us to select and gather 290 peer-reviewed publications. At the time of this writing, this constitutes the largest curated dataset on the topic. We first perform a quantitative analysis on the metadata of the publications, for example, publication outlets and keywords. This provides insight into the communities and key research concepts that currently characterise the field. We then map each publication to a vector of 20 different markers, corresponding to 20 research questions on microservices security that we formulated based on established security techniques and the field of microservices as a whole.

Our research questions focused on threat models, security approaches, infrastructure, and development approach. We perform correlation analysis to show that our questions are well-posed (independence), and also to confirm that some topics correlate positively (e.g., Intrusion Detection and Intrusion Prevention, and Agile Development and DevOps as well). Findings from our analysis include: issues with technology transfer from academia to industry on microservices security; lack of guidelines for adopting security by design in microservices; lack of appropriate threat models; lack of guidelines for addressing the attack surface given by technology heterogeneity; and security issues when migrating systems to microservices. Our data, findings, and discussions form a useful basis for orienting future developments of the field.

In summary, the main contributions of this work are:

* the characterisation of Microservices Security as an early-stage, growing research field in need of systematisation and more mature contributions (“Publication Outlets”, “Types of Publications”);

* the identification of the main research communities on the Microservice Security field and the clustering of authors (Research Communities);

* a presentation of the trends of the main security attacks involving microservice architectures, both from the points of view of threat model (Threat Model) and mitigation (Security Approach (Mitigation));
* a report on the current infrastructural security solutions for microservices (Infrastructure) as well as the interaction between the main microservices development approaches (such as DevOps and Agile) and security (Development);

* a correlation analysis of the answers to our research questions in papers, which sheds light on relationships among the different aspects of microservice security (Correlation between Research Questions);

* a summary of the main open challenges that emerged from our study, which form a call for action for the community of researchers and practitioners working in the field of microservice security (Discussion and Future Directions).

## Structure of the article

We start by providing a summary of related work in “Related Work”. In “Review Method” and “Research Questions” we detail the method we followed to conduct the systematic literature review and the research questions, respectively. We present our results in “Review Results” and we conclude in “Discussion and Future Directions” with a discussion on the outstanding challenges.

## RELATED WORK

To the best of our knowledge, the published works that are closest to ours are those by Vale et al. (2019) and Almeida et al. (2017). Vale et al. (2019) present a systematic mapping that identifies the security mechanisms used in microservice-based systems. Contrary to our work, which provides a general overview on the state of the art of microservices security, the authors narrow their focus on cataloguing the security technologies and mechanisms adopted by developers of microservice-based systems—e.g., authentication and authorisation—leaving out other subjects related to security, like threat models and development methods. Similarly to Vale et al. (2019), Almeida et al. (2017) concentrate on surveying the technologies and standards for security, privacy, and communication used in the area of microservice architectures in the cloud.

Extending our view to articles that, at the time of this writing, are not available as peer-reviewed publications, we mention the work by Hannousse & Yahiouche (2020) and Ponce et al. (2021). Hannousse & Yahiouche (2020) present a systematic categorisation of threats on microservice architectures and propose a selection of possible mitigations. Ponce et al. (2021) look at how “security smells” affect microservice-based applications and how to mitigate the effects of such smells through refactoring. As for the proposals by Vale et al. (2019) and Almeida et al. (2017), the difference between our work and Hannousse & Yahiouche (2020) lies on generality: Hannousse and Yahiouche narrow their investigation down to the threats identified in the literature. Similarly, the work of Ponce et al. (2021) focuses on the programming of microservices.

In addition to the related work discussed above, there are quite a few neighbouring surveys with respect to our work that are interesting to discuss: while these studies are not dedicated to the topic of microservice security, they explicitly mention security as an important concern for microservices in different contexts—software engineering, Internet
of Things, containerisation, etc. The purpose of reviewing neighbouring related work is twofold:

1. It shows the multifaceted nature of microservice security, giving concrete evidence of the need for an investigation which is both wider and deeper, as we do in this work.

2. It provides a general overview of the challenges and possible uncovered research topics related to security in microservices—which inspired some of the questions presented in “Review Method”.

Dragoni et al. (2017) present an overview of microservices, including a discussion of the origins of the paradigm, its state of the art, and future challenges. They identify a number of trust and security challenges posed by the paradigm. We mention a few examples. Service reuse, one of the key benefits pushed for in the microservice paradigm, requires adopting secure mechanisms for service authentication and authorisation. The increased granularity and heterogeneity of microservice architectures extends considerably the attack surface of these systems. The sophisticated DevOps infrastructure required to operate microservices effectively is a new attack vector.

Garriga (2017) conducted a preliminary analysis towards a taxonomy of microservices architectures. While not addressing in particular security concerns, Garriga reports that the security subject is not extensively addressed, highlighting how monitoring and microservice communication trust chains should receive particular attention.

Joseph & Chandrasekaran (2019) reviewed approaches proposed in the literature to deal with the various concerns of microservice-based systems. The authors mention the large attack area offered by microservices subject to insider/privilege-escalation attacks and network security issues.

Casale et al. (2016) surveyed the topics of European research projects in the area of software engineering. Regarding microservices security, they highlight four main challenges: increasing the usage of software validation and verification methods; improving the trust and interoperability of services through (self/federated)-certification of outputs based on standards; adopting a security-by-design approach on the whole software lifecycle; and helping developers with addressing discontinuities in the chain of compositionality between services and execution environments—e.g., due to data leakages derived from fragile container-host interactions.

Lichtenthäler et al. (2019) investigate and discuss the challenges of migrating monoliths to microservices. They observe that security should be part of the migration planning phase to begin with, and that developers need models and frameworks to help them elicit, track, and manage the (frequently implicit) assumptions and invariants induced by the migration of the legacy system. These observations are shared with Di Francesco, Malavolta & Lago (2017), who suggest that the microservice architectural style has a direct impact on the design of a system and that researchers are still investigating how to leverage its characteristics with respect to system quality and security. Di Francesco, Malavolta & Lago (2017) note that there exists uncertainty about the realisation of microservices,
indicating the need for comprehensive references to help programmers in the multifaceted
aspects of microservice development.

Noura, Atiquzzaman & Gaedke (2019) address the open challenges of interoperability in the Internet of Things (IoT), noting how microservices can constitute a solution for the programming of highly distributed IoT networks and provide two decades worth of research and industrial experience to tackle interoperability in heterogeneous systems. Regarding the general security of IoT systems, Noura, Atiquzzaman & Gaedke (2019) note the emergence of security issues (e.g., authentication and access control) when system design permits direct access to resource-constrained devices. Reviewing the many solutions and levels at which IoT interoperability can be tackled, Noura, Atiquzzaman & Gaedke (2019) note the challenge of both maintaining and guaranteeing the same level of security when mediating among different technologies.

Márquez & Astudillo (2019) examine microservice availability tactics to detect, prevent, mitigate, and recover from faults. They highlight how the tactics for the availability of microservices mainly focus on preventing faults, whereas detection, reaction, and recovery are scarcely addressed. Commenting on related challenges, Márquez & Astudillo (2019) report a deficit of solutions to support the restoration of normal functionalities after a microservice architecture suffered from some faults.

Ahmed et al. (2019) surveyed robust and flexible service management platforms for IoT systems. Like Noura, Atiquzzaman & Gaedke (2019), they identify microservice architectures as the most suitable architectural pattern to handle the heterogeneity of IoT systems and that the foremost challenge in the field is the robust integration of different technologies. Ahmed et al. (2019) also report how conventional security solutions and practices are not suitable to handle the expansion, mobility, resource constraints, and new security requirements of the considered systems.

Cerny & Donahoo (2016) investigate service integration from the perspective of separation of concerns and identify problems with conventional service integration design/technologies. They report that the lack of proper cross-cutting concerns in programming technologies make it difficult to capture and guarantee that invariants of a given microservice—specifically, on security—hold when paired with integration components.

Yang et al. (2014) survey how cloud computing systems can help scientific research. In their report, they notice how the (micro)service paradigm is useful to make resources available to collaborating researchers by providing a well-defined interface specifying the operations that can be performed on, or with, a given resource. However, they also report that privacy and trust issues are of particular concern to researchers, especially in fields that are processing sensitive data such as medical research. For this, appropriate provenance metadata is required, both to understand how and by whom the data was created and modified, as well as to understand where it has been potentially exposed to corruption. Similar comments are shared also by Plaza, Daz & Pérez (2018) in the context of healthcare cyber-physical systems. In particular, proper encryption is reported as a key component for (real-time) data acquisition.
Soldani, Tamburri & Van Den Heuvel (2018), reviewing the “pains and gains” of microservices in the grey literature, found how security generates pains at design-time. Like Yang et al. (2014), Soldani, Tamburri & Van Den Heuvel (2018) comment that microservice-based applications should support the consistent determination of the provenance and authenticity of data, noting the paradox of that being in contrast with the heavily-distributed nature of microservice systems. Another (meta) observation by Soldani, Tamburri & Van Den Heuvel (2018) is how there is a gap between the industrial understanding and state-of-practice on microservices and the state-of-the-art of academic research, one possible reason being that academics have limited access to industrial-scale microservice-based applications.

Di Francesco, Lago & Malavolta (2019) identify, classify, and evaluate the state of the art on architecting with microservices from the perspectives of publication trends, the focus of research, and potential for industrial adoption. On security, they report that it is attracting insufficient research. The works by Vural, Koyuncu & Guney (2017) and Alshuqayran, Ali & Evans (2016) follow similar modalities and results.

Bélair, Laniepce & Menaud (2019) surveyed security of containers, a technology frequently paired with microservices. They report how container security is still in an early phase and it faces unsolved challenges. The results presented by Bélair, Laniepce & Menaud (2019) match those by Sultan, Ahmad & Dimitriou (2019), who report the presence of a large number of challenges linked to containerisation because OS kernel sharing introduces security issues absent from virtualisation solutions. Sultan, Ahmad & Dimitriou (2019) also highlight the importance of enhancing vulnerability management, digital investigation, and container alternatives.

Puliafito et al. (2019) present a survey on the employment of fog computing to support IoT devices and (micro)services. In their study, they report how security is the largest cross-cutting technical concern within critical IoT systems, which necessitates a common baseline and interoperable standards to address security challenges within both hardware and software. In particular, Puliafito et al. (2019) advocate for solutions to provide a full-stack secure chain of trust from devices to fog/cloud components, which has been only preliminary explored (as remote attestation techniques). Trnka, Černý & Stickney (2018) and Puliafito et al. (2019) report also the importance of addressing the concerns of context-aware security (in IoT systems), especially for authentication and authorisation.

Also Yu et al. (2019) surveyed the literature on microservice-based fog applications to elicit the security risks threatening them. The main threats highlighted include: kernel-level leakage vulnerabilities linked to containerised deployment; man-in-the-middle/insider attacks on data-transmission interception; the need to verify when services become compromised/misbehave; and network-level vulnerabilities on data-routing alteration.

Table 1, shows the differences between these various works, in numerical and boolean terms. As clearly evincible, our work expands previous work by adding a conspicuous amount of analysed publications; using white literature at its roots and following the trend and methods of the main Systematic White Literature Reviews.
<table><caption>**Table 1 Summary table and comparison with related works.** For each row/work in the table, we report: its reference; its publication year; its type (systematic literature review (SLR), survey, etc.); the number of publications it encompasses; whether it analyses white (peer reviewed) literature; whether it analyses grey (blog posts, etc.) literature; the sources it used to search its dataset.</caption><thead><tr><th>Publication</th><th>Year</th><th>Type</th><th>Num.</th><th>White L.</th><th>Grey L.</th><th>Sources</th></tr></thead><tbody><tr><td>This work</td><td>2021</td><td>SLR</td><td>290</td><td>●</td><td>○</td><td>ACM Digital Library<br>IEEE Xplorer<br>SpringerLink<br>Scopus<br>Science Direct<br>Wiley<br>Google Scholar</td></tr><tr><td>Vale et al.</td><td>2019</td><td>SLR</td><td>26</td><td>●</td><td>○</td><td>ACM Digital Library<br>IEEE Xplorer<br>SpringerLink<br>Science Direct<br>Wiley<br>Google Scholar</td></tr><tr><td>Almeida et al.</td><td>2017</td><td>Survey</td><td>N.A.</td><td>●</td><td>○</td><td>N.A.</td></tr><tr><td>Hannousse & Yahiouche</td><td>2020</td><td>SLR</td><td>46</td><td>●</td><td>○</td><td>ACM Digital Library<br>IEEE Xplorer<br>SpringerLink<br>Science Direct<br>Wiley</td></tr><tr><td>Soldani et al.</td><td>2018</td><td>SLR</td><td>51</td><td>○</td><td>●</td><td>Google<br>Bing<br>Duck Duck Go<br>Yahoo!<br>Webopedia</td></tr></tbody></table>

REVIEW METHOD

In this section, we describe and motivate the steps we followed to perform our systematic review.

Following the guidelines by Snyder (2019), and as depicted in Fig. 1, we started by searching and retrieving the literature for relevant publications from several data sources by using the same keyword query. We then performed a manual revision process of the automatically selected publications to exclude publications out of the scope of this study and perform snowballing—i.e., recursively adding to the dataset relevant publications cited by the already selected publications. The resulting dataset consists of 290 publications. We analysed these publications to collect statistical and transparent answers to our research questions, which are detailed in “Research Questions”.<fnref n="1" />

<footnote n="1">¹ The list of the publications and their bibliography information is publicly available at https://doi.org/10.5281/zenodo.4774894.</footnote>
<figure><img src="image_3.png" /><figcaption>Figure 1 Schema of the method followed to gather the dataset for this review.</figcaption></figure>

Full-size

<figure><img src="image_4.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-1

## Selection query and collection of publications

Security in microservices includes complex and heterogeneous topics, ranging from development to infrastructural concerns. In our choice of a selection query to gather an initial dataset, it was important to pick a sufficiently general query. For this reason, we adopted the query “Microservice AND Security” for our initial search, capturing all the publications containing both terms in any of their title, abstract, or body.<fnref n="2" />

Di Francesco, Lago & Malavolta (2019), Plaza, Daz & Pérez (2018), Soldani, Tamburri & Van Den Heuvel (2018) reported how publications on the topic of Microservice started in 2014. Taking into account this fact, we limited our research to contributions published since 2014. During the 7 years covered by our work, the body of knowledge on this topic has grown significantly. For this reason, we deemed it useful to consider white literature only: in terms of quantity, it represents a very meaningful sample of the research produced during the considered time frame, and in terms of quality, it allowed us to rely on peer review. Thanks to the more uniform organisation of white literature, we are also more confident in the level of consistency of our choice and application of the selection criteria. This is not to say that grey literature is not worth investigating. Blog posts, personal websites, technical reports, white papers, etc., are often the preferred venues for practitioners to share ideas. However, as also pointed out in Soldani (2019), “it is very

<footnote n="2">² We performed experiments with potentially more inclusive queries, such as “Microservice AND (Security OR Authorisation)”, as well. The tried queries, however, did not extend the search in any useful way since the term “Security” proved to be general enough to cover specialised aspects like authentication, authorisation, and (safe) communication.</footnote>
difficult to uniquely measure the quality of grey literature when conducting a systematic, controllable, and replicable secondary study" and we are not aware of a standard method for the evaluation of grey literature. Analysing the grey literature was beyond the quality goal of this article and we leave it as future work.

Accordingly to this strategy, we collected publications from 6 different publishers, focusing on peer-reviewed publications. We did not, for example, use Google Scholar or arXiv, since they also list resources that are not peer-reviewed. We list the publishers, reporting the respective numbers of publications that matched our query:

* ACM (https://dl.acm.org/), 478 publications;

* IEEE explore (https://ieeexplore.ieee.org/), 181 publications;

* Springer (https://link.springer.com/), 345 publications;

* Scopus (https://www.scopus.com/home.uri), 134 publications;

* Science Direct (https://www.sciencedirect.com/), 358 publications;

* Wiley (https://onlinelibrary.wiley.com/), 208 publications.

This gave us an initial dataset of 1,704 publications in total. We collected publications published up to the 31st of December 2020, using the academic subscriptions provided by the affiliations of the authors—the University of Bologna and the University of Southern Denmark. To guarantee the same level of trustworthiness and authenticity, we retrieved the publications only from the official entries, avoiding external sources such as the authors' personal websites.

## Publications triage

The publications retrieved from the publishers were processed in three steps to check if they should be excluded according to distinct exclusion criteria. Graphically, in Fig. 1, these steps are labelled as 2nd, 3rd, and 4th Step(s).

In the 2nd Step, we looked at whether the keywords "Microservice" and "Security" were used. We excluded a publication if the keywords appeared only in the bibliography. Moreover, we excluded the publication if it was too short (less than two pages), publications not written in English, and duplicate publications already listed in another publisher source.

In the 3rd Step, we looked at the title, abstract, and conclusion of each publication. Publications that do not treat or discuss topics related to microservices and security were excluded. In this step, we also excluded publications in which the security topic was orthogonal or incidental. In this way, we excluded publications where "microservices and security" was one of the possible application scenarios, but not the main subject of the study. We also excluded cases in which the work tangentially mentioned the satisfaction of some security aspects, without detailing the design/development of the security technologies to accomplish them. For example, we excluded publications focusing on blockchain technologies where the authors incidentally mention authentication and integrity protection as inherent security properties of blockchain-based implementations.
In the 4th Step, we performed an analysis of the publications, answering to the research questions (RQ) detailed in Research Questions. No publications were excluded at this step.

At this point, the following publications remained in the dataset (268 in total):

* ACM, 67 publications;

* IEEE explore, 59 publications;

* Springer, 46 publications;

* Scopus, 28 publications;

* Science Direct, 53 publications;

* Wiley, 15 publications.

## Snowballing

As the last (5th) step for the systematic literature review, we performed a backward snowballing process (Wohlin, 2014) with the objective of identifying additional relevant references for our study from the works cited by the already selected publications.

All references collected in this way underwent the triage by following the Steps 2, 3, and 4. Each referenced publication accepted for inclusion by these steps was then added to the dataset of selected publications. Snowballing was recursively performed on these newly-added publications until reaching a fixed point; i.e., until no new publications was added to the dataset.

The outcome of repeatedly applying the snowballing process led to the following results:

* 40 references in the first round, from which we selected 9 publications;

* 22 references in the second round, from which we selected 8 publications;

* 5 references in the third round, from which we selected 5 publications;

* 4 references in the fourth round, where we selected 0 publications.

The 4 cycles of snowballing yielded 22 additional publications that were included in the dataset to reach the final size of 290 publications.

## RESEARCH QUESTIONS

In this section, we detail the research questions that guided our systematic review.

Usually, the research questions for systematic literature reviews are fairly broad and do not amount to more than six. In our case, we chose to adopt more questions (20) but dichotomous (i.e., with yes-or-no answers), to favour precision and objectiveness. To define the questions and seek guidance in categorising the relevant security issues for microservices, we took inspiration from the related work presented “Related Work”, as well as from the state of the art in standards and methods, namely the NIST Special Publication 800-204 “Security Strategies for Microservice-based Application Systems” (Chandramouli, 2019).

Our questions are collected in four macro groups (Gs), each covering a different concern.
* **G1:** Threat Model. Questions on threat modelling and how threats are dealt with.

* **G2:** Security Approach. Questions on the security approach, e.g., whether it is preventive, adaptive, proactive, or reactive.

* **G3:** Infrastructure. Questions on the infrastructure that microservices run on.

* **G4:** Development. Questions on the development process.

The questions in each group are reported in the remainder of this section.

## First group: threat model

Mapping the usage of threat models is important to see gaps when a security violation must be handled, or if known models are outdated and need to be adjusted. The NIST report, for instance, hints at the importance of identifying the threats looming over a microservices architecture (Chandramouli, 2019). The usage of a formal threat model has proven to be extremely useful in the identification of attack types and their strategic countermeasures (Death, 2017).

Several threat models exist in the literature. The most famous one is STRIDE (Kohnfelder & Garg, 1999) named after the Spoofing, Tampering, Repudiation, Information Disclosure, Denial of Service, and Elevation of privilege security threats. Other threat models however exists, such as PASTA (UcedaVelez & Morana, 2015) or OWASP (OWASP Foundation, 2020).

In our review and with this first group of questions, we aimed to understand whether a publication followed a known model, strategy, or guideline. Alternatively, we wanted to know if new security models were proposed.

This group consists of the following questions.

* **Q1:** Does the publication mention STRIDE, or at least consider all of its aspects?

* **Q2:** Even without explicitly mentioning STRIDE, does the publication involve at least one of its aspects (Spoofing, Tampering, ...)?

* **Q3:** If STRIDE aspects or equivalent are considered, does the publication propose/ discuss a concrete implementation/solution (either developed by the same author or one taken from the literature)?

* **Q4:** Does the publication consider or follow another threat model rather than STRIDE without introducing a new one?

* **Q5:** Does the publication mention policies, workflows, or guidelines to handle violations?

In particular, with question Q1 and Q3 we looked for the adoption of STRIDE, being the most popular threat model. In the remaining questions, we investigate if the publication defined some threat model—either from the literature or a newly one introduced in that publication—or at least discussed equivalent principles or guidelines without mentioning STRIDE.
## Second group: security approach

Many related works cite the usage of preventive measures to secure microservices (Márquez & Astudillo, 2019; Vale et al., 2019; Garriga, 2017; Almeida et al., 2017; Ahmed et al., 2019; Soldani, Tamburri & Van Den Heuvel, 2018) while some indicate the need for further research in the other directions of proaction, reaction, and adaptation (Vale et al., 2019; Márquez & Astudillo, 2019). With this second block of questions, we wanted to go deeper into the security aspects, considering the specific security approaches, solutions, and also the role that microservices play.

This group consists of the following questions.

* Q6: Does the publication mention Intrusion Detection System (IDS) functionalities?

* Q7: Does the publication mention Intrusion Prevention Systems (IPS) functionalities?

* Q8: Does the publication mention Threat Intelligence?

* Q9: Does the publication mention Exfiltration Leaks?

* Q10: Does the publication address Insider Threats?

* Q11: Are microservices part of the solution?

* Q12: Are privacy and GDPR considered?

## Third group: infrastructure

The NIST report by Chandramouli (2019) dedicates a large part of its content to infrastructural security solutions for microservices. Similarly, the majority of the mentioned related work in “Related Work” presents or at least cites infrastructural solutions for security, acknowledging that the infrastructure of microservice systems is typically complex, encompassing concerns that span from service deployment and service-to-service coordination (discovery, composition, consistency) to the definition of security-specific mechanisms (authorisation, authentication).

In this group of questions, we aimed at finding information on the infrastructure configurations considered in the publication. This group consists of the following questions.

* Q13: Does the publication specify how the proposed architecture is controlled or managed (e.g., in a centralised, decentralised, or hybrid way)?

* Q14: Does the publication mention Infrastructure-as-a-Service?

* Q15: Does the publication mention service discovery?

## Fourth group: development

Microservices are often associated with software development practices like DevOps and Agile (Balalaie, Heydarnoori & Jamshidi, 2016; Vadapalli, 2018) which, in turn, are heavily influenced by the inclusion of security-oriented practices (Casale et al., 2016; Lichtenthäler et al., 2019; Cerny & Donahoo, 2016; Soldani, Tamburri & Van Den Heuvel, 2018).
In this last set of questions, we aimed at checking the extent to which these practices are
used also in the setting of security, for example by verifying whether specific development
processes and security standards are considered.

This group consists of the following questions.

* Q16: Does the publication mention DevOps, Continuous Integration, Continuous Deployment, or Continuous Delivery?

* Q17: Does the publication mention Agile, or how security experts are integrated from a development process point of view?

* Q18: Does the publication mention Domain Driven Development?

* Q19: Does the publication mention Model Driven Development?

* Q20: Does the publication mention certifications, such as ISO27000 (https://www.iso.org/isoiec-27001-information-security.html), or technological standards such as X.509 (https://tools.ietf.org/html/rfc5280)?

REVIEW RESULTS

In this section, we present the outcome of the literature review. We start by presenting quantitative results from the metadata of the publications in our dataset. This is useful to map the trends over time and current shape of the field, in terms of number of contributions, type (proceedings, articles), communities, and keywords (and their relations). Then, we present qualitative results derived from the analysis of the types of contributions (theoretical, applicative, etc.) and of the relation between the selected dataset and our research questions (cf. "Research Questions"). The qualitative part is aimed at providing a detailed insight on existing research patterns, gaps, and uncovered areas of the field. We close the subsection with a correlation analysis of the questions, providing a quantitative look over the relationships between them. For reference, we also report our dataset in tabular form, each entry associated with the positive answers given to our research questions.

Insights

In the following subsections, we highlight in separate paragraphs (like this one) the main
insights that emerge from our analysis. Each insight motivates an open challenge,
which we write in bold as the heading of the insight. We will use these challenges in
"Discussion and Future Directions" to structure our discussion about useful future
directions for research on microservice security.

Metadata results

We start our quantitative analysis of the collected dataset by presenting in Fig. 2A the time
distribution of the selected publications. As expected, security in microservice systems
gained a lot of academic interest in the latest years. This is reflected by the sharp increase in
the number of publications since 2014. In Fig. 2A, we report the number of collected
publications per year.
<figure><img src="image_5.png" /><figcaption>**Figure 2** Time and category distribution of publications.</figcaption></figure>

Full-size

<figure><img src="image_6.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-2

As a reference to indicate the degree of growth of the field, we report in Fig. 2B the yearly ratio (in parts per million) between the collected publications and the overall number of publications in computer science.<fnref n="3" />

## Publication outlets

From the plot in In Fig. 2C, we see that conferences and journal venues are the most commons outlets, while books/collections are underrepresented. This last fact indicates the early stage of the field, where established references are still lacking. However, conference proceedings are almost matched by journal articles, marking a maturing trend of results that are solid enough to constitute material for more structured contributions, as those found in peer-reviewed journals.

We now concentrate on the specific conferences and journals where the publications in our dataset have been published. In Figs. 3 and 4, we report this result in two versions: (i) in tabular form, on the left-hand side of Figs. 3 and 4, with the acronym, the full name, and the number of contributions in our dataset of the venues with the most contributions and (ii) on the right-hand side of Figs. 3 and 4, showing the data on the left as a pie chart.

Regarding the distribution of publications over the different categories of venues, we note how the audience of journals and conferences vary. In fact, there is no predominance of security-oriented or even software engineering venues, which could have been the most likely targets. Instead, the analysed publications appear on publications addressing a broad range of topics, from networking to cloud computing, and on open journals such as IEEE Access and ACM Queue. Furthermore, there is no clear preferred venue that dominates the others, but contributors are rather scattered over many neighbouring venues.

<footnote n="3">³ Source: https://dblp.org/statistics/publications/year.html.</footnote>
<table><thead><tr><th>Acronym</th><th>Name</th><th># in dataset</th></tr></thead><tbody><tr><td>ARES</td><td>International Conference on Availability, Reliability and Security</td><td>2</td></tr><tr><td>CCGRID</td><td>IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing</td><td>2</td></tr><tr><td>EuroS&amp;P</td><td>European Symposium on Security and Privacy</td><td>2</td></tr><tr><td>ICSA</td><td>IEEE International Conference on Software Architecture</td><td>3</td></tr><tr><td>IFIP</td><td>The International Federation for Information Processing Conference</td><td>3</td></tr><tr><td>MEDES</td><td>ACM Conference on Management of Digital EcoSystems</td><td>2</td></tr><tr><td>NOMS</td><td>Network Operations and Management Symposium</td><td>2</td></tr><tr><td>SEC</td><td>Security Conference</td><td>3</td></tr><tr><td>STAF</td><td>Software Technologies: Applications and Foundations Interoperable Systems</td><td>2</td></tr></tbody></table>

<figure><img src="image_7.png" /><figcaption>**Figure 3** Conferences with the largest number of publications in our dataset.</figcaption></figure>

Full-size

<figure><img src="image_8.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-3

<table><thead><tr><th>Acronym</th><th>Name</th><th># in dataset</th></tr></thead><tbody><tr><td>CC</td><td>Cluster Computing</td><td>4</td></tr><tr><td>CCPE</td><td>Concurrency and Computation: Practice and Experience</td><td>4</td></tr><tr><td>ESE</td><td>Empirical Software Engineering</td><td>2</td></tr><tr><td>FGCS</td><td>Future Generation Computer Systems Conference</td><td>7</td></tr><tr><td>FI</td><td>Future Internet</td><td>2</td></tr><tr><td>IEEE Access</td><td>IEEE Access Multidisciplinary open access journal</td><td>5</td></tr><tr><td>IEEE IC</td><td>IEEE Internet Computing</td><td>3</td></tr><tr><td>IEEE PDS</td><td>IEEE Transactions on Parallel and Distributed Systems</td><td>3</td></tr><tr><td>IST</td><td>Information and Software Technology</td><td>2</td></tr><tr><td>JSS</td><td>Journal of Systems and Software</td><td>8</td></tr><tr><td>MNA</td><td>Mobile Networks and Applications</td><td>2</td></tr><tr><td>MTA</td><td>Multimedia Tools and Applications</td><td>2</td></tr><tr><td>PCS</td><td>Procedia Computer Science</td><td>3</td></tr><tr><td>Queue</td><td>ACM Queue</td><td>3</td></tr><tr><td>SICS</td><td>Software-Intensive Cyber-Physical Systems</td><td>2</td></tr><tr><td>SPE</td><td>Software: Practice and Experience</td><td>4</td></tr><tr><td>Sensors</td><td>IEEE Sensors Journal</td><td>3</td></tr></tbody></table>

<figure><img src="image_9.png" /><figcaption>**Figure 4** Journals with the largest number of publications in our dataset.</figcaption></figure>

Full-size

<figure><img src="image_10.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-4

We give a twofold interpretation to the phenomenon. On the one hand, this fact can indicate that microservice security is perceived as of cross-disciplinary interest, each contribution seeing it from the lens of its specific area (whether it be software engineering, networks, sensors, cloud computing, etc.). On the other hand, we notice the lack of specific venues dedicated to microservices, and least of all, dedicated to microservice security.
## Insights

**Fragmentation of outlets:** there are no reference venues for the area of microservice security (neither journals nor conferences). This makes it difficult for researchers and practitioners to keep up with the state of the art, as well as to find dedicated conventions where they can discuss this topic with the rest of the community interested in the area.

## Research communities

To add more insight on the communities of the field, we also perform a network analysis to identify and explore the clusters of the most prolific authors and their research collaborations. Specifically, we are interested in analysing the networks of collaboration of "core authors", i.e., prolific authors that, by working with different people, act as a liaison among separated groups of authors.

To find the clusters of core authors in our dataset, we consider all the authors in the dataset and we aggregate them in clusters such that each member of a cluster has at least one contribution published with one of the members of the cluster. Since we are interested in "core authors”—i.e., authors with more than 2 works in the dataset—we remove all those clusters formed around just one work—i.e., where the maximum number of publications published by the most prolific author is one.

Our analysis extracted 16 clusters from our dataset. We report in Table 2 the result of our analysis, labelling each cluster from **A** to **P**. For each Cluster, we report the name of the author, the number of publications (# pub.) in our dataset and their affiliation.

The measure gives some interesting insights. First, clusters **F**, **G**, **J**, and **L** are totally localised in one country or the same University/Institute, they are relatively small (compared to the others in the Table), and include some of the most prolific authors (**J** and **L** in particular). Four other clusters follow a different trend: **C**, **H**, **P** and **I**. They are big-size clusters (respectively 6,10,8 and 6), they count one core author (respectively with 3,3,4 and 3 publications) but they are rather homogeneous, the first mainly including authors from Brasil, Finland and the fourth one from Portugal. Clusters **A**, **B**, **D**, **K**, **M**, **N** and **O** are the most varied. Cluster **A**, is the largest (22 authors) and most heterogeneous one: it includes 6 core authors from 5 different countries (Brazil, Germany, Italy, Switzerland, and the UK) and 12 co-authors from 4 countries different from those of the core authors (Australia, France, Portugal and the US). Cluster **B** includes 6 core authors over 24 members, distributed over just 5 countries (Brazil, Germany, Italy, Greece and Switzerland). Cluster **D** includes 8 authors, of which 6 are core and come both from either China or US. Cluster **K** is another big cluster of 16 authors with include 3 core authors from US and Germany. Clusters **M**, **N** and **O** follow the same trend of cluster **D**. This means that these clusters are build around 2 core authors which represent the main affiliation provenance, respectively Holland, Germany and Switzerland, US and UK.

Overall, the communities of core authors in the dataset is distributed among three types of clusters:

* "open" clusters (**A**, **B**, **D**, **K**) of co-authors linked by a few (if not one) core authors and diverse affiliations;
<table><caption>Table 2 Cluster authors correspondence.</caption><thead><tr><th>Cluster</th><th>Author</th><th># Pub.</th><th>Affiliation</th><th>Cluster</th><th>Author</th><th># Pub.</th><th>Affiliation</th></tr></thead><tbody><tr><td>A</td><td>Fetzer Christof</td><td>3</td><td>TU Dresden</td><td>G</td><td>Makitalo Niko</td><td>1</td><td>University of Helsinki</td></tr><tr><td>A</td><td>Brito Andrey</td><td>2</td><td>Universidade de Campina Grande</td><td>H</td><td>Jin Yike</td><td>1</td><td>Unknown affiliation</td></tr><tr><td>A</td><td>Kopsell Stefan</td><td>2</td><td>TU Dresden</td><td>H</td><td>Yu Dongjin</td><td>1</td><td>Hangzhou Dianzi University</td></tr><tr><td>A</td><td>Pietzuch Peter</td><td>2</td><td>Imperial College London</td><td>H</td><td>Zhang Yuqun</td><td>1</td><td>Southern University</td></tr><tr><td>A</td><td>Pasin Marcelo</td><td>2</td><td>University de Neuchâtel</td><td>H</td><td>Zheng Xi</td><td>3</td><td>Xi'an Jiaotong University</td></tr><tr><td>A</td><td>Felber Pascal</td><td>2</td><td>University of Neuchâtel</td><td>H</td><td>Zhang Chong</td><td>2</td><td>Chong Qing Hospital</td></tr><tr><td>A</td><td>Fonseca Keiko</td><td>1</td><td>Universidade do Paraná</td><td>H</td><td>Liu Xiao</td><td>2</td><td>Tsinghua University</td></tr><tr><td>A</td><td>Rosa Marcelo</td><td>1</td><td>University of Melbourne</td><td>H</td><td>Li Rui</td><td>2</td><td>Facebook</td></tr><tr><td>A</td><td>Gomes Luiz</td><td>1</td><td>Arizona State University</td><td>H</td><td>Liu Huai</td><td>2</td><td>University of Washington</td></tr><tr><td>A</td><td>Riella Rodrigo</td><td>1</td><td>Universidade do Paraná</td><td>I</td><td>Donahoo Michael J</td><td>2</td><td>Carnegie University</td></tr><tr><td>A</td><td>da Silva MS Leite</td><td>1</td><td>Universidade de Campina Grande</td><td>I</td><td>Cerny Tomas</td><td>6</td><td>Baylor University</td></tr><tr><td>A</td><td>de Oliveira SV Fernando</td><td>1</td><td>Universidade de Campina Grande</td><td>I</td><td>Sedlisky Filip</td><td>1</td><td>University In Prague</td></tr><tr><td>A</td><td>Kelbert Florian</td><td>1</td><td>Elastic</td><td>I</td><td>Walker Andrew</td><td>2</td><td>Carnegie University</td></tr><tr><td>A</td><td>Gregor Franz</td><td>1</td><td>TU Dresden</td><td>I</td><td>Svacina Jan</td><td>2</td><td>Baylor University</td></tr><tr><td>A</td><td>Pires Rafael</td><td>1</td><td>University of Sao Paulo</td><td>I</td><td>Bushong Vincent</td><td>2</td><td>Baylor University</td></tr><tr><td>A</td><td>Schiavoni Valerio</td><td>1</td><td>University of Neuchâtel</td><td>I</td><td>Bures Miroslav</td><td>2</td><td>University In Prague</td></tr><tr><td>A</td><td>Mazzeo Giovanni</td><td>2</td><td>MDM-IMM-CNR lab</td><td>I</td><td>Tisnovsky Pavel</td><td>2</td><td>University In Prague</td></tr><tr><td>A</td><td>Oliver John</td><td>1</td><td>UC Berkeley</td><td>I</td><td>Frajtak Karel</td><td>2</td><td>University in Prague</td></tr><tr><td>A</td><td>Romano Luigi</td><td>1</td><td>Universita della Campania</td><td>I</td><td>Shin Dongwan</td><td>2</td><td>Korea Institute of Energy Research</td></tr><tr><td>A</td><td>Brenner Stefan</td><td>1</td><td>TU Braunschweig</td><td>I</td><td>Huang Jun</td><td>2</td><td>Duke University</td></tr><tr><td>A</td><td>Hundt Tobias</td><td>1</td><td>UCL Institute of Child Health</td><td>J</td><td>Yarygina Tetiana</td><td>4</td><td>University of Bergen</td></tr><tr><td>A</td><td>Kapitza Rudiger</td><td>1</td><td>TU Braunschweig</td><td>J</td><td>Otterstad Christian</td><td>3</td><td>University of Oslo</td></tr><tr><td>B</td><td>Artac</td><td>1</td><td>Necmettin Erbakan University</td><td>J</td><td>Lysne Olav</td><td>1</td><td>Simula Research Laboratory</td></tr><tr><td>B</td><td>Casale Giuliano</td><td>2</td><td>Imperial College London</td><td>J</td><td>Hole Kjell J</td><td>1</td><td>Simula Research Laboratory</td></tr><tr><td>B</td><td>Van Den Heuvel W-J</td><td>2</td><td>Tilburg University</td><td>J</td><td>Ytrehus</td><td>1</td><td>University of Tromso</td></tr><tr><td>B</td><td>van Hoorn Andre</td><td>5</td><td>University of Stuttgart</td><td>J</td><td>Aarseth Raymond</td><td>1</td><td>University of Tromso</td></tr><tr><td>B</td><td>Jakovits Pelle</td><td>1</td><td>University of Tartu</td><td>J</td><td>Tellnes Jorgen</td><td>1</td><td>University of Bergen</td></tr><tr><td>B</td><td>Leymann Frank</td><td>1</td><td>University of Stuttgart</td><td>J</td><td>Bagge Anya Helene</td><td>1</td><td>University of Bergen</td></tr><tr><td>B</td><td>Long Madeleine</td><td>1</td><td>University of Oslo</td><td>K</td><td>Cecconi Alessio</td><td>1</td><td>Vienna University</td></tr><tr><td>B</td><td>Papanikolaou Vicky</td><td>1</td><td>National School of Public Health</td><td>K</td><td>Di Ciccio Claudio</td><td>1</td><td>Sapienza University of Rome</td></tr><tr><td>B</td><td>Presenza Domenico</td><td>1</td><td>University of Rome</td><td>K</td><td>Dumas Marlon</td><td>1</td><td>University of Tartu</td></tr><tr><td>B</td><td>Russo Alessandra</td><td>1</td><td>University of Catania</td><td>K</td><td>Garcia-Banuelos Luciano</td><td>1</td><td>Tecnologico de Monterrey</td></tr><tr><td>B</td><td>Chesta Cristina</td><td>1</td><td>University of Chester</td><td>K</td><td>Lopez-Pintado Orlenys</td><td>1</td><td>University of Tartu</td></tr><tr><td>B</td><td>Di Nitto Elisabetta</td><td>1</td><td>Politecnico di Milano</td><td>K</td><td>Lu Qinghua</td><td>3</td><td>University of delaware</td></tr><tr><td>B</td><td>Gouvas Panagiotis</td><td>2</td><td>University of Athens</td><td>K</td><td>Mendling Jan</td><td>1</td><td>Humboldt-Universität zu Berlin</td></tr></tbody></table>

(Continued)
<table><caption>Table 2 (continued)</caption><thead><tr><th>Cluster</th><th>Author</th><th># Pub.</th><th>Affiliation</th><th>Cluster</th><th>Author</th><th># Pub.</th><th>Affiliation</th></tr></thead><tbody><tr><td>B</td><td>Stankovski Vlado</td><td>2</td><td>University of Ljubljana</td><td>K</td><td>Tran An Binh</td><td>1</td><td>CSIRO</td></tr><tr><td>B</td><td>Symeonidis Andreas</td><td>1</td><td>University of Thessaloniki</td><td>K</td><td>Weber Ingo</td><td>3</td><td>TU Berlin</td></tr><tr><td>B</td><td>Zafeiropoulos Anastasios</td><td>2</td><td>University of Athens</td><td>K</td><td>Binh Tran An</td><td>2</td><td>CSIRO</td></tr><tr><td>B</td><td>Soldani Jacopo</td><td>1</td><td>University of Pisa</td><td>K</td><td>O'Connor Hugo</td><td>2</td><td>CSIRO</td></tr><tr><td>B</td><td>Avritzer Alberto</td><td>4</td><td>eSulabSolutions</td><td>K</td><td>Rimba Paul</td><td>2</td><td>CSIRO</td></tr><tr><td>B</td><td>Ferme Vincenzo</td><td>3</td><td>Kiratech S.p.A.</td><td>K</td><td>Xu Xiwei</td><td>2</td><td>National Institute of Natural Hazards</td></tr><tr><td>B</td><td>Janes Andrea</td><td>3</td><td>The James Hutton Institute</td><td>K</td><td>Staples Mark</td><td>2</td><td>CSIRO</td></tr><tr><td>B</td><td>Russo Barbara</td><td>3</td><td>Free University of Bozen-Bolzano</td><td>K</td><td>Zhu Liming</td><td>3</td><td>CSIRO</td></tr><tr><td>B</td><td>Schulz Henning</td><td>3</td><td>Novatec Consulting GmbH</td><td>K</td><td>Jeffery Ross</td><td>2</td><td>Mayo Clinic</td></tr><tr><td>B</td><td>Menasche</td><td>3</td><td>University of Rio de Janeiro</td><td>L</td><td>Mirri Silvia</td><td>2</td><td>University of Bologna</td></tr><tr><td>B</td><td>Rufino Vilc</td><td>3</td><td>UFRJ</td><td>L</td><td>Melis Andrea</td><td>4</td><td>University of Bologna</td></tr><tr><td>B</td><td>Trubiani Catia</td><td>1</td><td>Gran Sasso Science Institute</td><td>L</td><td>Prandi Catia</td><td>2</td><td>University of Bologna</td></tr><tr><td>B</td><td>Bran Alexander</td><td>1</td><td>University of Exeter</td><td>L</td><td>Prandini Marco</td><td>4</td><td>University of Bologna</td></tr><tr><td>C</td><td>Rocha Carla</td><td>1</td><td>Rutgers University</td><td>L</td><td>Salomoni Paola</td><td>2</td><td>University of Bologna</td></tr><tr><td>C</td><td>Leite Leonardo</td><td>3</td><td>University of São Paulo</td><td>L</td><td>Callegati Franco</td><td>3</td><td>University of Bologna</td></tr><tr><td>C</td><td>Kon Fabio</td><td>3</td><td>University of São Paulo</td><td>L</td><td>Giallorenzo Saverio</td><td>2</td><td>University of Bologna</td></tr><tr><td>C</td><td>Milojicic Dejan</td><td>1</td><td>Hewlett Packard Labs</td><td>L</td><td>Delnevo Giovanni</td><td>1</td><td>University of Bologna</td></tr><tr><td>C</td><td>Meirelles Paulo</td><td>3</td><td>University of São Paulo</td><td>L</td><td>Monti Lorenzo</td><td>1</td><td>University of Bologna</td></tr><tr><td>C</td><td>Pinto Gustavo</td><td>2</td><td>University of São Paulo</td><td>M</td><td>Panichella Annibale</td><td>4</td><td>Delft University of Technology</td></tr><tr><td>D</td><td>Hou Kaiyu</td><td>3</td><td>Northwestern University</td><td>M</td><td>Jan Sadeeq</td><td>1</td><td>Technology Peshawar Pakistan</td></tr><tr><td>D</td><td>Wu Xiaochun</td><td>3</td><td>Zhejiang University</td><td>M</td><td>Arcuri Andrea</td><td>1</td><td>Kristiania University College</td></tr><tr><td>D</td><td>Leng Xue</td><td>3</td><td>Zhejiang University</td><td>M</td><td>Briand Lionel</td><td>1</td><td>University of Ottawa</td></tr><tr><td>D</td><td>Li Xing</td><td>3</td><td>University of Chicago</td><td>M</td><td>Olsthoorn Mitchell</td><td>2</td><td>Delft University of Technology</td></tr><tr><td>D</td><td>Yu YinBo</td><td>1</td><td>Wuhan University</td><td>M</td><td>van Deursen Arie</td><td>2</td><td>Delft University of Technology</td></tr><tr><td>D</td><td>Wu Bo</td><td>3</td><td>Google Inc.</td><td>N</td><td>Zimmermann Olaf</td><td>5</td><td>HSR University of Rapperswil</td></tr><tr><td>D</td><td>Chen Yan</td><td>3</td><td>Lunghwa University</td><td>N</td><td>Stocker Mirko</td><td>1</td><td>HSR University of Rapperswil</td></tr><tr><td>D</td><td>Yu Yinbo</td><td>2</td><td>Wuhan University</td><td>N</td><td>Zdun Uwe</td><td>3</td><td>University of Vienna</td></tr><tr><td>E</td><td>Nikouei Seyed Yahya</td><td>3</td><td>Binghamton University</td><td>N</td><td>Lubke Daniel</td><td>1</td><td>Leibniz Universität Hannover</td></tr><tr><td>E</td><td>Xu Ronghua</td><td>2</td><td>Binghamton University</td><td>N</td><td>Pautasso Cesare</td><td>1</td><td>University of Lugano</td></tr><tr><td>E</td><td>Chen Yu</td><td>3</td><td>University of Singapore</td><td>N</td><td>Kapferer Stefan</td><td>2</td><td>Witten/Herdecke University</td></tr><tr><td>E</td><td>Blasch Erik</td><td>2</td><td>Air Force Research Lab</td><td>N</td><td>Wittern Erik</td><td>2</td><td>Witten/Herdecke University</td></tr><tr><td>E</td><td>Aved Alexander</td><td>2</td><td>US Air Force Research Lab</td><td>N</td><td>Leitner Philipp</td><td>2</td><td>University of Gothenburg</td></tr><tr><td>E</td><td>Nagothu Deeraj</td><td>1</td><td>Binghamton University</td><td>O</td><td>Michalas Antonis</td><td>1</td><td>Tampere University of Technology</td></tr><tr><td>E</td><td>Faughnan Timothy R</td><td>1</td><td>Binghamton University</td><td>O</td><td>Paladi Nicolae</td><td>1</td><td>Research Institutes of Sweden</td></tr><tr><td>F</td><td>Sukaridhoto Sritrusta</td><td>3</td><td>Politeknik Surabaya</td><td>O</td><td>Dang Hai-Van</td><td>3</td><td>University of Westminster</td></tr><tr><td>F</td><td>Panduman YY Fridelin</td><td>1</td><td>Politeknik Surabaya</td><td>O</td><td>DesLauriers James</td><td>2</td><td>CNRS</td></tr><tr><td>F</td><td>Tjahjono Anang</td><td>1</td><td>Politeknik Surabaya</td><td>O</td><td>Kiss Tamas</td><td>2</td><td>CNRS</td></tr></tbody></table>
<table><caption>Table 2 (continued)</caption><thead><tr><th>Cluster</th><th>Author</th><th># Pub.</th><th>Affiliation</th><th>Cluster</th><th>Author</th><th># Pub.</th><th>Affiliation</th></tr></thead><tbody><tr><td>F</td><td>Falah Muhammad Fajrul</td><td>2</td><td>Politeknik Surabaya</td><td>O</td><td>Ariyattu Resmi C</td><td>2</td><td>Carleton University</td></tr><tr><td>F</td><td>Al Rasyid MU Harun</td><td>2</td><td>Politeknik Surabaya</td><td>O</td><td>Ullah Amjad</td><td>2</td><td>Carleton University</td></tr><tr><td>F</td><td>Wicaksono Hendro</td><td>2</td><td>Politeknik Surabaya</td><td>O</td><td>Bowden James</td><td>2</td><td>Carleton University</td></tr><tr><td>G</td><td>Kilamo Terhi</td><td>1</td><td>Aalto University</td><td>O</td><td>Krefting Dagmar</td><td>2</td><td>HTW Berlin</td></tr><tr><td>G</td><td>Lwakatare Lucy Ellen</td><td>1</td><td>University of Helsinki</td><td>O</td><td>Pierantoni Gabriele</td><td>2</td><td>University of Westminster</td></tr><tr><td>G</td><td>Karvonen Teemu</td><td>1</td><td>University of Helsinki</td><td>O</td><td>Terstyanszky Gabor</td><td>2</td><td>University of Westminster</td></tr><tr><td>G</td><td>Heikkila</td><td>1</td><td>University of Oulu</td><td>P</td><td>Basso Tania</td><td>1</td><td>Universidade Estadual de Campinas</td></tr><tr><td>G</td><td>Itkonen Juha</td><td>1</td><td>Aalto University</td><td>P</td><td>Antunes Nuno</td><td>3</td><td>University of Coimbra</td></tr><tr><td>G</td><td>Kuvaja Pasi</td><td>1</td><td>Aalto University</td><td>P</td><td>Vieira Marco</td><td>1</td><td>University of Coimbra</td></tr><tr><td>G</td><td>Mikkonen Tommi</td><td>2</td><td>University of Helsinki</td><td>P</td><td>Santos Walter</td><td>1</td><td>Universidade Estadual de Montes Claros</td></tr><tr><td>G</td><td>Oivo Markku</td><td>1</td><td>University of Oulu</td><td>P</td><td>Meira Wagner</td><td>1</td><td>Universidade Federal de Minas Gerais</td></tr><tr><td>G</td><td>Lassenius Casper</td><td>1</td><td>Aalto University</td><td>P</td><td>Flora Jose</td><td>4</td><td>University of South Carolina</td></tr><tr><td>G</td><td>Kalske Miika</td><td>1</td><td>University of Helsinki</td><td>P</td><td>Goncalves Paulo</td><td>2</td><td>Universidade de São Paulo</td></tr></tbody></table>

* “semi-open” clusters (C, G, M, N and O) of localised collaborators with sporadic, external collaborations;

* “closed”, localised clusters (F, L, P) that tend to be small but whose core authors tend to be the most prolific (L).

Given their larger reach, semi-open and open clusters have a better chance to gather an impactful community around the topic. Our call to the authors in the field (particularly the closed clusters that tend to be prolific but rather localised) is to establish international collaborations and coordinate to foster the advancement and growth of the field.

## Concepts and keywords

We conclude our quantitative analysis by providing a graphical representation of the main keywords present in the abstract of the contributions in our dataset. To conduct our analysis, we used VOSviewer by Van Eck & Waltman (2010), a software that offers text mining functionalities for constructing and visualising co-occurrence networks of important terms extracted from a given corpus. Specifically, we ignored basic words and copyright statements, and performed a full-count of the words present in the text. We considered only words occurring more than 15 times, sizing them by their relevance in terms of occurrences. The resulting graph, however, is still too large and dispersive to convey useful information: for the sake of clarity we present here a visualisation including only the top 60% most-occurring words.

We report the visualisation of the analysis in Fig. 5.
<figure><img src="image_11.png" /><figcaption>Figure 5 Word-Net of the abstracts in our dataset.</figcaption></figure>

Full-size

<figure><img src="image_12.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-5

VOSviewer automatically clustered the words in 4 areas using its modularity-based clustering algorithm, which is a variant of the cluster algorithm developed by *Clauset, Newman & Moore, 2004* to detect communities (clusters) in a network that also considers modularity.

We can interpret the clusters as follows:

* The blue area marks the main terms of this study, grouping words like *microservice* and *system*. The result does not surprise, since those words describe the design of the systematic selection we performed.

* The green area marks technical terms as *container* or *attack*.

* The red area identifies application terms, e.g., the targets or reasons of the research, if it is an industrial or research-focused article. We find for instance the word *Internet-of-Things*, as it is mainly cited with industry and research applications rather than along with terms like *container* and *cloud*.

* The yellow area includes words that identify the subject of a study, whether it be some *tool*, *data* (of the system, of the users), *users*, and they *privacy*. The word *tool* here is peculiar, as it acts as a bridge between the other areas. Also this finding is somehow expected, as the field of microservice security is marked by a fairly practical orientation towards automatisation of processes and control.
<figure><img src="image_13.png" /><figcaption>Figure 6 Type of publications.</figcaption></figure>

Full-size

<figure><img src="image_14.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-6

Publication context analysis

In this section, we discuss trends and considerations derived from reading the selected
publications and the research question detailed in “Research Questions”.

Types of publications

In Fig. 6 we report the distribution of the type of research contribution—whether
theoretical, practical, mixed, or a review.

More precisely, regarding the type of research contribution, we mapped every
publication in our dataset to one of the following types:

* *Theoretical* for publications that present an approach for a specific problem without any implementation artefact.

* *Applicative* for publications that describe an implemented application possibly with its validation.

* *Theoretical and Applicative* for publications that develop a theory and provide a practical tool, framework, program, or application.

* *Review* for both literature reviews and social studies (e.g., on developers).

Reviews constitute the 15% of works, marking the fragmented shape of the field, which is in rapid expansion and in need for studies to map its research landscape. Besides surveys, the other contributions in the field are distributed among a 52% share that introduce new theoretical results, a 20% share that contribute by pairing new theoretical proposals with implementations, and the remaining 11% describing pure applications. The fact that the main publications in the field are of theoretical nature is surprising, given the prominently applied nature of microservices. Indeed, excluding surveys, we have that for every 5 publications slightly more than 3 (64% of them) are of purely theoretical. We attribute this figure to two phenomena. The first marks the current exploratory trend of the field, which is still engaged in proposing new ideas and in evaluating and maturing them into models amenable to implementation. The second phenomenon relates to the impact
that microservices have at the processes/organisational level, with works that are intrinsically theoretical because their contribution can be hardly crystallised into automated implementations, e.g., for proposals of attack models or techniques for handling security within organisations and development teams notwithstanding the possible explanations above, it is worth noting the (quantitative) distance between contributions from academia and applications available to practitioners and the industry, which is an indicator of an untapped potential for joint synergies between the two communities.

After having characterised the type of publications in the field, we proceed by exploring the results from the answer of the research questions following the 4 macro-groups presented in “Research Questions”.

## Insights

**Technology transfer:** the field of microservice security is still in the early phase of new idea proposals. There are just a few implementations of these ideas, which hinders industrial adoption.

## Threat model

A total of 176 publications (ca. 65% of the dataset) give a positive answer to at least one question of this category. However, only 53 publications among those 120 (ca. 30% of the total dataset) mentioned the usage of at least one threat model to analyse or classify threats. The reason for those publications to adopt a threat model vary, from publications that use the model to motivate their proposed solutions to reviews that use the model to structure their overview of the state of the art. Interestingly, in ca. 80% of those publications that mention the usage of at least one known threat model, the model is tailored to work on a specific application scenario. This is an indication of the lack of usage of a generic threat model for microservice security. We conjecture that this lack of usage of generic threat models is due to the fact that the majority of research done on microservice security comes from the software (engineering, languages) side of the field, rather than from the side of security, which advocates for a security-by-design approach.

A complementary explanation of that phenomenon is that there is no affirmed threat model for microservices, e.g., due to the difficulty of making the model specific enough for microservices yet avoiding the infamous problem of threat explosion, where the effort required to prioritise and consider all threats starts exceeding the benefits of proposing methods to manage them *Wuyts et al. (2018)*. Threat explosion is a known problem of neighbouring areas to microservices, like cloud, edge, and fog computing (*Di Francesco, Malavolta & Lago, 2017; Ibrahim, Bozhinoski & Pretschner, 2019; Guija & Siddiqui, 2018; Lou et al., 2020; Flora, 2020; Truong & Klein, 2020; Russinovich et al., 2021*) where the authors resorted to defining smaller, customised threat models rather than adopting standard ones, due to the problem of requiring conspicuous adaptation efforts to tailor them to such complex and multifaceted architectures.

Regarding the possible attacks addressed in the publications, Fig. 7 categorises the publications based on the STRIDE threats, following up on question Q2 asking if the
<figure><img src="image_15.png" /><figcaption>**Figure 7** Attack type identified following the STRIDE classification.</figcaption></figure>

Full-size

<figure><img src="image_16.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-7

publication involves at least one of threats of the STRIDE classification. The most commonly tackled attacks are of the “spoofing” and “denial of service” kinds. This is an effect of the push for fine-granularity and independence of services advocated by microservices, where applications result from several small (in size), independent software components that communicate with each other. Such decentralised communication/ coordination is one of the most important attack vectors for microservice applications, in particular, the possibility to disguise a communication from an unknown source as being from a known, trusted source, which matches the spoofing attack category. Such attacks, along with tampering and repudiation ones (which together represent more than half of the attack types found in our collection), entail the need for solutions to address attacks centred around exploits of data provenance.

A similar consideration can be made for denial-of-service attacks, where the flexible scalability of microservices allows malicious intruders to, e.g., scale up peripheral microservices and hit more central and well-protected components with (distributed) overpowering attacks.

## Insights

**Adoption of security-by-design:** security in microservices frequently comes as an afterthought, whereas it should be one of the main concerns for their engineering.

**Data provenance:** the quantity of spoofing, tampering, and repudiation attacks highlights the need to address the general problem of data provenance in microservices.

**Dedicated attack trees and threat models:** while there are attacks that specifically pertain to microservices, such as those that leverage the scalability of microservice architectures to cause denial of service, there are no dedicated threat models to help developers become aware of those particular threats.
## Security approach (Mitigation)

In terms of solutions to security issues proposed by the publications (questions Q6–Q10), the most common approach (45 publications) is to address specific problems, such as authentication or exfiltration, rather than suggesting a general approach. Publications dealing with architectural aspects rarely address the overall picture (only 25, roughly 8%, of publications focuses on IDS, IPS, Exfiltration Leaks and Threat Intelligence). Again, they focus on local threats like intra-communications or authentication (question Q11). These observations suggest that there is a lack of security approaches that address applications across the full stack.

As far as privacy and GDPR are involved (question Q12), surprisingly, only 9 publications consider privacy protection relevant or worthy of analysis. In particular, only one publication Badii et al. (2019) considers the GDPR as a guideline to follow in order to protect the privacy of users. Example of this kind of guideline application are shown in Voigt & Von dem Bussche (2017). Considering that many of the solutions included in the dataset are Cloud-based solutions, it is surprising to note that only one publication claims to be GDPR compliant.

## Insights

**Global view/control:** the distributed nature of microservices introduces the need for technologies that provide global yet decentralised observability and control, i.e., tools that aid in the enforcement of security policies over a whole architecture without single points of failure.

**React & recover techniques:** while we found solutions to prevent and detect attacks, there are only a few proposals about how microservice systems could react to and recover from them.

**Comprehensive technological references:** microservices use diverse sets of technology stacks, each characterised by peculiar exploits. To secure microservice architectures effectively, implementors need dedicated technological references to avoid known threats.

## Infrastructure

We start the discussion by first focusing on the type of microservice infrastructure used by the various contributions. Specifically, we have 205 publications in our dataset that answer positively to question Q13. The breakdown of the answers is:

* 39% (80) describe a centralised approach;

* 24% (49) use a decentralised approach;

* 17% (35) resort to a hybrid approach;

* 20% (41) do not specify which approach they use.

The most widely adopted turns out to be the centralised one. We conjecture two explanations behind this observation. First, the centralised approach has the merit of simplifying the definition, deployment, monitoring, and evolution of policies holding over all the components in a given architecture—traded off with scalability issues and single-point-of-failure concerns. Second, we note that, among the approaches that appeared early
in the literature, many focused on converting monolithic applications into microservice
applications. Clearly, having a centralised controller that manages the orchestration of
microservices helps this process and is closer in spirit to the monolithic workflow.
However, the advent of federated, multi-cloud solutions (that prevent the identification/
deployment of a centralised authority over the whole peer network) as well as new
distributed-consensus technologies (e.g., blockchains), has led to a decentralisation of
control, making new decentralised or hybrid solutions emerge (in our dataset) starting
from 2018. As an example, in 2015 and 2016, we find publications such as Callegati et al.
(2016) and Lysne et al. (2016) which presented centralised approaches to enable security in
microservice platforms, while starting from 2018 hybrid and decentralised solutions
appear like Pahl & Donini (2018) for certificate-based authentication or Andersen et al.
(2018), Andersen et al. (2017) where authors propose a decentralise high-fidelity city-scale
emulation to verify the scalability of the authorisation tier.

We notice that the advent of new distributed-consensus technologies also affected the
orchestration approach of microservice solutions. For example, works such as Xu et al.
(2019) propose a decentralised, blockchain-based data-access control for microservices.
Recent contributions also tackled the problem of authentication and authorisation in
decentralised settings, e.g., Bánáti et al. (2018) develops a workflow-oriented authorisation
framework to enforce authorisation policies in a decentralised manner, Taha, Talhi &
Ould-Slimanec, 2019 presents a new algorithm that distributes tasks on clusters of
vehicular ad-hoc networks, Zhiyi, Shahidehpour & Xuan, 2018 proposes a secure
decentralised energy management framework, and Tourani et al. (2019) describes a
decentralised data-centric SECurity-as-a-Service (SECaaS) framework for elastic
deployment and provisioning of security services. Another interesting work has been done
in Falah et al. (2020) where authors brought the concept of a digital twin to show how a
microservice infrastructure approach can speed up the process of deploying complex
infrastructure components.

Infrastructure as a Service (IaaS), which is the focus of question Q14, is also a recurrent
topic in our dataset, with 66 publications yielding a positive answer. IaaS include
solutions that provide and manage low-level infrastructural components, like computing
resources, data storage, network components, etc. We notice that IaaS is mentioned mainly
as the modality used to deploy the solution but is not studied as a security subject/
mechanism per se. Works such as Sultan, Ahmad & Dimitriou, 2019 emerge as exceptions;
their authors analysed the security benefits obtained using a container-based infrastructure
exposed as a service.

Question Q15 investigates Service Discovery, i.e., the automatic detection of services
and their functionalities available in a given architecture/network. A total of 16
publications mention Service Discovery in the context of security. Mainly, they propose
architectures that support reactive mechanisms for the detection of security issues. Of
those, only 2 mention service registration procedures that include data for performing the
preventive analysis of the composition, with the goal of statically finding and fixing
possible vulnerabilities and misconfigurations: Callegati et al. (2018) and Kamble & Sinha
(2016).
**Insights**

**Global view/control:** while there is not a definitive approach to microservice security control (whether it be centralised, decentralised, or hybrid), there is a recognised need for applying security control policies in a consistent way across all microservices belonging in the same architecture.

**Development**

DevOps and Agile are recurring topics in our dataset. Based on the answer to question Q16, 76 publications used the DevOps approach, while, answering to Q17, 57 used Agile methods—of those 99 publications which represent the 40% of all publications in our dataset, 10 mention both approaches. There is a common consensus in these publications that Agile/DevOps is important in security because microservices seem to be the perfect match for this type of software development model (Vehent, 2018; Hsu, 2018). In particular, microservices align with the tenet of both approaches: to assign dedicated, independent teams to the development of small and independent components within the architecture Continuous Integration (CI) process. However, the majority of the selected publications provide no in-depth security analysis of any of the two development approaches, but rather indicate the inclusion of generic security measures in the steps of the development method. Only three works, namely Mansfield-Devine (2018), Anisetti et al. (2019) and Kumar & Goyal (2020), propose concrete and specific variants of the DevOps methodology that tackle security issues—in particular Mansfield-Devine (2018) explicitly cites the guidelines of DevSecOps Hsu (2018).

Migration is one of the main challenges faced in this context; migrating applications introduces important security concerns (Lwakatare et al., 2019) that are difficult to track, due to the lack of appropriate devices (both organisational and linguistic) to elicit them from the source codebase and make sure they hold in the migrated one. Another major challenge is the coordination between development teams in the context of privacy-handling issues (Gupta, Venkatachalapathy & Jeberla, 2019). Also, security becomes a challenging aspect since the (small, independent) teams need to know many aspects of security (Leite et al., 2019) and those DevOps criteria for testing, building, and deployment automation are often neither properly followed in industrial environments (Bogner et al., 2019), nor for automated scans (Chondamrongkul, Sun & Warren, 2020).

When considering domain- and model-driven approaches (questions Q18 and Q19), 16 publications consider domain-driven approaches and 26 consider model-driven ones, such as Kapferer & Zimmermann (2020), Avritzer et al. (2020). These topics are therefore not as widespread as DevOps. Moreover, all citations in these cases are just brief references of the development approach, and lack a discussion on how one of the two approaches can be used in a security context on microservices.

The last question in this category, Q20, concerns security standards, i.e., curated sets of technologies, policies, concepts, safeguards, guidelines, assessments, procedures, training programmes that should be adopted to reduce security risks and mitigate attacks. The answers we gathered for this question surprised us. Indeed, security standards are a staple
<figure><img src="image_17.png" /><figcaption>**Figure 8** Blockchain trend.</figcaption></figure>

Full-size

<figure><img src="image_18.png" /></figure>

DOI: 10.7717/peerj-cs.779/fig-8

element of industries and organisations that want to impose and guarantee a certain level of security on their members and collaborators (often also for certification purposes – Stewart, Chapple & Gibson, 2012, Lie, Sánchez-Gordón & Colomo-Palacios, 2020). Despite their widespread use in practice, only 7 publications mention security standards.

In particular, *Souppaya, Morello & Scarfone (2017)* mentions the usage of X.509 to verify a secure method for key exchange between microservice. In *Brenner et al. (2017)* the authors show a solution for securing microservices through the SGX Intel Standard. The authors of *Vassilakis, Panaousis & Mouratidis (2016)* analyse the concept of Small-Cell-as-a-Service, i.e., a technological paradigm for the development of Virtualised Mobile Edge Computing Environments, using several mobile standards for 5G and SDN networks (e.g., *MobileFlow Pentikousis, Wang & Hu, 2013* and VNFs *Agarwal et al. (2019)*). Finally, *Yarygina (2018)* performs a deep analysis on securing microservices, citing and analysing several know standards for both microservice management and security purposes.

**Insights**

**Migration to microservices:** there are no established techniques to help developers migrate legacy systems to microservice architectures, and in particular to identify the possible security threats that come from such a migration.

**DevSecOps:** Agile and DevOps practices are widely used when developing microservices, yet only a few publications address how security is addressed and combined in these practices.

**Additional considerations**

By analysing our dataset, we were surprised to find many citations to blockchain technologies (as reported above) as well as the lack of more and more mainstream technologies like service mesh and serverless.

Regarding blockchain technologies, we found 31 publications mentioning or explicitly using blockchains. The decentralisation and independence of microservices constitute a
good pairing for the usage of blockchain technologies. Figure 8 presents also the trend of publications using blockchain in the dataset. There is an increasing interest in blockchain applications for microservice architecture. Examples of that pairing include works such as Nagothu et al. (2018) and Xu et al. (2019), where the trust-chain of the blockchain is combined with a decentralised microservice architecture to create strong smart contract systems, or Lu et al. (2021), where authors proposed a model-driven engineering approach for blockchain applications with microservice.

New approaches for microservices design and usage such as service mesh Li et al. (2019a), i.e., a dedicated infrastructure layer for facilitating service-to-service communications between microservices is just mentioned by 3 works: Pahl & Donini (2018), where the authors indicate a service mesh architecture for authenticating services—securely adding information to their executables and validating the correct execution of distributed entities with such certificate-based approach—and Suneja, Kanso & Isci (2019), which mentions the service-mesh sidecar pattern used to control security. Another interesting work regarding service mesh is Hahn, Davidson & Bardas (2020) where authors analysed under several scenarios issues and challenges in Service Meshes.

Similarly, serverless Hendrickson et al. (2016) is mentioned only in 4 publications. We did not expect to find (50%) more citations of serverless than those regarding service mesh. Serverless is a cloud computing execution model in which the cloud provider dynamically manages the allocation/scaling of machine resources depending on inbound requests. Indeed, while the service mesh is a technology from the (micro)service-oriented context, serverless is a more neighbouring concept to that of stateless microservice deployment.

In this context, the most relevant publication is Casale et al. (2019), which presents the results of a European research project to develop a model-driven DevOps framework for creating and managing applications based on serverless computing. Its main result consists in designing applications as fine-grained and independent microservices that can efficiently and optimally exploit the serverless paradigm. The serverless term, despite starting to get momentum, is still loosely related to microservices.

Given their increasing importance and impact in the industry and their close relation with microservices, we argue that both service mesh and serverless will attract the general attention of the research community in the near future, as well as that of security research.

## Insights

**Comprehensive technological references:** the progressive adoption of new technologies in the world of microservices (such as blockchains, service meshes, and serverless) calls for dedicated investigations and reports on their impact on the security of these systems.

## Correlation between research questions

The amount of data collected in our dataset is large enough to represent a statistically-relevant sample. In this section, we leverage this to study correlations between our research
<table><caption>Table 3 Correlation matrix among research questions (the values are percentages).</caption><thead><tr><th></th><th>Q2</th><th>Q3</th><th>Q4</th><th>Q5</th><th>Q6</th><th>Q7</th><th>Q8</th><th>Q9</th><th>Q10</th><th>Q11</th><th>Q12</th><th>Q13</th><th>Q14</th><th>Q15</th><th>Q16</th><th>Q17</th><th>Q18</th><th>Q19</th><th>Q20</th></tr></thead><tbody><tr><th>Q2</th><td></td><td>27.11</td><td>32.80</td><td>8.10</td><td>13.75</td><td>3.19</td><td>-7.74</td><td>12.36</td><td>0.41</td><td>24.68</td><td>-4.12</td><td>-22.74</td><td>-8.06</td><td>6.27</td><td>-3.88</td><td>-6.71</td><td>8.45</td><td>0.19</td><td>0.41</td></tr><tr><th>Q3</th><td>27.11</td><td></td><td>28.59</td><td>7.37</td><td>18.93</td><td>29.11</td><td>7.49</td><td>8.68</td><td>12.81</td><td>16.69</td><td>8.54</td><td>0.75</td><td>5.51</td><td>15.10</td><td>-6.93</td><td>-10.82</td><td>3.57</td><td>2.26</td><td>12.81</td></tr><tr><th>Q4</th><td>32.80</td><td>28.59</td><td></td><td>12.18</td><td>6.30</td><td>5.05</td><td>10.50</td><td>6.05</td><td>8.45</td><td>17.28</td><td>9.01</td><td>-10.39</td><td>-7.34</td><td>-0.42</td><td>1.05</td><td>1.34</td><td>6.88</td><td>-6.90</td><td>8.45</td></tr><tr><th>Q5</th><td>8.10</td><td>7.37</td><td>12.18</td><td></td><td>6.15</td><td>8.26</td><td>12.31</td><td>5.58</td><td>13.51</td><td>-12.44</td><td>5.04</td><td>-2.41</td><td>5.31</td><td>9.24</td><td>-10.48</td><td>-7.12</td><td>-13.61</td><td>-9.07</td><td>8.06</td></tr><tr><th>Q6</th><td>13.75</td><td>18.93</td><td>6.30</td><td>6.15</td><td></td><td>77.49</td><td>22.89</td><td>14.23</td><td>14.86</td><td>3.83</td><td>5.58</td><td>0.88</td><td>17.76</td><td>14.23</td><td>-0.42</td><td>2.99</td><td>6.90</td><td>4.96</td><td>-5.83</td></tr><tr><th>Q7</th><td>3.19</td><td>29.11</td><td>5.05</td><td>8.26</td><td>77.49</td><td></td><td>20.77</td><td>12.55</td><td>17.68</td><td>1.97</td><td>0.88</td><td>0.78</td><td>15.67</td><td>12.55</td><td>4.41</td><td>-1.48</td><td>10.17</td><td>7.44</td><td>-5.14</td></tr><tr><th>Q8</th><td>-7.74</td><td>7.49</td><td>10.50</td><td>12.31</td><td>22.89</td><td>20.77</td><td></td><td>10.03</td><td>14.15</td><td>-5.27</td><td>20.31</td><td>20.12</td><td>31.15</td><td>13.76</td><td>8.28</td><td>9.01</td><td>4.83</td><td>-4.89</td><td>-8.03</td></tr><tr><th>Q9</th><td>12.36</td><td>8.68</td><td>6.05</td><td>5.58</td><td>14.23</td><td>12.55</td><td>10.03</td><td></td><td>25.72</td><td>3.19</td><td>13.09</td><td>-0.84</td><td>15.70</td><td>14.01</td><td>-0.66</td><td>3.25</td><td>8.28</td><td>14.01</td><td>-3.80</td></tr><tr><th>Q10</th><td>0.41</td><td>12.81</td><td>8.45</td><td>13.51</td><td>14.86</td><td>17.68</td><td>14.15</td><td>25.72</td><td></td><td>8.88</td><td>10.14</td><td>0.37</td><td>7.54</td><td>6.04</td><td>5.95</td><td>3.53</td><td>2.93</td><td>6.04</td><td>12.17</td></tr><tr><th>Q11</th><td>24.68</td><td>16.69</td><td>17.28</td><td>-12.44</td><td>3.83</td><td>1.97</td><td>-5.27</td><td>3.19</td><td>8.88</td><td></td><td>0.36</td><td>5.13</td><td>-17.71</td><td>0.15</td><td>12.62</td><td>9.16</td><td>9.02</td><td>6.24</td><td>8.88</td></tr><tr><th>Q12</th><td>-4.12</td><td>8.54</td><td>9.01</td><td>5.04</td><td>5.58</td><td>0.88</td><td>20.31</td><td>13.09</td><td>10.14</td><td>0.36</td><td></td><td>-1.44</td><td>9.26</td><td>4.38</td><td>-1.62</td><td>6.16</td><td>1.34</td><td>-4.32</td><td>-2.81</td></tr><tr><th>Q13</th><td>-22.74</td><td>0.75</td><td>-10.39</td><td>-2.41</td><td>0.88</td><td>0.78</td><td>20.12</td><td>-0.84</td><td>0.37</td><td>5.13</td><td>-1.44</td><td></td><td>26.24</td><td>9.08</td><td>11.22</td><td>13.12</td><td>7.16</td><td>5.77</td><td>5.29</td></tr><tr><th>Q14</th><td>-8.06</td><td>5.51</td><td>-7.34</td><td>5.31</td><td>17.76</td><td>15.67</td><td>31.15</td><td>15.70</td><td>7.54</td><td>-17.71</td><td>9.26</td><td>26.24</td><td></td><td>22.90</td><td>10.67</td><td>12.47</td><td>11.75</td><td>8.50</td><td>-3.18</td></tr><tr><th>Q15</th><td>6.27</td><td>15.10</td><td>-0.42</td><td>9.24</td><td>14.23</td><td>12.55</td><td>13.76</td><td>14.01</td><td>6.04</td><td>0.15</td><td>4.38</td><td>9.08</td><td>22.90</td><td></td><td>13.07</td><td>10.85</td><td>18.85</td><td>14.01</td><td>-3.80</td></tr><tr><th>Q16</th><td>-3.88</td><td>-6.93</td><td>1.05</td><td>-10.48</td><td>-0.42</td><td>4.41</td><td>8.28</td><td>-0.66</td><td>5.95</td><td>12.62</td><td>-1.62</td><td>11.22</td><td>10.67</td><td>13.07</td><td></td><td>57.34</td><td>25.21</td><td>19.94</td><td>0.85</td></tr><tr><th>Q17</th><td>-6.71</td><td>-10.82</td><td>1.34</td><td>-7.12</td><td>2.99</td><td>-1.48</td><td>9.01</td><td>3.25</td><td>3.53</td><td>9.16</td><td>6.16</td><td>13.12</td><td>12.47</td><td>10.85</td><td>57.34</td><td></td><td>33.08</td><td>10.85</td><td>-2.13</td></tr><tr><th>Q18</th><td>8.45</td><td>3.57</td><td>6.88</td><td>-13.61</td><td>6.90</td><td>10.17</td><td>4.83</td><td>8.28</td><td>2.93</td><td>9.02</td><td>1.34</td><td>7.16</td><td>11.75</td><td>18.85</td><td>25.21</td><td>33.08</td><td></td><td>40.00</td><td>-4.94</td></tr><tr><th>Q19</th><td>0.19</td><td>2.26</td><td>-6.90</td><td>-9.07</td><td>4.96</td><td>7.44</td><td>-4.89</td><td>14.01</td><td>6.04</td><td>6.24</td><td>-4.32</td><td>5.77</td><td>8.50</td><td>14.01</td><td>19.94</td><td>10.85</td><td>40.00</td><td></td><td>-3.80</td></tr><tr><th>Q20</th><td>0.41</td><td>12.81</td><td>8.45</td><td>8.06</td><td>-5.83</td><td>-5.14</td><td>-8.03</td><td>-3.80</td><td>12.17</td><td>8.88</td><td>-2.81</td><td>5.29</td><td>-3.18</td><td>-3.80</td><td>0.85</td><td>-2.13</td><td>-4.94</td><td>-3.80</td><td></td></tr></tbody></table>

questions, by way of the answers that the publications in our dataset give to each of them. Correlations can be used to understand which of the different aspects of microservice security are most commonly in a positive correlation (paired) in the dataset, and which ones are negatively correlated (mutually exclusive).

We report in Table 3 the correlation matrix—excluding research question Q1, since no publication answered it. While the obtained matrix is symmetric and we could report just one half, in Table 3 we report the full matrix for convenience, to provide a more immediate view of how each question correlates with all of the other ones.

We conditionally colour the cells of the Table, first, attributing colour intensity according to correlation absolute value—maximal intensity for 100% and degrading towards 0%—, second, setting a transition threshold above 30% (absolute value) from green to orange, to help to spot relevant correlations. Looking at the Table, we notice the predominance of light-coloured cells. This result can be interpreted as an indication that the research questions used in this work are mostly orthogonal, and thus suited to cover the reviewed subject with almost no wasteful overlap.

No anti-correlation was found, i.e., negative correlations over the 30% threshold in absolute value. In the following, we comment on all positive correlations above 30%.

No anti-correlation was found, i.e., negative correlations over the 30% threshold in absolute value. In the following, we comment on all positive correlations above 30%.
**Q2-Q4 (32.80%)** The questions relate the use of STRIDE threat model with one of its identified specific threats. This seems to be an obvious correlation since we are looking for a specific STRIDE path, or at least one of his threats.

**Q7-Q6 (77.49%)** The questions ask if the publication mentions IPS or IDS functionalities respectively. The strong correlation indicates how IPS and IDS are strictly related. Indeed, in practice, IDS may exist without IPS, but not the opposite, because prevention mechanisms are typically built as a reaction to a detected attack;

**Q8-Q14 (31.15%)** The questions relate Threat Intelligence functionalities with Infrastructure as a Service deployment, which can define a campaign strategy for a Threat Intelligence analysis.

**Q17-Q16 (57.34%)** The questions relate the Agile development methodology with DevOps and Continuous Integration. As also emphasised in other studies like Lwakatare et al. (2019), this correlation can be easily explained by the fact that DevOps is sometimes considered an Agile method or its evolution. Processes adopting DevOps, therefore, adopt also Agile;

**Q19-Q18 (40.00%)** The questions relate Domain-Driven Development and Model-Driven Development. We conjecture that this correlation is present because mentions of Domain-Driven Development often mentions Model-Driven Development as an alternative approach and *vice versa*;

**Q18-Q17 (33.08%)** The questions relate Domain-Driven Development and Agile methodologies, indicating a correlation, mainly because often Agile methodologies employ Domain-Driven Development.

## Threats to validity

Our study is subject to limitations that can be categorised into construct validity, external validity, internal validity, and reliability following the guidelines of Runeson et al. (2012).

*Construct validity* “reflects to what extent the operational measures that are studied really represent what the researcher has in mind and what is investigated according to the research questions”. To mitigate a potential misinterpretation and making sure that the constructs discussed in the research questions are not interpreted differently by the researchers, we adopted various triangulation rounds using online meetings and we designed a set of binary research questions to foster objectivity in answering them.

Another potential risk regards whether we were exhaustive during data collection, i.e., whether we may have missed any significant publication in our review. This risk cannot be completely mitigated but to minimise this risk we deliberately chose to have simple and broad keywords giving more initial hits that later were further filtered out. Moreover, we conducted a snowballing process to extend our initial dataset looking for potentially relevant publications that our query did not select.

*External validity* regards the applicability of a set of results in a more general context and is not a concern for this study since we focus on the intersection of the fields of microservices and security without any attempt of generalising the findings to a broader context. We do not claim that either our qualitative or our quantitative findings should also hold for other large fields.
*Internal validity* is of concern when causal relations are examined when there is a risk that the investigated factor is also affected by a third factor. This thread is not a concern for this study because we presented only correlations between different factors but did not examine causal relations.

*Reliability* concerns to what extent the data collection and analysis depend on the actual researchers. This risk has been partially mitigated by selecting as many objective criteria as possible for the filtering and by requiring at least a two-people consensus in case of more subjective decisions. In particular, the retrieval of the publications was performed by using search engines. The first filtering of the results (Step 2, cf. “Review Method”) was conducted by running a script that uses objective criteria such as counting the number of keywords present and the length of the publication. These automatically computed results were double-checked by at least one author to prevent problems due to the parsing of PDFs and to make sure that the language of the publication was English. The second filtering (Step 3, cf. “Review Method”) performed by reading the title, abstract, and (if needed) the body of the publication, was performed in parallel by two authors. Decision conflicts were solved by discussion involving at least two authors until a consensus was reached. For the publication analysis (Step 4, cf. “Review Method”), due to the binary nature and formulation of the questions, the 20 research questions were answered by the author assigned to the publication. To detect possible observer bias and errors, we selected a random subset of 15 papers and had a different author answer to the research questions. The calculation of the kappa index of agreement as proposed in Cohen (1960) over the two result sets yielded a value of κ = 0.99998, giving us statistical confidence over the perceived precision of questions and objectiveness of answers.

The reliability of the study is strengthened by being open and explicit about the
process of data collection and analysis. For transparency, reproducibility, and reuse, we
report the data used in this study at https://doi.org/10.5281/zenodo.4774894, which
includes both the final dataset with the answers to all the research questions and also the
set of rejected publications along with the reason for exclusion.

We also report in the Appendix each entry of our dataset and its answers to our research questions.

DISCUSSION AND FUTURE DIRECTIONS

In this article, we presented a systematic review of the literature regarding microservice security. To conduct our research, we followed a structured approach that allowed us to gather 290 peer-reviewed publications, which, at the time of writing, constitutes the largest curated dataset on the topic.

To study our dataset, we conducted first an investigation on the metadata of the
publications, which gave us some insight to map what are the publication outlets, the
communities, and the key research concepts that characterise the field. Then, we
performed an analysis, associating each element in our dataset to a vector of 20 different
markers—presented in the form of 20 research questions.

Since our markers belong in four micro-groups (of threat-model, security,
infrastructure, and development approaches), we used that partition to provide an
overview of the literature through the lenses of each cluster. As a byproduct of our analysis on the content of each publication, we found concepts and topics that we did not include in our questions but that recur in multiple publications, e.g., the usage of blockchain or service-mesh technologies. To provide a more comprehensive picture of the field, we described and contextualised also these additional elements. Since our dataset forms a statistically relevant vector field, we also performed a correlation study over the components of the vectors and reported the strongest correlations (e.g., between intrusion-detection (IDS) and intrusion-prevention (IPS) systems in microservice deployments) along with possible explanations of the identified phenomena.

In the following, we draw a summary of the main open challenges that emerged from our study, which forms a call for action for the community of researchers and practitioners working in the field of microservice security and its neighbouring areas.

**Data provenance:** the distributed nature of microservices calls for the certification of their outputs, which other federated services receive as input and need to trust. However, there is a lack of best practices and/or standards for such a task.

**Technology transfer:** there exists a sensible amount of research on microservices security, but transferring those results—e.g., viable methods and tools for validation and verification—to the industry is difficult and applications are almost non-existent.

**Security-by-design adoption:** while many advocate for adopting security-by-design at all stages of a microservice lifecycle (from design to monitoring), there are no established references nor guidelines on how these principles can be reliably adopted in practice.

**Dedicated attack trees and threat models:** threats in microservice systems can come from multiple sources, from the interaction of the layers of a chosen technology stack to how microservices interact with each other—e.g., in an exclusive network, on a federated basis, on the Web, etc. Practitioners lack dedicated attack trees and threat models to help them consider and tackle the multifaceted attack surface of microservice architectures.

**Comprehensive technological references:** microservice development entails the use of (heterogeneous) technology stacks, whose combinations and interactions give way to exploits at different levels. These include data leakage due to host-container interactions, threats to encryption reliability due to interacting heterogeneous standards and data-format conversions, as well as surreptitious attacks through software libraries hijacking. Besides the lack of dedicated threat models, there is also a need for concrete references to secure specific technology stacks.

**Migration to microservices:** several works provide structures and methods to migrate legacy systems to microservices architectures. However, there are no established techniques to elicit the assumptions and invariants (e.g., on shared-memory communication, runtime environment, concurrent/interleaved database accesses, etc.) of the legacy system that the developers of the microservices must deal with—least of all considering how those factors impact the security aspects of the migrated architecture. An additional step in this direction would benefit from following principled security-by-design disciplines.

**Global view/control:** the distributed nature of microservices makes it difficult to check the correct implementation of architecture-wide security policies, especially when each
microservice has a dedicated security configuration. The issue is further exacerbated by the DevOps practice of having different teams deal separately with all aspects of the microservices they develop, including the implementations of their security policies. This fact highlights the need for tools that provide global overviews and guarantees on the security policies, protocols, and invariants of microservice systems.

**React & recover techniques:** while the literature on preventive and detective measures against attacks abound, little has been done on how microservices should react to attacks and, as a consequence, recover their normal behaviour.

**DevSecOps:** Agile and DevOps practices are widely used when developing microservices, yet there is no established reference on how these approaches should integrate security in all their aspects (from team culture, management and communication to develop technologies and techniques) and into the lifecycle of microservices.

**Fragmentation of outlets:** researchers (and practitioners) working on microservices security do not have reference venues (neither journals nor conferences). This has at least two negative consequences. First, it makes it more difficult to gather the relevant work that constitutes the current state-of-the-art of their field—a need to which this study provides a partial solution, in the form of a snapshot of the current field landscape. Second, reference venues work also as gathering and exchange points for researchers to discuss current problems and new ideas, form interest groups, and concretise new contributions and projects to advance the knowledge in the field. Here, our call for action is at the community level, advocating for the establishment of a few reference, high-quality venues able to focus, inform, and orient the agenda of the field.

Regarding the future steps of the line of work of this contribution, we notice that here we focused our investigation on peer-reviewed publications. However, in the general field of microservices (and their security, by extension) the grey literature—which includes non-peer-reviewed reports, working papers, government documents (e.g., those by NIST), white papers—constitutes a relevant body of knowledge that deserves separate studies. As future work, we intend to pursue an activity similar to what we presented in this work, but purported to investigate the grey literature.

# APPENDIX

## Dataset and Research Questions in tabular form

We partition the dataset into four tables, each representing the categorisation described in “Types of Publications”— (i) Theoretical, (ii) Applicative, and (iii) Theoretical and Applicative publications and iv) Survey. For each table we have 5 columns. The first 4 columns from the left (after the column containing the reference (“Ref.”) to the publication from the publications dataset) and grouped under the column group “Group” report the 4 Research Questions Groups as defined in “Research Questions”. The value shown indicates the amount of questions of each group the publications answered. The last column labeled “Q.Num.” presents the number of questions having a positive answer.
<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td colspan="6">Survey Publications</td></tr><tr><td>Sultan, Ahmad & Dimitriou (2019)</td><td>3</td><td>2</td><td>2</td><td>1</td><td>2,4,5,8,11,13,14,16</td></tr><tr><td>Cerny & Donahoo (2016)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Westerlund & Kratzke (2018)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,15,16</td></tr><tr><td>Bandeira et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Ahmed et al. (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>8,13</td></tr><tr><td>Di Salle, Gallo & Pompilio (2016)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,16</td></tr><tr><td>Bélair, Laniepce & Menaud (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Márquez & Astudillo (2019)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,4,13,14</td></tr><tr><td>Puliafito et al. (2019)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Manu et al. (2016)</td><td>0</td><td>2</td><td>1</td><td>1</td><td>8,11,13,17</td></tr><tr><td>Lysne et al. (2016)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>3,4,13</td></tr><tr><td>Panduman, Sukaridhoto & Tjahjono (2019)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Casale et al. (2016)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,16</td></tr><tr><td>Soldani, Tamburri & Van Den Heuvel (2018)</td><td>1</td><td>1</td><td>2</td><td>3</td><td>4,8,13,14,16–18</td></tr><tr><td>Almeida et al. (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Yousefpour et al. (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Trnka, Černý & Stickney (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Adedugbe et al. (2019)</td><td>1</td><td>1</td><td>2</td><td>0</td><td>3,8,13,14</td></tr><tr><td>Lichtenthäler et al. (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Mohsin & Janjua (2018)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,13,17</td></tr><tr><td>Noura, Atiquzzaman & Gaedke (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Rao et al. (2018)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Yang et al. (2014)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>3,11,13</td></tr><tr><td>Yu et al. (2019)</td><td>1</td><td>1</td><td>2</td><td>1</td><td>2,8,13,14,16</td></tr><tr><td>Casalicchio & Iannucci (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,5,11,13</td></tr><tr><td>Plaza, Daz & Pérez (2018)</td><td>0</td><td>0</td><td>0</td><td>1</td><td>17</td></tr><tr><td>Di Francesco, Malavolta & Lago (2017)</td><td>2</td><td>0</td><td>0</td><td>2</td><td>4,5,16,17</td></tr><tr><td>Islam, Manivannan & Zeadally (2016)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,4,5,8</td></tr><tr><td>Vale et al. (2019)</td><td>2</td><td>2</td><td>0</td><td>0</td><td>2,5,9,11</td></tr><tr><td>Bélair, Laniepce & Menaud (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Márquez & Astudillo (2019)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,4,13,14</td></tr><tr><td>Puliafito et al. (2019)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Manu et al. (2016)</td><td>0</td><td>2</td><td>1</td><td>1</td><td>8,11,13,17</td></tr><tr><td>Lysne et al. (2016)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>3,4,13</td></tr><tr><td>Panduman, Sukaridhoto & Tjahjono (2019)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Casale et al. (2016)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,16</td></tr><tr><td>Soldani, Tamburri & Van Den Heuvel (2018)</td><td>1</td><td>1</td><td>2</td><td>3</td><td>4,8,13,14,16,17,18</td></tr><tr><td>Almeida et al. (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Yousefpour et al. (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Sultan, Ahmad & Dimitriou (2019)</td><td>3</td><td>2</td><td>2</td><td>1</td><td>2,4,5,8,11,13,14,16</td></tr></tbody></table>
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Ahmed et al. (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>8,13</td></tr><tr><td>Trnka, Černý & Stickney (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Cerny & Donahoo (2016)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Ahmadvand et al. (2018)</td><td>2</td><td>7</td><td>3</td><td>3</td><td>2,3,6–18</td></tr><tr><td>Adedugbe et al. (2019)</td><td>1</td><td>1</td><td>2</td><td>0</td><td>3,8,13,14</td></tr><tr><td>Lichtenthäler et al. (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Mohsin & Janjua (2018)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,13,17</td></tr><tr><td>Niazi, Mishra & Gill (2018)</td><td>0</td><td>0</td><td>0</td><td>0</td><td></td></tr><tr><td>Noura, Atiquzzaman & Gaedke (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Rao et al. (2018)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Yang et al. (2014)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>3,11,13</td></tr><tr><td>Yu et al. (2019)</td><td>1</td><td>1</td><td>2</td><td>1</td><td>2,8,13,14,16</td></tr><tr><td>Casalicchio & Iannucci (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,5,11,13</td></tr><tr><td>Plaza, Daz & Pérez (2018)</td><td>0</td><td>0</td><td>0</td><td>1</td><td>17</td></tr><tr><td>Di Francesco, Malavolta & Lago (2017)</td><td>2</td><td>0</td><td>0</td><td>2</td><td>4,5,16,17</td></tr><tr><td>Westerlund & Kratzke (2018)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,15,16</td></tr><tr><td>Islam, Manivannan & Zeadally (2016)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,4,5,8</td></tr><tr><td>Vale et al. (2019)</td><td>2</td><td>2</td><td>0</td><td>0</td><td>2,5,9,11</td></tr><tr><td>Lie, Sánchez-Gordón & Colomo-Palacios (2020)</td><td>2</td><td>1</td><td>0</td><td>3</td><td>3,4,11,16,17,20</td></tr><tr><td>Ali, Caprolu & Pietro (2020)</td><td>4</td><td>0</td><td>0</td><td>0</td><td>2,3,4,5</td></tr><tr><td>de Sousa et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>2</td><td>2,3,11,13,16,19</td></tr><tr><td>Adam & Alam (2020)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,5</td></tr><tr><td>Delicato et al. (2020)</td><td>3</td><td>0</td><td>0</td><td>0</td><td>2,4,5</td></tr><tr><td>Mohamed, Challenger & Kardas (2020)</td><td>2</td><td>0</td><td>0</td><td>1</td><td>2,4,18</td></tr><tr><td>Waseem, Liang & Shahin (2020)</td><td>2</td><td>1</td><td>2</td><td>4</td><td>2,4,11,13,14,16–19</td></tr><tr><td>Mishra & Otaiwi (2020)</td><td>1</td><td>1</td><td>1</td><td>2</td><td>2,11,13,16,17</td></tr><tr><td>Niknejad et al. (2020)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Moura & Hutchison (2020)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,4</td></tr><tr><td>de Araujo Zanella, da Silva & Albini (2020)</td><td>4</td><td>2</td><td>0</td><td>0</td><td>2,3,4,5,6,7</td></tr><tr><td>Mohamed, Challenger & Kardas (2020)</td><td>2</td><td>0</td><td>0</td><td>1</td><td>2,4,18</td></tr><tr><td>Razzaq (2020)</td><td>2</td><td>1</td><td>3</td><td>4</td><td>2,3,11,13–19</td></tr><tr><td>Wu et al. (2019)</td><td>1</td><td>2</td><td>0</td><td>0</td><td>2,6,11</td></tr></tbody></table>

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Applicative Publications</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>George & Mahmoud (2017)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,5,13</td></tr><tr><td>Thramboulidis, Vachtsevanou & Kontou (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>5,8,13</td></tr><tr><td>Ciavotta et al. (2017)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,13,17</td></tr><tr><td>Morris (2017)</td><td>2</td><td>2</td><td>1</td><td>0</td><td>3,5,8,11,13</td></tr><tr><td>Fetzer et al. (2017)</td><td>2</td><td>3</td><td>2</td><td>1</td><td>2,3,6–8,13,14,16</td></tr></tbody></table>

(Continued)
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Jita & Pieterse (2018)</td><td>1</td><td>0</td><td>2</td><td>0</td><td>2,13,14</td></tr><tr><td>Perrone & Romano (2017)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,17</td></tr><tr><td>Pahl & Aubet (2018)</td><td>1</td><td>0</td><td>2</td><td>0</td><td>3,13,14</td></tr><tr><td>Sialm & Knittl (2016)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Du, Xie & He (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>3,8,13</td></tr><tr><td>Kalske, Mäkitalo & Mikkonen (2017)</td><td>1</td><td>1</td><td>2</td><td>1</td><td>2,8,13,14,16</td></tr><tr><td>Nehme et al. (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,8,13</td></tr><tr><td>Nikoloudakis et al. (2019)</td><td>0</td><td>2</td><td>1</td><td>0</td><td>8,11,13</td></tr><tr><td>Salomoni et al. (2018)</td><td>0</td><td>0</td><td>2</td><td>1</td><td>13,14,16</td></tr><tr><td>Stallenberg & Panichella (2019)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,5,7</td></tr><tr><td>Morris (2017)</td><td>2</td><td>2</td><td>1</td><td>0</td><td>3,5,8,11,13</td></tr><tr><td>Fetzer et al. (2017)</td><td>2</td><td>3</td><td>2</td><td>1</td><td>2,3,6,7,8,13,14,16</td></tr><tr><td>Jita & Pieterse (2018)</td><td>1</td><td>0</td><td>2</td><td>0</td><td>2,13,14</td></tr><tr><td>Perrone & Romano (2017)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,17</td></tr><tr><td>Pahl & Aubet (2018)</td><td>1</td><td>0</td><td>2</td><td>0</td><td>3,13,14</td></tr><tr><td>Sialm & Knittl (2016)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Cerny & Donahoo (2016)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Du, Xie & He (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>3,8,13</td></tr><tr><td>Kalske, Mäkitalo & Mikkonen (2017)</td><td>1</td><td>1</td><td>2</td><td>1</td><td>2,8,13,14,16</td></tr><tr><td>Nehme et al. (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,8,13</td></tr><tr><td>Nikoloudakis et al. (2019)</td><td>0</td><td>2</td><td>1</td><td>0</td><td>8,11,13</td></tr><tr><td>Salomoni et al. (2018)</td><td>0</td><td>0</td><td>2</td><td>1</td><td>13,14,16</td></tr><tr><td>Stallenberg & Panichella (2019)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,5,7</td></tr><tr><td>Park & Jeon (2020)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,11,13</td></tr><tr><td>Xu & Bian (2020)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,13,16</td></tr><tr><td>Brondolin & Santambrogio (2020)</td><td>1</td><td>2</td><td>1</td><td>0</td><td>2,6,11,13</td></tr><tr><td>Ma et al. (2020)</td><td>1</td><td>1</td><td>0</td><td>1</td><td>3,7,16</td></tr><tr><td>Olsthorn, van Deursen & Panichella (2020)</td><td>1</td><td>1</td><td>0</td><td>1</td><td>3,7,16</td></tr><tr><td>Chen, Chen & Yu (2020)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,3,11</td></tr><tr><td>Zuo et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,3,11,13</td></tr><tr><td>Luntovsky & Shubyn (2020)</td><td>1</td><td>3</td><td>1</td><td>2</td><td>2,6,7,11,13,16,19</td></tr><tr><td>Ghuge et al. (2020)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,11</td></tr><tr><td>Bobel, Gerostathopoulos & Bures (2020)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Zhang et al. (2020)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Hang, Ullah & Kim (2020)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,11</td></tr><tr><td>Forti, Ferrari & Brogi (2020)</td><td>3</td><td>3</td><td>1</td><td>0</td><td>2,3,4,6,7,11,13</td></tr><tr><td>Stock, Schel & Bauernhansl (2020)</td><td>2</td><td>0</td><td>0</td><td>1</td><td>2,4,18</td></tr><tr><td>Hasan & Starly (2020)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Kallergis et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,4,11,13</td></tr><tr><td>Amir-Mohammadian & Kari (2020)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,4,11</td></tr></tbody></table>
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Roca et al. (2020)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,4,11,13</td></tr><tr><td>Bromberg & Gitzinger (2020)</td><td>2</td><td>4</td><td>1</td><td>2</td><td>2,3,6–8,11,13,16,18</td></tr><tr><td>Jaworski, Karwowski & Rusek (2019)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,4,11,13</td></tr></tbody></table>

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td colspan="6"><strong>Theoretical Publications (1/3)</strong></td></tr><tr><td>ShuLin & JiePing (2020)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,4,11,13</td></tr><tr><td>Dilshan et al. (2020)</td><td>4</td><td>1</td><td>1</td><td>0</td><td>2,3,4,5,11,13</td></tr><tr><td>Flora (2020)</td><td>3</td><td>3</td><td>1</td><td>0</td><td>2,3,4,6,7,11,13</td></tr><tr><td>Flora, Gonçalves & Antunes (2020)</td><td>3</td><td>3</td><td>0</td><td>0</td><td>2,3,4,6,7,11</td></tr><tr><td>Bogatinovski et al. (2020)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,4</td></tr><tr><td>Damis et al. (2020)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,11</td></tr><tr><td>Iraqi & El Bakkali (2020)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,4,11,13</td></tr><tr><td>Dewanta (2020)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,4,11,13</td></tr><tr><td>Bumblauskas et al. (2020)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Giaimo, Andrade & Berger (2020)</td><td>2</td><td>0</td><td>0</td><td>2</td><td>2,4,16,17</td></tr><tr><td>Lenarduzzi et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>2</td><td>2,4,11,13,16,17</td></tr><tr><td>Mann (2020)</td><td>3</td><td>1</td><td>0</td><td>1</td><td>2,3,4,9,16</td></tr><tr><td>Costa, Pires & Delicato (2020)</td><td>0</td><td>1</td><td>1</td><td>3</td><td>11,13,16,17,18</td></tr><tr><td>Fahmideh & Zowghi (2020)</td><td>1</td><td>0</td><td>0</td><td>2</td><td>2,18,19</td></tr><tr><td>Razian, Fathian & Buyya (2020)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Taherizadeh & Grobelnik (2020)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Safaryan et al. (2020)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,4,11</td></tr><tr><td>de Toledo, Martini & Sjøberg (2020)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,13,16</td></tr><tr><td>Alulema et al. (2020)</td><td>0</td><td>1</td><td>1</td><td>3</td><td>11,13,16,17,19</td></tr><tr><td>Kapferer & Zimmermann (2020)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,19</td></tr><tr><td>Redelinghuys, Basson & Kruger (2019)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,3,11</td></tr><tr><td>Dash et al. (2020)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,3,11</td></tr><tr><td>Kwon et al. (2020)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,11</td></tr><tr><td>Khan & Shameem (2020)</td><td>1</td><td>1</td><td>1</td><td>3</td><td>2,11,13,16,17,18</td></tr><tr><td>DesLauriers et al. (2020)</td><td>1</td><td>1</td><td>1</td><td>2</td><td>2,11,13,16,17</td></tr><tr><td>Bertolino et al. (2020)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,13,16</td></tr><tr><td>Di Sanzo, Avresky & Pellegrini (2021)</td><td>2</td><td>1</td><td>0</td><td>1</td><td>2,4,11,16</td></tr><tr><td>Moreira et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>2</td><td>2,4,11,13,16,17</td></tr><tr><td>Li et al. (2019b)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,3,11,13</td></tr></tbody></table><table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td colspan="6"><strong>Theoretical Publications (2/3)</strong></td></tr><tr><td>Callegati et al. (2016)</td><td>2</td><td>4</td><td>1</td><td>0</td><td>3,4,6,7,8,11,13</td></tr></tbody></table>

(Continued)
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Preuveneers &amp; Joosen (2019)</td><td>1</td><td>0</td><td>2</td><td>1</td><td>5,13,14,16</td></tr><tr><td>Abidi et al. (2019)</td><td>3</td><td>1</td><td>2</td><td>0</td><td>3,4,5,8,13,14</td></tr><tr><td>Baboi, Iftene &amp; Gfu (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>He &amp; Yang (2017)</td><td>1</td><td>1</td><td>0</td><td>1</td><td>3,11,16</td></tr><tr><td>Sim, Barus &amp; Jaya (2019)</td><td>0</td><td>1</td><td>0</td><td>0</td><td>11</td></tr><tr><td>Brito et al. (2019)</td><td>1</td><td>3</td><td>1</td><td>0</td><td>4,8,11,12,13</td></tr><tr><td>Niazi, Mishra &amp; Gill (2018)</td><td>0</td><td>0</td><td>0</td><td>1</td><td>17</td></tr><tr><td>Lu et al. (2017)</td><td>3</td><td>0</td><td>2</td><td>0</td><td>2,3,5,13,15</td></tr><tr><td>Beekman & Porter (2017)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,5,13</td></tr><tr><td>Syed & Fernandez (2017)</td><td>3</td><td>0</td><td>2</td><td>0</td><td>2,4,5,13,15</td></tr><tr><td>Syed & Fernandez (2018)</td><td>2</td><td>0</td><td>3</td><td>1</td><td>2,4,13-16</td></tr><tr><td>Bhattacharya (2019)</td><td>0</td><td>3</td><td>1</td><td>0</td><td>6,7,8,13</td></tr><tr><td>Zhang et al. (2017)</td><td>0</td><td>2</td><td>3</td><td>0</td><td>6,7,13-15</td></tr><tr><td>Zaheer et al. (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Walsh & Manferdelli (2017)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Torkura, Sukmana & Meinel (2017)</td><td>1</td><td>2</td><td>2</td><td>2</td><td>2,6,11,13,14,16,17</td></tr><tr><td>Clancy, McGwier & Chen (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Cerny, Sedlisky & Donahoo (2018)</td><td>0</td><td>0</td><td>2</td><td>2</td><td>13,14,18,19</td></tr><tr><td>Tourani et al. (2019)</td><td>1</td><td>3</td><td>3</td><td>0</td><td>3,6,7,8,13-15</td></tr><tr><td>Chen, Huang & Chen (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>5,8,13</td></tr><tr><td>Anisetti et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>15,16,17</td></tr><tr><td>Leite et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>2</td><td>13,14,16,17</td></tr><tr><td>Suneja, Kanso & Isci (2019)</td><td>0</td><td>2</td><td>1</td><td>0</td><td>8,11,13</td></tr><tr><td>Schlossnagle (2018)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Schlossnagle (2017)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Guija & Siddiqui (2018)</td><td>4</td><td>0</td><td>1</td><td>0</td><td>2,3,4,5,13</td></tr><tr><td>Esparrachiari, Reilly & Rentz (2018)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,5</td></tr><tr><td>Gupta, Venkatachalapathy & Jeberla (2019)</td><td>0</td><td>0</td><td>0</td><td>2</td><td>16,17</td></tr><tr><td>Troiano et al. (2019)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,3,13,14</td></tr><tr><td>Tchoubraev & Wiczynski (2015)</td><td>0</td><td>1</td><td>0</td><td>0</td><td>11</td></tr><tr><td>Sun, Nanda & Jaeger (2015)</td><td>2</td><td>5</td><td>2</td><td>0</td><td>3,5-8,10,11,13,14</td></tr><tr><td>Thanh et al. (2016)</td><td>2</td><td>3</td><td>1</td><td>2</td><td>2,5,6,7,8,13,16,17</td></tr><tr><td>Ahmadvand & Ibrahim (2016)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Kelbert et al. (2017)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Esposito et al. (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Torkura et al. (2017)</td><td>2</td><td>3</td><td>1</td><td>2</td><td>4,5,8,11,12,14,16,17</td></tr><tr><td>Yarygina & Bagge (2018)</td><td>1</td><td>0</td><td>1</td><td>2</td><td>4,13,17,18</td></tr><tr><td>Trihinas et al. (2018)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,16</td></tr><tr><td>Bánáti et al. (2018)</td><td>3</td><td>0</td><td>2</td><td>0</td><td>2,3,5,13,14</td></tr><tr><td>Pahl, Aubet & Liebald (2018)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr></tbody></table>
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Diekmann et al. (2018)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,17</td></tr><tr><td>Trihinas, Tryfonos & Dikaiakos (2016)</td><td>0</td><td>0</td><td>2</td><td>1</td><td>13,14,16</td></tr><tr><td>Nehme et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Torkura, Sukmana & Kayem (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Gerking & Schubert (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Bogner et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>4</td><td>13,16–19</td></tr><tr><td>Petrovska, Memeti & Imeri (2019)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,5,14</td></tr><tr><td>Osman et al. (2019)</td><td>1</td><td>2</td><td>2</td><td>0</td><td>5,6,7,13,14</td></tr><tr><td>Chen (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Wu et al. (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,11,14</td></tr><tr><td>Li et al. (2019b)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Mansfield-Devine (2018)</td><td>1</td><td>1</td><td>1</td><td>1</td><td>4,8,13,16</td></tr><tr><td>Trubiani et al. (2018)</td><td>3</td><td>1</td><td>0</td><td>1</td><td>2,4,5,8,16</td></tr><tr><td>Krämer, Frese & Kuijper (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Varghese & Buyya (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Elsayed & Zulkernine (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Reyna et al. (2018)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Vaquero et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Kochovski et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Lwakatare et al. (2019)</td><td>0</td><td>2</td><td>0</td><td>2</td><td>8,11,16,17</td></tr><tr><td>Avritzer et al. (2020)</td><td>1</td><td>2</td><td>0</td><td>0</td><td>2,6,8</td></tr><tr><td>Nagothu et al. (2018)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Baker & Nguyen (2019)</td><td>3</td><td>2</td><td>0</td><td>0</td><td>2,4,5,9,11</td></tr><tr><td>Buzachis & Villari (2018)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Yuan et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Preuveneers & Joosen (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Taha, Talhi & Ould-Slimanec (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,8,13</td></tr><tr><td>De Donno et al. (2019)</td><td>1</td><td>3</td><td>2</td><td>0</td><td>2,8,9,11,13,14</td></tr><tr><td>Ghayyur et al. (2018)</td><td>0</td><td>2</td><td>1</td><td>0</td><td>8,11,13</td></tr><tr><td>Xu, Jin & Kim (2019)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,3,8,13</td></tr><tr><td>Zhiyi, Shahidehpour & Xuan (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Zimmermann (2017b)</td><td>0</td><td>1</td><td>1</td><td>3</td><td>11,13,16–18</td></tr><tr><td>Tien et al. (2019)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,5,6</td></tr><tr><td>Oppermann et al. (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Brucker et al. (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Krishnan, Duttagupta & Achuthan (2019)</td><td>2</td><td>0</td><td>2</td><td>1</td><td>2,5,13,14,17</td></tr><tr><td>Salibindla (2018)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Nguyen & Baker (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Pustchi, Krishnan & Sandhu (2015)</td><td>4</td><td>1</td><td>2</td><td>0</td><td>2–6,13,15</td></tr><tr><td>Westerlund & Kratzke (2018)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,15,16</td></tr></tbody></table>

(Continued)
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Garg & Garg (2019)</td><td>1</td><td>1</td><td>0</td><td>2</td><td>5,11,16,17</td></tr><tr><td>Souppaya, Morello & Scarfone (2017)</td><td>3</td><td>3</td><td>1</td><td>2</td><td>2,4,5,8,10,11,13,16,17</td></tr><tr><td>Brenner et al. (2017)</td><td>0</td><td>1</td><td>0</td><td>0</td><td>11</td></tr><tr><td>Vassilakis, Panaousis & Mouratidis (2016)</td><td>0</td><td>0</td><td>0</td><td>0</td><td></td></tr><tr><td>Yarygina (2018)</td><td>1</td><td>3</td><td>2</td><td>2</td><td>2,6,8,11,13,14,16,17</td></tr><tr><td>Bozan, Lyytinen & Rose (2020)</td><td>1</td><td>0</td><td>1</td><td>2</td><td>2,13,16,17</td></tr><tr><td>Cleveland et al. (2020)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Reed (2020)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Baarzi et al. (2020)</td><td>3</td><td>3</td><td>1</td><td>0</td><td>2–6,7,11,13</td></tr><tr><td>Li et al. (2020)</td><td>1</td><td>1</td><td>1</td><td>2</td><td>2,11,13,16,17</td></tr><tr><td>Sundelin, Gonzalez-Huerta & Wnuk (2020)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Sharma, Lawrenz & Rausch (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,5,11,13</td></tr><tr><td>Walker & Cerny (2020)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,11,13</td></tr><tr><td>Leite et al. (2020)</td><td>1</td><td>1</td><td>1</td><td>2</td><td>2,11,13,16,17</td></tr><tr><td>Russinovich et al. (2021)</td><td>3</td><td>1</td><td>1</td><td>3</td><td>2,3,4,11,13,16–18</td></tr><tr><td>Mohammed & Mohammed (2020)</td><td>4</td><td>2</td><td>0</td><td>0</td><td>2,3,4,5,6,7</td></tr><tr><td>de Oliveira Rosa et al. (2020)</td><td>0</td><td>1</td><td>2</td><td>2</td><td>11,13,14,16,17</td></tr><tr><td>Ke, Wu & Yang (2020)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,4</td></tr><tr><td>Tuma et al. (2020)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,6</td></tr><tr><td>Wieber (2020)</td><td>3</td><td>1</td><td>1</td><td>3</td><td>2–4,11,13,16–18</td></tr><tr><td>Hajek et al. (2020)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,4,11,13</td></tr><tr><td>Chondamrongkul, Sun & Warren (2020)</td><td>4</td><td>1</td><td>1</td><td>0</td><td>2,3,4,5,11,13</td></tr><tr><td>Liang & Zhao (2020)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,11</td></tr><tr><td>Liu et al. (2020)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Gorige et al. (2020)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,4,11,13</td></tr><tr><td>Cerny et al. (2020)</td><td>1</td><td>1</td><td>1</td><td>1</td><td>2,11,13,18</td></tr><tr><td>Tenev & Tsvetanov (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,4,11,13</td></tr><tr><td>Jin et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,4,11,13</td></tr><tr><td>Wang et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,4,11,13</td></tr></tbody></table>

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td colspan="6">Theoretical Publications (3/3)</td></tr><tr><td>Badii et al. (2019)</td><td>2</td><td>2</td><td>1</td><td>0</td><td>3,5,11–13</td></tr><tr><td>Yang et al. (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Kang et al. (2018)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Casale et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>3</td><td>13,14,16–18</td></tr><tr><td>Di Ciccio et al. (2019)</td><td>0</td><td>2</td><td>1</td><td>1</td><td>9,10,14,19</td></tr><tr><td>Kathiravelu, Van Roy & Veiga (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Łaskawiec, Choraś & Kozik (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Leite et al. (2017)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr></tbody></table>
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Redelinghuys, Basson & Kruger (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>3,8,13</td></tr><tr><td>Brambilla, Umuhoza & Acerbis (2017)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,19</td></tr><tr><td>Shahin et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Zimmermann (2017a)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Zimmermann (2017b)</td><td>0</td><td>1</td><td>1</td><td>3</td><td>11,13,16–18</td></tr><tr><td>Tien et al. (2019)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,5,6</td></tr><tr><td>Oppermann et al. (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Brucker et al. (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Krishnan, Duttagupta & Achuthan (2019)</td><td>2</td><td>0</td><td>2</td><td>1</td><td>2,5,13,14,17</td></tr><tr><td>Salibindla (2018)</td><td>1</td><td>0</td><td>0</td><td>0</td><td>2</td></tr><tr><td>Nguyen & Baker (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Pustchi, Krishnan & Sandhu (2015)</td><td>4</td><td>1</td><td>2</td><td>0</td><td>2–6,13,15</td></tr><tr><td>Garg & Garg (2019)</td><td>1</td><td>1</td><td>0</td><td>2</td><td>5,11,16,17</td></tr><tr><td>Souppaya, Morello & Scarfone (2017)</td><td>3</td><td>3</td><td>1</td><td>2</td><td>2,4,5,8,10,11,13,16,17</td></tr><tr><td>Brenner et al. (2017)</td><td>0</td><td>1</td><td>0</td><td>0</td><td>11</td></tr><tr><td>Vassilakis, Panaousis & Mouratidis (2016)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,4</td></tr><tr><td>Yarygina (2018)</td><td>1</td><td>3</td><td>2</td><td>2</td><td>2,6,8,11,13,14,16,17</td></tr><tr><td>Beekman & Porter (2017)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,5,13</td></tr><tr><td>Syed & Fernandez (2017)</td><td>3</td><td>0</td><td>2</td><td>0</td><td>2,4,5,13,15</td></tr><tr><td>Syed & Fernandez (2018)</td><td>2</td><td>0</td><td>3</td><td>1</td><td>2,4,13,14,15,16</td></tr><tr><td>Bhattacharya (2019)</td><td>0</td><td>3</td><td>1</td><td>0</td><td>6,7,8,13</td></tr><tr><td>Zhang et al. (2017)</td><td>0</td><td>2</td><td>3</td><td>0</td><td>6,7,13,14,15</td></tr><tr><td>Zaheer et al. (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Walsh & Manferdelli (2017)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Torkura, Sukmana & Meinel (2017)</td><td>1</td><td>2</td><td>2</td><td>2</td><td>2,6,11,13,14,16,17</td></tr><tr><td>Clancy, McGwier & Chen (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Cerny, Sedlisky & Donahoo (2018)</td><td>0</td><td>0</td><td>2</td><td>2</td><td>13,14,18,19</td></tr><tr><td>Tourani et al. (2019)</td><td>1</td><td>3</td><td>3</td><td>0</td><td>3,6,7,8,13,14,15</td></tr><tr><td>Chen, Huang & Chen (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>5,8,13</td></tr><tr><td>Anisetti et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>15,16,17</td></tr><tr><td>Leite et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>2</td><td>13,14,16,17</td></tr><tr><td>Suneja, Kanso & Isci (2019)</td><td>0</td><td>2</td><td>1</td><td>0</td><td>8,11,13</td></tr><tr><td>Schlossnagle (2018)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Schlossnagle (2017)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Guija & Siddiqui (2018)</td><td>4</td><td>0</td><td>1</td><td>0</td><td>2,3,4,5,13</td></tr><tr><td>Esparrachiari, Reilly & Rentz (2018)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,5</td></tr><tr><td>Gupta, Venkatachalapathy & Jeberla (2019)</td><td>0</td><td>0</td><td>0</td><td>2</td><td>16,17</td></tr><tr><td>Troiano et al. (2019)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,3,13,14</td></tr><tr><td>Tchoubraev & Wiczynski (2015)</td><td>0</td><td>1</td><td>0</td><td>0</td><td>11</td></tr><tr><td>Sun, Nanda & Jaeger (2015)</td><td>2</td><td>5</td><td>2</td><td>0</td><td>3,5,6,7,8,10,11,13,14</td></tr></tbody></table>

(Continued)
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Callegati et al. (2016)</td><td>2</td><td>4</td><td>1</td><td>0</td><td>3,4,6,7,8,11,13</td></tr><tr><td>Thanh et al. (2016)</td><td>2</td><td>3</td><td>1</td><td>2</td><td>2,5,6,7,8,13,16,17</td></tr><tr><td>Ahmadvand & Ibrahim (2016)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Kelbert et al. (2017)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>George & Mahmoud (2017)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,5,13</td></tr><tr><td>Esposito et al. (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Torkura et al. (2017)</td><td>2</td><td>3</td><td>1</td><td>2</td><td>4,5,8,11,12,14,16,17</td></tr><tr><td>Yarygina & Bagge (2018)</td><td>1</td><td>0</td><td>1</td><td>2</td><td>4,13,17,18</td></tr><tr><td>Trihinas et al. (2018)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,16</td></tr><tr><td>Bánáti et al. (2018)</td><td>3</td><td>0</td><td>2</td><td>0</td><td>2,3,5,13,14</td></tr><tr><td>Pahl, Aubet & Liebald (2018)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Diekmann et al. (2018)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,17</td></tr><tr><td>Trihinas, Tryfonos & Dikaiakos (2016)</td><td>0</td><td>0</td><td>2</td><td>1</td><td>13,14,16</td></tr><tr><td>Nehme et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Torkura, Sukmana & Kayem (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Gerking & Schubert (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Bogner et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>4</td><td>13,16,17,18,19</td></tr><tr><td>Petrovska, Memeti & Imeri (2019)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,5,14</td></tr><tr><td>Osman et al. (2019)</td><td>1</td><td>2</td><td>2</td><td>0</td><td>5,6,7,13,14</td></tr><tr><td>Preuveneers & Joosen (2019)</td><td>1</td><td>0</td><td>2</td><td>1</td><td>5,13,14,16</td></tr><tr><td>Chen (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Wu et al. (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,11,14</td></tr><tr><td>Li et al. (2019b)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Ruan et al. (2019)</td><td>0</td><td>0</td><td>0</td><td>0</td><td></td></tr><tr><td>Mansfield-Devine (2018)</td><td>1</td><td>1</td><td>1</td><td>1</td><td>4,8,13,16</td></tr><tr><td>Baboi, Iftene & Gfu (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Trubiani et al. (2018)</td><td>3</td><td>1</td><td>0</td><td>1</td><td>2,4,5,8,16</td></tr><tr><td>Krämer, Frese & Kuijper (2019)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr><tr><td>Varghese & Buyya (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Elsayed & Zulkernine (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Reyna et al. (2018)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>2,13</td></tr><tr><td>Vaquero et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Kochovski et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Lwakatare et al. (2019)</td><td>0</td><td>2</td><td>0</td><td>2</td><td>8,11,16,17</td></tr><tr><td>Avritzer et al. (2020)</td><td>1</td><td>2</td><td>0</td><td>0</td><td>2,6,8</td></tr><tr><td>Nagothu et al. (2018)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Baker & Nguyen (2019)</td><td>3</td><td>2</td><td>0</td><td>0</td><td>2,4,5,9,11</td></tr><tr><td>Buzachis & Villari (2018)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,11</td></tr><tr><td>Yuan et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Preuveneers & Joosen (2017)</td><td>1</td><td>0</td><td>1</td><td>0</td><td>5,13</td></tr></tbody></table>
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Taha, Talhi & Ould-Slimanec (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,8,13</td></tr><tr><td>He & Yang (2017)</td><td>1</td><td>1</td><td>0</td><td>1</td><td>3,11,16</td></tr><tr><td>Sultan, Ahmad & Dimitriou (2019)</td><td>3</td><td>2</td><td>2</td><td>1</td><td>2,4,5,8,11,13,14,16</td></tr><tr><td>De Donno et al. (2019)</td><td>1</td><td>3</td><td>2</td><td>0</td><td>2,8,9,11,13,14</td></tr><tr><td>Ghayyur et al. (2018)</td><td>0</td><td>2</td><td>1</td><td>0</td><td>8,11,13</td></tr><tr><td>Zhiyi, Shahidehpour & Xuan (2018)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Sim, Barus & Jaya (2019)</td><td>0</td><td>0</td><td>0</td><td>0</td><td></td></tr><tr><td>Xu, Jin & Kim (2019)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,3,8,13</td></tr><tr><td>Badii et al. (2019)</td><td>2</td><td>2</td><td>1</td><td>0</td><td>3,5,11,12,13</td></tr><tr><td>Yang et al. (2018)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>4,8,13</td></tr><tr><td>Di Salle, Gallo & Pompilio (2016)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,16</td></tr><tr><td>Kang et al. (2018)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Brito et al. (2019)</td><td>1</td><td>3</td><td>1</td><td>0</td><td>4,8,11,12,13</td></tr><tr><td>Casale et al. (2019)</td><td>0</td><td>0</td><td>2</td><td>3</td><td>13,14,16,17,18</td></tr><tr><td>Di Ciccio et al. (2019)</td><td>0</td><td>2</td><td>1</td><td>1</td><td>9,10,14,19</td></tr><tr><td>Kathiravelu, Van Roy & Veiga (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Łaskawiec, Choraś & Kozik (2019)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Leite et al. (2017)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Redelinghuys, Basson & Kruger (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>3,8,13</td></tr><tr><td>Brambilla, Umuhoza & Acerbis (2017)</td><td>0</td><td>0</td><td>1</td><td>1</td><td>13,19</td></tr><tr><td>Shahin et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>2</td><td>13,16,17</td></tr><tr><td>Zimmermann (2017a)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Zdun, Wittern & Leitner (2019)</td><td>0</td><td>1</td><td>1</td><td>2</td><td>11,13,16,19</td></tr></tbody></table>

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td colspan="6">Theoretical and Applicative Publications</td></tr><tr><td>Ahmadvand et al. (2018)</td><td>2</td><td>7</td><td>3</td><td>3</td><td>2,3,6–18</td></tr><tr><td>Forti, Ferrari & Brogi (2020)</td><td>0</td><td>0</td><td>2</td><td>0</td><td>13,14</td></tr><tr><td>Díaz-Sánchez et al. (2019)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>4,5,11,13</td></tr><tr><td>Han et al. (2019)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,5,9,13</td></tr><tr><td>Paladi, Michalas & Dang (2018)</td><td>2</td><td>4</td><td>2</td><td>1</td><td>2,4,6,8,9,12,13,14,17</td></tr><tr><td>Stocker et al. (2018)</td><td>2</td><td>2</td><td>1</td><td>0</td><td>2,5,8,12,13</td></tr><tr><td>Andersen et al. (2018)</td><td>3</td><td>2</td><td>2</td><td>0</td><td>2,3,4,8,11,13,14</td></tr><tr><td>Andersen et al. (2018)</td><td>3</td><td>2</td><td>2</td><td>0</td><td>2,3,4,8,11,13,14</td></tr><tr><td>Li et al. (2018)</td><td>4</td><td>5</td><td>3</td><td>2</td><td>2–9,11,13–15,18,19</td></tr><tr><td>Akkermans et al. (2018)</td><td>1</td><td>3</td><td>2</td><td>0</td><td>3,6,7,9,13,14</td></tr><tr><td>Nikouei et al. (2019)</td><td>1</td><td>1</td><td>2</td><td>0</td><td>5,8,13,14</td></tr><tr><td>Nagendra et al. (2019)</td><td>4</td><td>1</td><td>1</td><td>0</td><td>2–6,13</td></tr><tr><td>Wang et al. (2018)</td><td>2</td><td>0</td><td>0</td><td>1</td><td>2,3,16</td></tr><tr><td>Basso et al. (2017)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,9,13</td></tr></tbody></table>

(Continued)
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Marchal, Cholez & Festor (2018)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,3,13,14</td></tr><tr><td>Demoulin et al. (2018)</td><td>3</td><td>0</td><td>0</td><td>0</td><td>2,3,5</td></tr><tr><td>Pahl & Donini (2018)</td><td>1</td><td>0</td><td>2</td><td>1</td><td>5,13,14,20</td></tr><tr><td>Kang, Shin & Kim (2019)</td><td>2</td><td>1</td><td>2</td><td>1</td><td>3,4,8,13,14,17</td></tr><tr><td>Osman, Hanisch & Strufe (2019)</td><td>0</td><td>0</td><td>0</td><td>1</td><td>17</td></tr><tr><td>Xu et al. (2019)</td><td>2</td><td>1</td><td>1</td><td>1</td><td>2,3,11,13,18</td></tr><tr><td>da Silva, de Oliveira Silva & Brito (2019)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,4,9</td></tr><tr><td>Jin et al. (2019)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,12</td></tr><tr><td>Wen et al. (2019)</td><td>2</td><td>2</td><td>0</td><td>0</td><td>3,4,8,12</td></tr><tr><td>Callegati et al. (2018)</td><td>3</td><td>1</td><td>2</td><td>0</td><td>2,4,5,8,13,14</td></tr><tr><td>Jander, Braubach & Pokahr (2018)</td><td>2</td><td>1</td><td>1</td><td>2</td><td>2,3,11,13,16,20</td></tr><tr><td>Jander, Braubach & Pokahr (2019)</td><td>2</td><td>1</td><td>1</td><td>1</td><td>2,3,11,13,20</td></tr><tr><td>Surantha & Ivan (2019)</td><td>3</td><td>1</td><td>1</td><td>1</td><td>3–5,10,13,20</td></tr><tr><td>Hole (2016)</td><td>4</td><td>2</td><td>3</td><td>1</td><td>2,3,4,5,8,11,13–15,16</td></tr><tr><td>Ravichandran, Taylor & Waterhouse (2016)</td><td>4</td><td>1</td><td>2</td><td>2</td><td>2–5,8,13,14,16,17</td></tr><tr><td>Otterstad & Yarygina (2017)</td><td>2</td><td>3</td><td>2</td><td>1</td><td>2,3,6,7,8,13,14,17</td></tr><tr><td>Yarygina & Otterstad (2018)</td><td>1</td><td>3</td><td>2</td><td>0</td><td>3,6,7,8,13,14</td></tr><tr><td>Luo, Ren & Zhang (2018)</td><td>0</td><td>1</td><td>3</td><td>3</td><td>8,13–18</td></tr><tr><td>Camilli et al. (2017)</td><td>2</td><td>1</td><td>3</td><td>4</td><td>2,3,8,13–19</td></tr><tr><td>Nkomo & Coetzee (2019)</td><td>3</td><td>3</td><td>3</td><td>1</td><td>2,3,5,8,9,11,13–15,17</td></tr><tr><td>Beheshti et al. (2019)</td><td>0</td><td>1</td><td>2</td><td>0</td><td>9,13,14</td></tr><tr><td>Chidambaram et al. (2019)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>3,5,13</td></tr><tr><td>Jan et al. (2019)</td><td>1</td><td>3</td><td>1</td><td>0</td><td>5,6,7,8,14</td></tr><tr><td>Melis et al. (2018)</td><td>1</td><td>1</td><td>2</td><td>0</td><td>3,12,13,14</td></tr><tr><td>Paschke (2016)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,3,13,14</td></tr><tr><td>Prandi et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Ibrahim, Bozhinoski & Pretschner (2019)</td><td>3</td><td>0</td><td>1</td><td>2</td><td>2,3,4,13,16,17</td></tr><tr><td>Ranjbar et al. (2017)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,3,13</td></tr><tr><td>Han et al. (2019)</td><td>3</td><td>1</td><td>1</td><td>0</td><td>2,3,5,9,13</td></tr><tr><td>Paladi, Michalas & Dang (2018)</td><td>2</td><td>4</td><td>2</td><td>1</td><td>2,4,6,8,9,12–14,17</td></tr><tr><td>Stocker et al. (2018)</td><td>2</td><td>2</td><td>1</td><td>0</td><td>2,5,8,12,13</td></tr><tr><td>Andersen et al. (2018)</td><td>3</td><td>2</td><td>2</td><td>0</td><td>2,3,4,8,11,13,14</td></tr><tr><td>Li et al. (2018)</td><td>4</td><td>5</td><td>3</td><td>2</td><td>2–9,11,13–15,18,19</td></tr><tr><td>Akkermans et al. (2018)</td><td>1</td><td>3</td><td>2</td><td>0</td><td>3,6,7,9,13,14</td></tr><tr><td>Nikouei et al. (2019)</td><td>1</td><td>1</td><td>2</td><td>0</td><td>5,8,13,14</td></tr><tr><td>Nagendra et al. (2019)</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td></tr><tr><td>Wang et al. (2018)</td><td>2</td><td>0</td><td>0</td><td>1</td><td>2,3,16</td></tr><tr><td>Basso et al. (2017)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>2,9,13</td></tr><tr><td>Marchal, Cholez & Festor (2018)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,3,13,14</td></tr><tr><td>Demoulin et al. (2018)</td><td>3</td><td>0</td><td>0</td><td>0</td><td>2,3,5</td></tr></tbody></table>
(continued)

<table><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Pahl & Donini (2018)</td><td>1</td><td>0</td><td>2</td><td>1</td><td>5,13,14,20</td></tr><tr><td>Kang, Shin & Kim (2019)</td><td>2</td><td>1</td><td>2</td><td>1</td><td>3,4,8,13,14,17</td></tr><tr><td>Osman, Hanisch & Strufe (2019)</td><td>0</td><td>0</td><td>0</td><td>1</td><td>17</td></tr><tr><td>Xu et al. (2019)</td><td>2</td><td>1</td><td>1</td><td>1</td><td>2,3,11,13,18</td></tr><tr><td>da Silva, de Oliveira Silva & Brito (2019)</td><td>2</td><td>1</td><td>0</td><td>0</td><td>2,4,9</td></tr><tr><td>Jin et al. (2019)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,12</td></tr><tr><td>Wen et al. (2019)</td><td>2</td><td>2</td><td>0</td><td>0</td><td>3,4,8,12</td></tr><tr><td>Abidi et al. (2019)</td><td>3</td><td>1</td><td>2</td><td>0</td><td>3,4,5,8,13,14</td></tr><tr><td>Callegati et al. (2018)</td><td>3</td><td>1</td><td>2</td><td>0</td><td>2,4,5,8,13,14</td></tr><tr><td>Thramboulidis, Vachtsevanou & Kontou (2019)</td><td>1</td><td>1</td><td>1</td><td>0</td><td>5,8,13</td></tr><tr><td>Jander, Braubach & Pokahr (2018)</td><td>2</td><td>1</td><td>1</td><td>2</td><td>2,3,11,13,16,20</td></tr><tr><td>Jander, Braubach & Pokahr, 2019</td><td>2</td><td>1</td><td>1</td><td>1</td><td>2,3,11,13,20</td></tr><tr><td>Surantha & Ivan (2019)</td><td>3</td><td>1</td><td>1</td><td>1</td><td>3,4,5,10,13,20</td></tr><tr><td>Ciavotta et al. (2017)</td><td>0</td><td>1</td><td>1</td><td>1</td><td>11,13,17</td></tr><tr><td>Díaz-Sánchez et al. (2019)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>4,5,11,13</td></tr><tr><td>Hole (2016)</td><td>4</td><td>2</td><td>3</td><td>1</td><td>2–5,8,11,13–16</td></tr><tr><td>Ravichandran, Taylor & Waterhouse (2016)</td><td>4</td><td>1</td><td>2</td><td>2</td><td>2–5,8,13,14,16,17</td></tr><tr><td>Otterstad & Yarygina (2017)</td><td>2</td><td>3</td><td>2</td><td>1</td><td>2,3,6,7,8,13,14,17</td></tr><tr><td>Yarygina & Otterstad (2018)</td><td>1</td><td>3</td><td>2</td><td>0</td><td>3,6,7,8,13,14</td></tr><tr><td>Luo, Ren & Zhang (2018)</td><td>0</td><td>1</td><td>3</td><td>3</td><td>8,13,14,15,16,17,18</td></tr><tr><td>Camilli et al. (2017)</td><td>2</td><td>1</td><td>3</td><td>4</td><td>2,3,8,13,14,15,16,17,18,19</td></tr><tr><td>Ahmadvand et al. (2018)</td><td>2</td><td>7</td><td>3</td><td>3</td><td>2,3,6–18</td></tr><tr><td>Nkomo & Coetzee (2019)</td><td>3</td><td>3</td><td>3</td><td>1</td><td>2,3,5,8,9,11,13–15,17</td></tr><tr><td>Beheshti et al. (2019)</td><td>0</td><td>1</td><td>2</td><td>0</td><td>9,13,14</td></tr><tr><td>Chidambaram et al. (2019)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>3,5,13</td></tr><tr><td>Jan et al. (2019)</td><td>1</td><td>3</td><td>1</td><td>0</td><td>5,6,7,8,14</td></tr><tr><td>Melis et al. (2018)</td><td>1</td><td>1</td><td>2</td><td>0</td><td>3,12,13,14</td></tr><tr><td>Paschke (2016)</td><td>2</td><td>0</td><td>2</td><td>0</td><td>2,3,13,14</td></tr><tr><td>Prandi et al. (2019)</td><td>0</td><td>0</td><td>1</td><td>0</td><td>13</td></tr><tr><td>Ibrahim, Bozhinoski & Pretschner (2019)</td><td>3</td><td>0</td><td>1</td><td>2</td><td>2,3,4,13,16,17</td></tr><tr><td>Ranjbar et al. (2017)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>2,3,13</td></tr><tr><td>Ranawaka et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,3,11,13</td></tr><tr><td>Du et al. (2020)</td><td>2</td><td>1</td><td>2</td><td>0</td><td>2,3,11,13,15</td></tr><tr><td>Haque, Iwaya & Babar (2020)</td><td>4</td><td>1</td><td>1</td><td>2</td><td>2,3,4,5,11,13,16,17</td></tr><tr><td>Avritzer et al. (2020)</td><td>3</td><td>4</td><td>1</td><td>4</td><td>2–4,6,7,9,11,13,16–19</td></tr><tr><td>Alaluna et al. (2020)</td><td>3</td><td>1</td><td>0</td><td>0</td><td>2,3,4,11</td></tr><tr><td>Falah et al. (2020)</td><td>1</td><td>1</td><td>0</td><td>0</td><td>2,6</td></tr><tr><td>Truong & Klein (2020)</td><td>2</td><td>1</td><td>1</td><td>1</td><td>2,4,11,13,16</td></tr><tr><td>Nikolakis et al. (2020)</td><td>3</td><td>1</td><td>2</td><td>0</td><td>2,3,4,11,13,14</td></tr><tr><td>Kumar & Goyal (2020)</td><td>2</td><td>4</td><td>2</td><td>3</td><td>2,4,6,7,8,11,13,14,16,17,18</td></tr></tbody></table>

(Continued)
<table><caption>(continued)</caption><thead><tr><th rowspan="2">Ref.</th><th colspan="4">Group</th><th rowspan="2">Q. Num.</th></tr><tr><th>G1</th><th>G2</th><th>G3</th><th>G4</th></tr></thead><tbody><tr><td>Janjua et al. (2020)</td><td>3</td><td>1</td><td>1</td><td>1</td><td>2,3,4,11,13,20</td></tr><tr><td>Hahn, Davidson & Bardas (2020)</td><td>3</td><td>4</td><td>1</td><td>1</td><td>2,3,4,8,9,10,11,13,16</td></tr><tr><td>Cheruvu et al. (2020)</td><td>2</td><td>0</td><td>0</td><td>0</td><td>2,3</td></tr><tr><td>Lakhan & Li (2020)</td><td>0</td><td>1</td><td>1</td><td>0</td><td>11,13</td></tr><tr><td>Javed et al. (2020)</td><td>2</td><td>0</td><td>1</td><td>0</td><td>3,4,13</td></tr><tr><td>Lou et al. (2020)</td><td>4</td><td>4</td><td>0</td><td>0</td><td>2,3,4,5,6,7,10,11</td></tr><tr><td>Maati & Saidouni (2020)</td><td>4</td><td>0</td><td>0</td><td>0</td><td>2,3,4,5</td></tr><tr><td>Lu et al. (2021)</td><td>2</td><td>1</td><td>0</td><td>2</td><td>2,3,11,18,19</td></tr><tr><td>Copei, Wickert & Zündorf (2020)</td><td>3</td><td>1</td><td>1</td><td>1</td><td>2,4,5,11,13,20</td></tr><tr><td>Ranawaka et al. (2020)</td><td>2</td><td>1</td><td>1</td><td>0</td><td>2,3,11,13</td></tr></tbody></table>

## ADDITIONAL INFORMATION AND DECLARATIONS

### Funding

Fabrizio Montesi was supported by Villum Fonden, grant no. 29518, and by Independent Research Fund Denmark, grant no. 0135-00219. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

### Grant Disclosures

The following grant information was disclosed by the authors:

Villum Fonden: 29518.

Independent Research Fund Denmark: 0135-00219.

### Competing Interests

The authors declare that they have no competing interests.

### Author Contributions

* Davide Berardi performed the experiments, performed the computation work, prepared figures and/or tables, and approved the final draft.

* Saverio Giallorenzo conceived and designed the experiments, prepared figures and/or tables, authored or reviewed drafts of the paper, and approved the final draft.

* Jacopo Mauro conceived and designed the experiments, authored or reviewed drafts of the paper, and approved the final draft.

* Andrea Melis conceived and designed the experiments, performed the experiments, analyzed the data, performed the computation work, prepared figures and/or tables, and approved the final draft.

* Fabrizio Montesi conceived and designed the experiments, authored or reviewed drafts of the paper, and approved the final draft.
* Marco Prandini conceived and designed the experiments, prepared figures and/or tables, authored or reviewed drafts of the paper, and approved the final draft.

## Data Availability

The following information was supplied regarding data availability:
The data is available on Zenodo: Davide Berardi, Saverio Giallorenzo, Jacopo Mauro, Andrea Melis, Fabrizio Montesi, & Marco Prandini. (2021). Microservice Security: A Systematic Literature Review, dataset (1.0) [Data set]. Zenodo. https://doi.org/10.5281/zenodo.5513580.

## Supplemental Information

Supplemental information for this article can be found online at http://dx.doi.org/10.7717/peerj-cs.779#supplemental-information.

## REFERENCES

Abidi S, Essafi M, Guegan CG, Fakhri M, Witti H, Ghezala HHB. 2019. A web service security governance approach based on dedicated micro-services. Procedia Computer Science 159(3):372-386 DOI 10.1016/j.procs.2019.09.192.

Adam A, Alam MM. 2020. The fog cloud of things: a survey on concepts, architecture, standards, tools, and applications. Internet of Thing 9:100177 DOI 10.1016/j.iot.2020.100177.

Adedugbe O, Benkhelifa E, Campion R, Al-Obeidat F, Hani AB, Uchitha J. 2019. Leveraging cloud computing for the semantic web: review and trends. Soft Computing 24:5999-6014 DOI 10.1007/s00500-019-04559-2.

Agarwal S, Malandrino F, Chiasserini CF, De S. 2019. VNF placement and resource allocation for the support of vertical services in 5g networks. IEEE/ACM Transactions on Networking 27(1):433-446 DOI 10.1109/TNET.2018.2890631.

Ahmadvand M, Ibrahim A. 2016. Requirements reconciliation for scalable and secure microservice (de) composition. In: 2016 IEEE 24th International Requirements Engineering Conference Workshops (REW). Piscataway: IEEE, 68-73.

Ahmadvand M, Pretschner A, Ball K, Eyring D. 2018. Integrity protection against insiders in microservice-based infrastructures: from threats to a security framework. In: Federation of International Conferences on Software Technologies: Applications and Foundations. Berlin: Springer, 573-588.

Ahmed AIA, Gani A, Ab Hamid SH, Abdelmaboud A, Syed HJ, Mohamed RAAH, Ali I. 2019. Service management for IoT: requirements, taxonomy, recent advances and open research challenges. IEEE Access 7:155472-155488 DOI 10.1109/ACCESS.2019.2948027.

Akkermans S, Crispo B, Joosen W, Hughes D. 2018. Polyglot cerberos: resource security, interoperability and multi-tenancy for IoT services on a multilingual platform. In: Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. 59-68.

Alaluna M, Ferrolho L, Figueira JR, Neves N, Ramos FM. 2020. Secure multi-cloud virtual network embedding. Computer Communications 155(5):252-265 DOI 10.1016/j.comcom.2020.03.023.

Ali IM, Caprolu M, Pietro RD. 2020. Foundations, properties, and security applications of puzzles: a survey. ACM Computing Surveys (CSUR) 53(4):1-38 DOI 10.1145/3396374.

Almeida WHC, de Aguiar Monteiro L, Hazin RR, de Lima AC, Ferraz FS. 2017. Survey on microservice architecture-security, privacy and standardization on cloud computing
environment. In: ICSEA 2017: The Twelfth International Conference on Software Engineering Advances. 199-205.

**Alshuqayran N, Ali N, Evans R. 2016.** A systematic mapping study in microservice architecture. In: 2016 IEEE 9th International Conference on Service-Oriented Computing and Applications (SOCA). Piscataway: IEEE, 44-51.

**Alulema D, Criado J, Iribarne L, Fernández-Garca AJ, Ayala R. 2020.** A model-driven engineering approach for the service integration of iot systems. Cluster Computing 23(3):1937-1954 DOI 10.1007/s10586-020-03150-x.

**Amir-Mohammadian S, Kari C. 2020.** Correct audit logging in concurrent systems. Electronic Notes in Theoretical Computer Science 351:115-141 DOI 10.1016/j.entcs.2020.08.007.

**Andersen MP, Kolb J, Chen K, Culler DE, Katz RH. 2017.** Old democratizing authority in the built environment. In: Whitehouse K, Dutta P, Noh HY, eds. Proceedings of the 4th ACM International Conference on Systems for Energy-Efficient Built Environments, BuildSys 2017. Delft: ACM, 23:1-23:10.

**Andersen MP, Kolb J, Chen K, Fierro G, Culler DE, Katz R. 2018.** Democratizing authority in the built environment. ACM Transactions on Sensor Networks (TOSN) 14(3-4):1-26 DOI 10.1145/3199665.

**Anisetti M, Ardagna CA, Gaudenzi F, Damiani E. 2019.** A continuous certification methodology for devops. In: Proceedings of the 11th International Conference on Management of Digital EcoSystems. 205-212.

**Avritzer A, Ferme V, Janes A, Russo B, van Hoorn A, Schulz H, Menasché D, Rufino V. 2020.** Scalability assessment of microservice architecture deployment configurations: a domain-based approach leveraging operational profiles and load tests. Journal of Systems and Software 165(9):110564 DOI 10.1016/j.jss.2020.110564.

**Baarzi AF, Kesidis G, Fleck D, Stavrou A. 2020.** Microservices made attack-resilient using unsupervised service fissioning. In: Proceedings of the 13th European Workshop on Systems Security. 31-36.

**Baboi M, Iftene A, Gfu D. 2019.** Dynamic microservices to create scalable and fault tolerance architecture. Procedia Computer Science 159(3-4):1035-1044 DOI 10.1016/j.procs.2019.09.271.

**Badii C, Bellini P, Difino A, Nesi P, Pantaleo G, Paolucci M. 2019.** Microservices suite for smart city applications. Sensors 19(21):4798 DOI 10.3390/s19214798.

**Baker O, Nguyen Q. 2019.** A novel approach to secure microservice architecture from owasp vulnerabilities. In: CITRENZ Conference 2019.

**Balalaie A, Heydarnoori A, Jamshidi P. 2016.** Microservices architecture enables devops: migration to a cloud-native architecture. IEEE Software 33(3):42-52 DOI 10.1109/MS.2016.64.

**Bánáti A, Kail E, Karóczkai K, Kozlovszky M. 2018.** Authentication and authorization orchestrator for microservice-based software architectures. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). Piscataway: IEEE, 1180-1184.

**Bandeira A, Medeiros CA, Paixao M, Maia PH. 2019.** We need to talk about microservices: an analysis from the discussions on stackoverflow. In: 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR). Piscataway: IEEE, 255-259.

**Basso T, Moraes R, Antunes N, Vieira M, Santos W, Meira W. 2017.** Privaas: privacy approach for a distributed cloud-based data analytics platforms. In: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID). Piscataway: IEEE, 1108-1116.

**Beekman JG, Porter DE. 2017.** Challenges for scaling applications across enclaves. In: Proceedings of the 2nd Workshop on System Software for Trusted Execution. 1-2.
**Beheshti A, Benatallah B, Tabebordbar A, Motahari-Nezhad HR, Barukh MC, Nouri R. 2019.** *Datasynapse: a social data curation foundry.* *Distributed and Parallel Databases* **37**(3):351–384
DOI 10.1007/s10619-018-7245-1.

**Bélair M, Laniepce S, Menaud J-M. 2019.** Leveraging kernel security mechanisms to improve container security: a survey. In: *Proceedings of the 14th International Conference on Availability, Reliability and Security*. 1–6.

**Bertolino A, Angelis GD, Guerriero A, Miranda B, Pietrantuono R, Russo S. 2020.** Devopret: continuous reliability testing in devops. *Journal of Software: Evolution and Process e2298*
DOI 10.1002/smr.2298.

**Bhattacharya R. 2019.** Smart proxying for microservices. In: *Proceedings of the 20th International Middleware Conference Doctoral Symposium*. 31–33.

**Bobel M, Gerostathopoulos I, Bures T. 2020.** A toolbox for realtime timeseries anomaly detection. In: *2020 IEEE International Conference on Software Architecture Companion (ICSA-C)*. Piscataway: IEEE, 278–281.

**Bogatinovski J, Nedelkoski S, Cardoso J, Kao O. 2020.** Self-supervised anomaly detection from distributed traces. In: *2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)*. Piscataway: IEEE, 342–347.

**Bogner J, Fritzsch J, Wagner S, Zimmermann A. 2019.** Microservices in industry: insights into technologies, characteristics, and software quality. In: *2019 IEEE International Conference on Software Architecture Companion (ICSA-C)*. Piscataway: IEEE, 187–195.

**Bozan K, Lyytinen K, Rose GM. 2020.** How to transition incrementally to microservice architecture. *Communications of the ACM* **64**(1):79–85 DOI 10.1145/3378064.

**Brambilla M, Umuhoza E, Acerbis R. 2017.** Model-driven development of user interfaces for IoT systems via domain-specific components and patterns. *Journal of Internet Services and Applications* **8**(1):14 DOI 10.1186/s13174-017-0064-1.

**Brenner S, Hundt T, Mazzeo G, Kapitza R. 2017.** Secure cloud micro services using Intel SGX. In: *IFIP International Conference on Distributed Applications and Interoperable Systems*. Berlin: Springer, 177–191.

**Brito A, Fetzer C, Köpsell S, Pietzuch P, Pasin M, Felber P, Fonseca K, Rosa M, Gomes L, Riella R, Prado C, Rust LF, Lucani DE, Sipos M, Nagy L, Fehér M. 2019.** Secure end-to-end processing of smart metering data. *Journal of Cloud Computing* **8**(1):1–13
DOI 10.1186/s13677-019-0141-z.

**Bromberg Y-D, Gitzinger L. 2020.** Droidautoml: a microservice architecture to automate the evaluation of android machine learning detection systems. In: *IFIP International Conference on Distributed Applications and Interoperable Systems*. Berlin: Springer, 148–165.

**Brondolin R, Santambrogio MD. 2020.** A black-box monitoring approach to measure microservices runtime performance. *ACM Transactions on Architecture and Code Optimization (TACO)* **17**(4):1–26 DOI 10.1145/3418899.

**Brucker AD, Zhou B, Malmignati F, Shi Q, Merabti M. 2017.** Modelling, validating, and ranking of secure service compositions. *Software: Practice and Experience* **47**(12):1923–1943
DOI 10.1002/spe.2513.

**Bumblauskas D, Mann A, Dugan B, Rittmer J. 2020.** A blockchain use case in food distribution: do you know where your food has been? *International Journal of Information Management* **52**(9):102008 DOI 10.1016/j.ijinfomgt.2019.09.004.

**Buzachis A, Villari M. 2018.** Basic principles of osmotic computing: secure and dependable microelements (mels) orchestration leveraging blockchain facilities. In: *2018 IEEE/ACM*
*International Conference on Utility and Cloud Computing Companion (UCC Companion)*.
Piscataway: IEEE, 47–52.

**Callegati F, Giallorenzo S, Melis A, Prandini M. 2016.** Data security issues in maas-enabling platforms. In: *2016 IEEE 2nd International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI)*. Piscataway: IEEE, 1–5.

**Callegati F, Giallorenzo S, Melis A, Prandini M. 2018.** Cloud-of-things meets mobility-as-a-service: an insider threat perspective. *Computers & Security* **74**(7):277–295
DOI 10.1016/j.cose.2017.10.006.

**Camilli M, Bellettini C, Capra L, Monga M. 2017.** A formal framework for specifying and verifying microservices based process flows. In: *International Conference on Software Engineering and Formal Methods*. Berlin: Springer, 187–202.

**Casale G, Artač M, van den Heuvel W-J, Van Hoorn A, Jakovits P, Leymann F, Long M, Papanikolaou V, Presenza D, Russo A, Srirama SN, Tamburri DA, Wurster M, Zhu L. 2019.** Radon: rational decomposition and orchestration for serverless computing. *SICS Software-Intensive Cyber-Physical Systems* **35**:77–87 DOI 10.1007/s00450-019-00413-w.

**Casale G, Chesta C, Deussen P, Di Nitto E, Gouvas P, Koussouris S, Stankovski V, Symeonidis A, Vlassiou V, Zafeiropoulos A, Zhao Z. 2016.** Current and future challenges of software engineering for services and applications. *Procedia Computer Science* **97**:34–42
DOI 10.1016/j.procs.2016.08.278.

**Casalicchio E, Iannucci S. 2020.** The state-of-the-art in container technologies: application, orchestration and security. *Concurrency and Computation: Practice and Experience* **32**(17): e5668 DOI 10.1002/cpe.5668.

**Cerny T, Donahoo MJ. 2016.** Survey on concern separation in service integration. In: *International Conference on Current Trends in Theory and Practice of Informatics*. Springer, 518–531.

**Cerny T, Sedlisky F, Donahoo MJ. 2018.** On isolation-driven automated module decomposition. In: *Proceedings of the 2018 Conference on Research in Adaptive and Convergent Systems*. 302–307.

**Cerny T, Svacina J, Das D, Bushong V, Bures M, Tisnovsky P, Frajtak K, Shin D, Huang J. 2020.** On code analysis opportunities and challenges for enterprise systems and microservices. *IEEE Access* **8**:159449–159470 DOI 10.1109/ACCESS.2020.3019985.

**Chandramouli R. 2019.** Microservices-based application systems. *NIST Special Publication 800:204* DOI 10.6028/NIST.SP.800-204.

**Chen C-A. 2019.** With great abstraction comes great responsibility: Sealing the microservices attack surface. In: *2019 IEEE Cybersecurity Development (SecDev)*. Piscataway: IEEE, 144.

**Chen H, Chen P, Yu G. 2020.** A framework of virtual war room and matrix sketch-based streaming anomaly detection for microservice systems. *IEEE Access* **8**:43413–43426
DOI 10.1109/ACCESS.2020.2977464.

**Chen J, Huang H, Chen H. 2019.** Informer: irregular traffic detection for containerized microservices rpc in the real world. In: *Proceedings of the 4th ACM/IEEE Symposium on Edge Computing*. New York: ACM, 389–394.

**Cheruvu S, Kumar A, Smith N, Wheeler DM. 2020.** Demystifying internet of things security: successful iot device/edge and platform security deployment. Berkeley: Springer Nature.

**Chidambaram N, Raj P, Thenmozhi K, Rajagopalan S, Amirtharajan R. 2019.** A cloud compatible dna coded security solution for multimedia file sharing & storage. *Multimedia Tools and Applications* **78**(23):33837–33863 DOI 10.1007/s11042-019-08166-z.
**Chondamrongkul N, Sun J, Warren I. 2020.** Automated security analysis for microservice architecture. In: *2020 IEEE International Conference on Software Architecture Companion (ICSA-C)*. Piscataway: IEEE, 79-82.

**Ciavotta M, Alge M, Menato S, Rovere D, Pedrazzoli P. 2017.** A microservice-based middleware for the digital factory. *Procedia Manufacturing* 11:931-938 DOI 10.1016/j.promfg.2017.07.197.

**Clancy TC, McGwier RW, Chen L. 2019.** Post-quantum cryptography and 5g security: tutorial. In: *Proceedings of the 12th Conference on Security and Privacy in Wireless and Mobile Networks*. 285.

**Clauset A, Newman ME, Moore C. 2004.** Finding community structure in very large networks. *Physical Review E* 70(6):066111 DOI 10.1103/PhysRevE.70.066111.

**Cleveland SB, Jamthe A, Padhy S, Stubbs J, Packard M, Looney J, Terry S, Cardone R, Dahan M, Jacobs GA. 2020.** Tapis api development with python: best practices in scientific rest api implementation: experience implementing a distributed stream api. In: *Practice and Experience in Advanced Research Computing*. 181-187.

**Cohen J. 1960.** A coefficient of agreement for nominal scales. *Educational and Psychological Measurement* 20(1):37-46 DOI 10.1177/001316446002000104.

**Copei S, Wickert M, Zündorf A. 2020.** Certification as a service. In: *Paasivaara M, Kruchten P, eds. Agile Processes in Software Engineering and Extreme Programming - Workshops*. Cham: Springer International Publishing, 203-210.

**Costa B, Pires PF, Delicato FC. 2020.** Towards the adoption of omg standards in the development of soa-based iot systems. *Journal of Systems and Software* 169(1):110720 DOI 10.1016/j.jss.2020.110720.

**da Silva MSL, de Oliveira Silva FF, Brito A. 2019.** Squad: a secure, simple storage service for SGX-based microservices. In: *2019 9th Latin-American Symposium on Dependable Computing (LADC)*. Piscataway: IEEE, 1-9.

**Damis HA, Shehada D, Fachkha C, Gawanmeh A, Al-Karaki JN. 2020.** A microservices architecture for ads-b data security using blockchain. In: *2020 3rd International Conference on Signal Processing and Information Security (ICSPIS)*. Piscataway: IEEE, 1-4.

**Dash PB, Nayak J, Naik B, Oram E, Islam SH. 2020.** Model based iot security framework using multiclass adaptive boosting with smote. *Security and Privacy* 3(5):e112 DOI 10.1002/spy2.112.

**Díaz-Sánchez D, Marín-Lopez A, Almenárez Mendoza F, Arias Cabarcos P. 2019.** DNS/DANE collision-based distributed and dynamic authentication for microservices in IoT. *Sensors* 19(15):3292 DOI 10.3390/s19153292.

**de Araujo Zanella AR, da Silva E, Albini LCP. 2020.** Security challenges to smart agriculture: current state, key issues, and future directions. *Array 8(August)*:100048 DOI 10.1016/j.array.2020.100048.

**De Donno M, Giaretta A, Dragoni N, Bucchiarone A, Mazzara M. 2019.** Cyber-storms come from clouds: security of cloud computing in the iot era. *Future Internet* 11(6):127 DOI 10.3390/fi11060127.

**de Oliveira Rosa T, Daniel JFL, Guerra EM, Goldman A. 2020.** A method for architectural trade-off analysis based on patterns: evaluating microservices structural attributes. In: *Proceedings of the European Conference on Pattern Languages of Programs 2020*. 1-8.

**de Sousa PS, Nogueira NP, dos Santos RC, Maia PHM, de Souza JT. 2020.** Building a prototype based on microservices and blockchain technologies for notary's office: an academic experience report. In: *2020 IEEE International Conference on Software Architecture Companion (ICSA-C)*. Piscataway: IEEE, 122-129.
de Toledo SS, Martini A, Sjöberg DI. 2020. Improving agility by managing shared libraries in microservices. In: *International Conference on Agile Software Development*. Berlin: Springer, 195–202.

Death D. 2017. *Information security handbook: develop a threat model and incident response strategy to build a strong information security framework*. Birmingham: Packt Publishing Ltd.

Delicato FC, Al-Anbuky A, Kevin I, Wang K. 2020. Smart cyber-physical systems: toward pervasive intelligence systems. Available at https://www.sciencedirect.com/science/article/abs/pii/S0167739X19316619.

Demoulin HM, Vaidya T, Pedisich I, DiMaiolo B, Qian J, Shah C, Zhang Y, Chen A, Haeberlen A, Loo BT, Phan LTX, Sherr M, Shields C, Zhou W. 2018. Dedos: defusing dos with dispersion oriented software. In: *Proceedings of the 34th Annual Computer Security Applications Conference*. 712–722.

DesLauriers J, Kiss T, Ariyattu RC, Dang H-V, Ullah A, Bowden J, Krefting D, Pierantoni G, Terstyanszky G. 2020. Cloud apps to-go: cloud portability with TOSCA and MiCADO. *Concurrency and Computation: Practice and Experience* 33(19):e6093 DOI 10.1002/cpe.6093.

Dewanta F. 2020. Secure microservices deployment for fog computing services in a remote office. In: *2020 3rd International Conference on Information and Communications Technology (ICOIACT)*. Piscataway: IEEE, 425–430.

Di Ciccio C, Cecconi A, Dumas M, Garca-Bañuelos L, López-Pintado O, Lu Q, Mendling J, Ponomarev A, Tran AB, Weber I. 2019. Blockchain support for collaborative business processes. *Informatik Spektrum* 42(3):182–190 DOI 10.1007/s00287-019-01178-x.

Di Francesco P, Lago P, Malavolta I. 2019. Architecting with microservices: a systematic mapping study. *Journal of Systems and Software* 150(1):77–97 DOI 10.1016/j.jss.2019.01.001.

Di Francesco P, Malavolta I, Lago P. 2017. Research on architecting microservices: trends, focus, and potential for industrial adoption. In: *2017 IEEE International Conference on Software Architecture (ICSA)*. Piscataway: IEEE, 21–30.

Di Salle A, Gallo F, Pompilio C. 2016. Composition of advanced ($\mu$) services for the next generation of the internet of things. In: *Federation of International Conferences on Software Technologies: Applications and Foundations*. Berlin: Springer, 436–444.

Di Sanzo P, Avresky DR, Pellegrini A. 2021. Autonomic rejuvenation of cloud applications as a countermeasure to software anomalies. *Software: Practice and Experience* 51(1):46–71 DOI 10.1002/spe.2908.

Diekmann C, Naab J, Korsten A, Carle G. 2018. Agile network access control in the container age. *IEEE Transactions on Network and Service Management* 16(1):41–55 DOI 10.1109/TNSM.2018.2889009.

Dilshan D, Piumika S, Rupasinghe C, Perera I, Siriwardena P. 2020. Mschain: blockchain based decentralized certificate transparency for microservices. In: *2020 Moratuwa Engineering Research Conference (MERCon)*. Piscataway: IEEE, 1–6.

Dragoni N, Giallorenzo S, Lafuente AL, Mazzara M, Montesi F, Mustafin R, Safina L. 2017. *Microservices: yesterday, today, and tomorrow*. Cham: Springer International Publishing, 195–216.

Du D, Yu T, Xia Y, Zang B, Yan G, Qin C, Wu Q, Chen H. 2020. Catalyzer: sub-milliscond startup for serverless computing with initialization-less booting. In: *Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems*. 467–481.
**Du Q, Xie T, He Y. 2018.** Anomaly detection and diagnosis for container-based microservices with performance monitoring. In: *International Conference on Algorithms and Architectures for Parallel Processing*. Berlin: Springer, 560-572.

**Elsayed M, Zulkernine M. 2019.** Offering security diagnosis as a service for cloud saas applications. *Journal of Information Security and Applications* 44(5):32-48 DOI 10.1016/j.jisa.2018.11.006.

**Esparrachiari S, Reilly T, Rentz A. 2018.** Tracking and controlling microservice dependencies. *Queue* 16(4):44-65 DOI 10.1145/3277539.3277541.

**Esposito C, Castiglione A, Tudorica C-A, Pop F. 2017.** Security and privacy for cloud-based data management in the health network service chain: a microservice approach. *IEEE Communications Magazine* 55(9):102-108 DOI 10.1109/MCOM.2017.1700089.

**Fahmideh M, Zowghi D. 2020.** An exploration of iot platform development. *Information Systems* 87(10):101409 DOI 10.1016/j.is.2019.06.005.

**Falah MF, Sukaridhoto S, Al Rasyid MUH, Wicaksono H. 2020.** Design of virtual engineering and digital twin platform as implementation of cyber-physical systems. *Procedia Manufacturing* 52(5):331-336 DOI 10.1016/j.promfg.2020.11.055.

**Fetzer C, Mazzeo G, Oliver J, Romano L, Verburg M. 2017.** Integrating reactive cloud applications in sereca. In: *Proceedings of the 12th International Conference on Availability, Reliability and Security*. 1-8.

**Flora J. 2020.** Improving the security of microservice systems by detecting and tolerating intrusions. In: *2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)*. Piscataway: IEEE, 131-134.

**Flora J, Gonçalves P, Antunes N. 2020.** Using attack injection to evaluate intrusion detection effectiveness in container-based systems. In: *2020 IEEE 25th Pacific Rim International Symposium on Dependable Computing (PRDC)*. Piscataway: IEEE, 60-69.

**Forti S, Ferrari G-L, Brogi A. 2020.** Secure cloud-edge deployments, with trust. *Future Generation Computer Systems* 102(9):775-788 DOI 10.1016/j.future.2019.08.020.

**Garg S, Garg S. 2019.** Automated cloud infrastructure, continuous integration and continuous delivery using docker with robust container security. In: *2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR)*. Piscataway: IEEE, 467-470.

**Garriga M. 2017.** Towards a taxonomy of microservices architectures. In: *International Conference on Software Engineering and Formal Methods*. Berlin: Springer, 203-218.

**George VM, Mahmoud QH. 2017.** Claimware: a claims-based middleware for securing iot services. In: *2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC)*. Piscataway: IEEE, Vol. 1, 649-654.

**Gerking C, Schubert D. 2019.** Component-based refinement and verification of information-flow security policies for cyber-physical microservice architectures. In: *2019 IEEE International Conference on Software Architecture (ICSA)*. Piscataway: IEEE, 61-70.

**Ghayyur SAK, Razzaq A, Ullah S, Ahmed S. 2018.** Matrix clustering based migration of system application to microservices architecture. *International Journal of Advanced Computer Science and Applications* 9(1):284-296 DOI 10.14569/IJACSA.2018.090139.

**Ghuge SS, Kumar N, Savitha S, Suraj V. 2020.** Multilayer technique to secure data transfer in private cloud for saas applications. In: *2020 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA)*. Piscataway: IEEE, 646-651.

**Giaimo F, Andrade H, Berger C. 2020.** Continuous experimentation and the cyber-physical systems challenge: an overview of the literature and the industrial perspective. *Journal of Systems and Software* 170(2):110781 DOI 10.1016/j.jss.2020.110781.
**Gorige D, Al-Masri E, Kanzhelev S, Fattah H. 2020.** Privacy-risk detection in microservices composition using distributed tracing. In: *2020 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE)*. Piscataway: IEEE, 250–253.

**Guija D, Siddiqui MS. 2018.** Identity and access control for micro-services based 5g nfv platforms. In: *Proceedings of the 13th International Conference on Availability, Reliability and Security*. 1–10.

**Gupta RK, Venkatachalapathy M, Jeberla FK. 2019.** Challenges in adopting continuous delivery and devops in a globally distributed product team: a case study of a healthcare organization. In: *2019 ACM/IEEE 14th International Conference on Global Software Engineering (ICGSE)*. Piscataway: IEEE, 30–34.

**Hahn DA, Davidson D, Bardas AG. 2020.** Mismesh: Security issues and challenges in service meshes. In: *International Conference on Security and Privacy in Communication Systems*. Berlin: Springer, 140–151.

**Hajek J, Rashid M, Sevil M, Cinar A, Alvarez Fernandez PA, Jain D. 2020.** The necessity of interdisciplinary software development for building viable research platforms: case study in automated drug delivery in diabetes. In: *Proceedings of the 21st Annual Conference on Information Technology Education*. 390–396.

**Han J, Kim S, Kim T, Han D. 2019.** Toward scaling hardware security module for emerging cloud services. In: *Proceedings of the 4th Workshop on System Software for Trusted Execution*. 1–6.

**Hang L, Ullah I, Kim D-H. 2020.** A secure fish farm platform based on blockchain for agriculture data integrity. *Computers and Electronics in Agriculture 170*(1-3):105251 DOI 10.1016/j.compag.2020.105251.

**Hannousse A, Yahiouche S. 2020.** Securing microservices and microservice architectures: a systematic mapping study. Available at https://www.sciencedirect.com/science/article/abs/pii/S1574013721000551.

**Haque MU, Iwaya LH, Babar MA. 2020.** Challenges in docker development: a large-scale study using stack overflow. In: *Proceedings of the 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)*. 1–11.

**Hasan M, Starly B. 2020.** Decentralized cloud manufacturing-as-a-service (cmaas) platform architecture with configurable digital assets. *Journal of Manufacturing Systems* 56(2):157–174 DOI 10.1016/j.jmsy.2020.05.017.

**He X, Yang X. 2017.** Authentication and authorization of end user in microservice architecture. *Journal of Physics: Conference Series* 910:012060 DOI 10.1088/1742-6596/910/1/012060.

**Hendrickson S, Sturdevant S, Harter T, Venkataramani V, Arpaci-Dusseau AC, Arpaci-Dusseau RH. 2016.** Serverless computation with openlambda. In: *8th {USENIX} Workshop on Hot Topics in Cloud Computing (HotCloud 16)*.

**Hole JK. 2016.** *Anti-fragile ICT systems*. Berlin: Springer-Verlag GmbH.

**Hsu TH-C. 2018.** *Hands-on security in DevOps: ensure continuous security, deployment, and delivery with DevSecOps*. Birmingham: Packt Publishing Ltd.

**Ibrahim A, Bozhinoski S, Pretschner A. 2019.** Attack graph generation for microservice architecture. In: *Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing*. 1235–1242.

**Iraqi O, El Bakkali H. 2020.** Immunizer: a scalable loosely-coupled self-protecting software framework using adaptive microagents and parallelized microservices. In: *2020 IEEE 29th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE)*. Piscataway: IEEE, 24–27.
**Islam T, Manivannan D, Zeadally S. 2016.** A classification and characterization of security threats in cloud computing. *International Journal of Next-Generation Computing* **7**(1):307 DOI 10.47164/ijngc.v7i1.307.

**Jan S, Panichella A, Arcuri A, Briand L. 2019.** Search-based multi-vulnerability testing of xml injections in web applications. *Empirical Software Engineering* **24**(6):3696-3729 DOI 10.1007/s10664-019-09707-8.

**Jander K, Braubach L, Pokahr A. 2018.** Defense-in-depth and role authentication for microservice systems. *Procedia Computer Science* **130**(2):456-463 DOI 10.1016/j.procs.2018.04.047.

**Jander K, Braubach L, Pokahr A. 2019.** Practical defense-in-depth solution for microservice systems. *Journal of Ubiquitous Systems & Pervasive Networks* **11**(1):17-25 DOI 10.5383/JUSPN.11.01.003.

**Janjua K, Shah MA, Almogren A, Khattak HA, Maple C, Din IU. 2020.** Proactive forensics in IoT: privacy-aware log-preservation architecture in fog-enabled-cloud using holochain and containerization technologies. *Electronics* **9**(7):1172 DOI 10.3390/electronics9071172.

**Javed A, Robert J, Heljanko K, Främling K. 2020.** Iotef: a federated edge-cloud architecture for fault-tolerant iot applications. *Journal of Grid Computing* **18**(1):1-24 DOI 10.1007/s10723-019-09498-8.

**Jaworski J, Karwowski W, Rusek M. 2019.** Microservice-based cloud application ported to unikernels: performance comparison of different technologies. In: *International Conference on Information Systems Architecture and Technology*. Berlin: Springer, 255-264.

**Jin H, Li Z, Zou D, Yuan B. 2019.** Dseom: a framework for dynamic security evaluation and optimization of mtd in container-based cloud. *IEEE Transactions on Dependable and Secure Computing* **18**(3):1125-1136 DOI 10.1109/TDSC.2019.2916666.

**Jin M, Lv A, Zhu Y, Wen Z, Zhong Y, Zhao Z, Wu J, Li H, He H, Chen F. 2020.** An anomaly detection algorithm for microservice architecture based on robust principal component analysis. *IEEE Access* **8**:226397-226408 DOI 10.1109/ACCESS.2020.3044610.

**Jita H, Pieterse V. 2018.** A framework to apply the internet of things for medical care in a home environment. In: *Proceedings of the 2018 International Conference on Cloud Computing and Internet of Things*. 45-54.

**Joseph CT, Chandrasekaran K. 2019.** Straddling the crevasse: a review of microservice software architecture foundations and recent advancements. *Software: Practice and Experience* **49**(10):1448-1484 DOI 10.1002/spe.2729.

**Kallergis D, Garofalaki Z, Katsikogiannis G, Douligeris C. 2020.** Capodaz: a containerised authorisation and policy-driven architecture using microservices. *Ad Hoc Networks* **104**(Pt. 3):102153 DOI 10.1016/j.adhoc.2020.102153.

**Kalske M, Mäkitalo N, Mikkonen T. 2017.** Challenges when moving from monolith to microservice architecture. In: *International Conference on Web Engineering*. Berlin: Springer, 32-47.

**Kamble KG, Sinha A. 2016.** US Patent App. 15/191,420. Available at https://www.patentguru.com/US2016381076A1.

**Kang M, Shin J-S, Kim J. 2019.** Protected coordination of service mesh for container-based 3-tier service traffic. In: *2019 International Conference on Information Networking (ICOIN)*. Piscataway: IEEE, 427-429.

**Kang R, Zhou Z, Liu J, Zhou Z, Xu S. 2018.** Distributed monitoring system for microservices-based iot middleware system. In: *International Conference on Cloud Computing and Security*. Berlin: Springer, 467-477.
**Kapferer S, Zimmermann O. 2020.** Domain-driven service design. In: *Symposium and Summer School on Service-Oriented Computing*. Berlin: Springer, 189–208.

**Kathiravelu P, Van Roy P, Veiga L. 2019.** SD-CPS: software-defined cyber-physical systems. taming the challenges of CPS with workflows at the edge. *Cluster Computing* 22(3):661–677 DOI 10.1007/s10586-018-2874-8.

**Ke H, Wu H, Yang D. 2020.** Towards evolving security requirements of industrial internet: a layered security architecture solution based on data transfer techniques. In: *Proceedings of the 2020 International Conference on Cyberspace Innovation of Advanced Technologies*. 504–511.

**Kelbert F, Gregor F, Pires R, Köpsell S, Pasin M, Havet A, Schiavoni V, Felber P, Fetzer C, Pietzuch P. 2017.** Securecloud: secure big data processing in untrusted clouds. In: *Design, Automation & Test in Europe Conference & Exhibition (DATE)*. Piscataway: IEEE, 282–285.

**Khan AA, Shameem M. 2020.** Multicriteria decision-making taxonomy for devops challenging factors using analytical hierarchy process. *Journal of Software: Evolution and Process 32*(10): e2263 DOI 10.1002/smcr.2263.

**Kochovski P, Gec S, Stankovski V, Bajec M, Drobintsev PD. 2019.** Trust management in a blockchain based fog computing platform with trustless smart oracles. *Future Generation Computer Systems* 101(4):747–759 DOI 10.1016/j.future.2019.07.030.

**Kohnfelder L, Garg P. 1999.** *The threats to our products*. Redmond: Microsoft Interface, Microsoft Corporation.

**Krämer M, Frese S, Kuijper A. 2019.** Implementing secure applications in smart city clouds using microservices. *Future Generation Computer Systems* 99(1):308–320 DOI 10.1016/j.future.2019.04.042.

**Krishnan P, Duttagupta S, Achuthan K. 2019.** SDN/NFV security framework for fog-to-things computing infrastructure. *Software: Practice and Experience* 50(5):757–800 DOI 10.1002/spe.2761.

**Kumar R, Goyal R. 2020.** Modeling continuous security: a conceptual model for automated devsecops using open-source software over cloud (adoc). *Computers & Security* 97(1):101967 DOI 10.1016/j.cose.2020.101967.

**Kwon S, Son S-J, Choi Y, Lee J-H. 2020.** Protocol fuzzing to find security vulnerabilities of rabbitMQ. *Concurrency and Computation: Practice and Experience* 33(23):e6012 DOI 10.1002/cpe.6012.

**Lakhan A, Li X. 2020.** Transient fault aware application partitioning computational offloading algorithm in microservices based mobile cloudlet networks. *Computing* 102(1):105–139 DOI 10.1007/s00607-019-00733-4.

**Łaskawiec S, Choraś M, Kozik R. 2019.** New solutions for exposing clustered applications deployed in the cloud. *Cluster Computing* 22(3):829–838 DOI 10.1007/s10586-018-2850-3.

**Leite AF, Alves V, Rodrigues GN, Tadonki C, Eisenbeis C, de Melo ACMA. 2017.** Dohko: an autonomic system for provision, configuration, and management of inter-cloud environments based on a software product line engineering method. *Cluster Computing* 20(3):1951–1976 DOI 10.1007/s10586-017-0897-1.

**Leite L, Kon F, Pinto G, Meirelles P. 2020.** Platform teams: an organizational structure for continuous delivery. In: *Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops*. 505–511.

**Leite L, Rocha C, Kon F, Milojicic D, Meirelles P. 2019.** A survey of devops concepts and challenges. *ACM Computing Surveys (CSUR)* 52(6):1–35 DOI 10.1145/3359981.
**Lenarduzzi V, Lomio F, Saarimäki N, Taibi D. 2020.** Does migrating a monolithic system to microservices decrease the technical debt? *Journal of Systems and Software* **169**(1):110710
DOI 10.1016/j.jss.2020.110710.

**Li H, Hu H, Gu G, Ahn G-J, Zhang F. 2018.** VNIDS: towards elastic security with safe and efficient virtualization of network intrusion detection systems. In: *Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security*. 17–34.

**Li S, Xu Q, Hou P, Chen X, Wang Y, Zhang H, Rong G. 2020.** Exploring the challenges of developing and operating consortium blockchains: a case study. In: *Proceedings of the Evaluation and Assessment in Software Engineering*. New York: ACM, 398–404.

**Li W, Lemieux Y, Gao J, Zhao Z, Han Y. 2019a.** Service mesh: challenges, state of the art, and future research opportunities. In: *2019 IEEE International Conference on Service-Oriented System Engineering (SOSE)*. Piscataway: IEEE, 122–1225.

**Li Z, Jin H, Zou D, Yuan B. 2019b.** Exploring new opportunities to defeat low-rate ddos attack in container-based cloud environment. *IEEE Transactions on Parallel and Distributed Systems* **31**(3):695–706 DOI 10.1109/TPDS.2019.2942591.

**Liang X, Zhao Q. 2020.** On the design of a blockchain-based student quality assessment system. In: *2020 International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS)*. Piscataway: IEEE, 1–7.

**Lichtenthäler R, Prechtl M, Schwille C, Schwartz T, Cezanne P, Wirtz G. 2019.** Requirements for a model-driven cloud-native migration of monolithic web-based applications. *SICS Software-Intensive Cyber-Physical Systems* **35**:1–12 DOI 10.1007/s00450-019-00414-9.

**Lie MF, Sánchez-Gordón M, Colomo-Palacios R. 2020.** Devops in an iso 13485 regulated environment: a multivocal literature review. In: *Proceedings of the 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)*. New York: ACM, 1–11.

**Liu P, Xu H, Ouyang Q, Jiao R, Chen Z, Zhang S, Yang J, Mo L, Zeng J, Xue W, Pei D. 2020.** Unsupervised detection of microservice trace anomalies through service-level deep Bayesian networks. In: *2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE)*. Piscataway: IEEE, 48–58.

**Lou P, Lu G, Jiang X, Xiao Z, Hu J, Yan J. 2020.** Cyber intrusion detection through association rule mining on multi-source logs. *Applied Intelligence* **51**:1–15
DOI 10.1007/s10489-020-02007-5.

**Lu D, Huang D, Walenstein A, Medhi D. 2017.** A secure microservice framework for IoT. In: *2017 IEEE Symposium on Service-Oriented System Engineering (SOSE)*. Piscataway: IEEE, 9–18.

**Lu Q, Binh Tran A, Weber I, O'Connor H, Rimba P, Xu X, Staples M, Zhu L, Jeffery R. 2021.** Integrated model-driven engineering of blockchain applications for business processes and asset management. *Software: Practice and Experience* **51**(5):1059–1079 DOI 10.1002/spe.2931.

**Luntovskyy A, Shubyn B. 2020.** Highly-distributed systems based on micro-services and their construction paradigms. In: *2020 IEEE 15th International Conference on Advanced Trends in Radioelectronics, Telecommunications and Computer Engineering (TCSET)*. Piscataway: IEEE, 7–14.

**Luo X, Ren F, Zhang T. 2018.** High performance userspace networking for containerized microservices. In: *International Conference on Service-Oriented Computing*. Berlin: Springer, 57–72.

**Lwakatare LE, Kilamo T, Karvonen T, Sauvola T, Heikkilä V, Itkonen J, Kuvaja P, Mikkonen T, Oivo M, Lassenius C. 2019.** Devops in practice: a multiple case study of five companies. *Information and Software Technology* **114**(8):217–230 DOI 10.1016/j.infsof.2019.06.010.