# A Cloud Orchestrator for Deploying Public Services on the Cloud – The Case of STRATEGIC Project

Panagiotis Gouvas, Konstantinos Kalaboukas, Giannis Ledakis, Theo Dimitrakos, Joshua Daniel, Géry Ducatel, Nuria Rodriguez Dominguez

► To cite this version:

Panagiotis Gouvas, Konstantinos Kalaboukas, Giannis Ledakis, Theo Dimitrakos, Joshua Daniel, et al.. A Cloud Orchestrator for Deploying Public Services on the Cloud – The Case of STRATEGIC Project. 9th IFIP International Conference on Trust Management (TM), May 2015, Hamburg, Germany. pp.217-225, 10.1007/978-3-319-18491-3_18 . hal-01416229

HAL Id: hal-01416229

https://inria.hal.science/hal-01416229

Submitted on 14 Dec 2016

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# A Cloud Orchestrator for Deploying Public Services on the Cloud – the Case of STRATEGIC Project

Panagiotis Gouvas¹, Konstantinos Kalaboukas¹, Giannis Ledakis¹, Theo Dimitrakos², Joshua Daniel², Gery Ducatel², Nuria Rodriguez Dominguez³

¹SingularLogic, Al. Panagouli & Siniosoglou, Nea Ionia, 14234, Athens, Greece
pgouvas@gmail.com, kkalaboukas@singularlogic.eu,
g.ledakis@gmail.com

²BT Research & Innovation, Adastral park, Ipswich, IP5 3RE, UK
{theo.dimitrakos, joshua.daniel, gery.ducatel}@bt.com

³ ATOS Spain, C/Albarracín 25, 28037 Madrid, Spain
nuria.rodriguez@atos.net

**Abstract.** In recent times, public bodies are adopting IaaS solutions for deploying online governmental services. A sufficient number are adopting private cloud solutions while others hybrid or public offerings, making the necessity of a Cloud Orchestrator highly imperative. In this paper, the STRATEGIC Cloud Orchestrator is presented which targets deployment services in multi-cloud providers. The Cloud Orchestrator architecture and design have been developed using a purely top-down approach, driven by user requirements coming from the three different European Municipalities (London Borough of Camden-UK, Genoa-IT and Stari Grad-SR) that will adopt the STRATEGIC solution. Also, the summary of the user requirements, the technical approach and value proposition are being described.

## 1 Introduction

Cloud computing services (including public cloud services) hold the promise to deliver a host of benefits to both public sector organizations and enterprises, including reduced Capital Expenditure (CAPEX), improved performance and scalability, and enhanced reliability, as well as a reduced overall Total Cost of Ownership (TCO) for their ICT infrastructures and services. According to the European Union Agency for Network and Information Security (ENISA), public bodies can also benefit from the improvement of citizen interactions with government in respect of reducing information processing time, lowering the cost of government services and enhancing citizen data security[1]. These benefits are particularly important for public bodies, especially for governmental agencies, municipalities and regions; the adoption of public cloud services as part of their numerous e-government interactions is expected to have a significant economic and social impact.
The main objective of STRATEGIC is to boost the adoption of public cloud services by the creation of a STRATEGIC Cloud Orchestrator. The STRATEGIC Cloud Orchestrator builds upon leading edge R&D results (Optimis Toolkit[2], STORK[3] and Semiramis[4] projects), to provide tools and techniques for the interoperable migration and replication of public cloud services across different EU countries and their regions. It has the following principal features:

*Cloud Enablement:* Cloud enablement is the migration/porting of existing on-line distributed services to the Cloud.

*Replication:* Replication and re-use of existing services, which have been already successfully deployed across EU countries and regions. This will result in localization and adaptation of the services to different legal, ethical and governance requirements.

*Composition of new value-added services:* The ability to compose and integrate novel public cloud services based on other existing/legacy services could allow public administrations to streamline their processes thereby reducing overheads, alleviating bureaucracy and overall improve citizens' benefits and satisfaction [6].

The primary incentive for an organization/public body to adopt a Cloud Orchestrator is to increase automation. The need to orchestrate really becomes clear as when using cloud environments as the automation of storage, network, performance and provisioning are in most cases handled by miscellaneous solutions that have been added incrementally over time. Even for organizations that take a transformational approach, jumping to an advanced cloud to optimize their data centers, the management of heterogeneous environments with disparate systems can be a challenge not simply addressed by automation alone[5].

In this paper, a summary of the identified user requirements for a Cloud Orchestrator are provided, STRATEGIC Cloud Orchestrator is presented in terms of technical approach and value proposition offered. Furthermore, the pilot scenarios of the three different European Municipalities (London Borough of Camden-UK, Genoa-IT and Stari Grad-SR) that will evaluate the STRATEGIC Cloud Orchestrator are depicted.

# 2 STRATEGIC Cloud Orchestrator

## 2.1 Requirements Identification

The methodology for requirements identification comprised two main axes: a questionnaire supported by selected interviews to get input from a diverse set of stakeholders, including both cloud users and providers and analysis of pilot Municipalities applications' requirements. The requirements of the target communities were identified after analyzing a diverse set of public and private sector organizations. Public sector bodies covered included central government agencies, and municipalities and other regional or local governments, while the private sector bodies covered included cloud application developers, cloud solution providers, cloud services providers, cloud solution integrators, Independent Software Vendors (ISVs) and more. A total of 117 questionnaire responses were received and analysed[7].
Regarding users who want to adopt cloud services, the most important requirements that were considered as functional, identified from the questionnaire analyses are:

* Security and privacy.

* High Availability

* Interoperability, portability.

In the same time the requirements of lowering costs and having good performance have been identified, but were considered non-functional.

In addition, specific technical requirements were raised after analyzing 11 applications that are operated by the three large European Municipalities within the STRATEGIC project. These will now be described.

*Common Application Packaging Format:* This will be expressive enough to cover many aspects of the application lifecycle. The challenges here are many, since the notion of cloud enabling an application entails many difficulties. Applications may be monolithic, or multi-tier with several interdependencies between them. Furthermore, applications may have external dependencies at the service-level, at the OS-level or even at hardware-level. In addition, a proper application-packaging should take under consideration interoperability and “docking points” between packages. Beyond dependency-management, a packaging format should take under consideration the notion of application and configuration and application scalability.

*Configuration Management:* This deals with post-installation configuration management and covers many issues such as the setup of encryption channels, the configuration of logging handlers, the installation and configuration of security management services etc. in a multi-cloud context.

*Interoperability at the hypervisor level:* A critical requirement is the avoidance of vendor lock-in at the hypervisor level. Many mature hypervisors (KVM, ESXI etc) are already able to process VMs that comply to specific formats. However these hypervisors expose their functionality with different API; therefore any Orchestrator should be able to use an abstraction layer on-top of these diverse APIs.

*Interoperability on Monitoring:* Additionally, a de-facto need of any orchestrator is for interoperability with monitoring platforms. Indeed, most of the core entities that are deployed in a Cloud Environment can be “patched” in order to expose performance measurements on many levels (application-level, VM-level). This exposed information can be used for anomaly detection, deployment optimization or even SLA enforcement.

## 2.2 STRATEGIC Cloud Orchestrator Architecture

Taking under consideration the requirements identified for the creation of the Cloud Orchestrator, a modular high-level architecture has been defined.
<figure><img src="image_2.png" /><figcaption>Fig. 1. STRATEGIC Cloud Orchestrator High Level architecture components</figcaption></figure>

The Packaged-Applications Repository contains all applications that can be instantiated in an Infrastructure as a Service (IaaS) environment. The critical aspect regarding the repository is the formulation of an expressive enough application-packaging schema. This repository can be used as the basis of a STRATEGIC marketplace. A separate OS Virtual Machines (VM) Template Repository contains the available Operating Systems that can be instantiated by various IaaS environments.

The Credential Management Component is responsible for persistently storing the credentials of an end-user for each IaaS provider. The Application Instantiation Workflow coordinates the deployment of an Application to an IaaS provider. This implies the selection of the proper host-OS (based on the application packaging information), the target-IaaS and the initialization of the configuration-logic that is dependent to the application. The instantiation process combines user-oriented and system-imposed information that is required in order for a successful deployment to be performed.

One of the most crucial components is the Configuration Recipes Repository that contains the available configuration templates that can be applied after an Application instantiation. A configuration template is valuable only in the context of the adoption of a Configuration Management Framework. Therefore, although a Configuration Server is not an organic part of the Orchestrator, it constitutes a critical point since it assures that running instances maintain during runtime of a proper configuration.
Beyond that, the Configuration Framework acts as a single point of reference for any functionality that has to be horizontally integrated. Indicative functionalities that are subjected to horizontal integration are Monitoring and Security.

Finally, the Governance Component is responsible for interacting with several underlying IaaS providers to start, stop, pause or delete workloads. This has to rely on an abstraction layer between the Orchestrator and the various Hypervisors. Since the risk of vendor-lock-in is high, the exploitation of Open Cloud Computing Interface (OCCI) interfaces is imperative[8]. OCCI is a set of specifications delivered through the Open Grid Forum for cloud computing service providers that provides a boundary API that acts as a service front-end to an IaaS provider's internal infrastructure management framework[9].

## 2.3 STRATEGIC Workload Metadata Model

Workloads are a key concept and capability in the STRATEGIC Cloud Orchestrator, and are designed to make it possible to manage not just simple (single server) apps, but also much more complex multi-tier applications, as found in the enterprise or distributed applications consisting of many distinct server elements.

The STRATEGIC Workload Metadata Model has been created in order to capture the semantics of any possible workload. The metadata model has several sections. The first section covers basic details about the `<Name>`, `<Version>`, `<License>` and `<Category>` of the application. These elements of the schema are indexable - instances of the model will be aggregated in a central repository in order for a customer (public body) to be able to search and deploy them.

The next section is a group of `<Informational>` elements. These elements are used for guiding the end-user through installation and support actions. Moreover, the `<SupportedOS>` element is intended to capture the compatible OS that can be used for installation. Additionally, the `<DeployMethod>` element is used to identify the target Cloud of the installation.

One of the most crucial parts is the `<ConfigurationParameters>` section where the entire configuration layer of the application is exposed and initialized. In parallel, the `<DeploymentDescriptor>` is used to capture the Installation scripts that are required in order to perform the systemic installation.

Finally, the `<ServerConfiguration>` element is used to model the post-installation part. The Puppet Framework has been used in order to automate the DevOps tasks. Puppet uses `<Recipes>` as the basic notion of orchestration-bundle. The Workload Metadata Model contains placeholders for Recipes[10].

The XSD schema is provided in the following figure:
<figure><img src="image_3.png" /><figcaption>Fig. 2. Workload Metadata Model</figcaption></figure>

## 3 STRATEGIC Pilot Scenarios Overview

STRATEGIC as a project has the vision to deliver the necessary cloud-enabled infrastructure, associated tools and services to governmental bodies that will let them migrate existing public services to the cloud and easily extend their portfolio of services offered to the public. To achieve this vision, three large European Municipalities (London Borough of Camden, City of Genoa and Municipality of Stari Grad) are contributing several services, and also providing realistic use cases for validation of STRATEGIC Cloud Orchestrator.

Table 1 provides a summary of the application and the expected usage of the STRATEGIC cloud orchestrator for each scenario.
<table><caption>**Table 1.** Usage of STRATEGIC cloud orchestrator from the applications of pilot use cases.</caption><thead><tr><td>Application Description</td><td>Usage of STRATEGIC cloud orchestrator</td><td>Involved Pilot</td></tr></thead><tbody><tr><td>Application for managing OpenData based on SharePoint.</td><td>Migration of existing SharePoint to Cloud with usage of STRATEGIC Cloud Orchestrator, publish on STRATEGIC Marketplace for reselling and deploy to selected IaaS</td><td>London Borough of Camden</td></tr><tr><td>Application for managing Citizen Blue-Badge information</td><td>Cloud Enable Application with usage of STRATEGIC Cloud Orchestrator, publish on STRATEGIC Marketplace for reselling and deploy to selected IaaS</td><td>London Borough of Camden</td></tr><tr><td>Application for managing user identity and their associated attributes in Camden.</td><td>Cloud Enable Application with usage of STRATEGIC Cloud Orchestrator and deploy to selected IaaS</td><td>London Borough of Camden</td></tr><tr><td>Service for business activities</td><td>Cloud Enable Application with usage of STRATEGIC Cloud Orchestrator and deploy to selected IaaS</td><td>City of Genoa</td></tr><tr><td>Cross-border authentication service for business activities, based on Stork project</td><td>Integrate Cross-Border features offered by STRATEGIC and deploy to selected IaaS</td><td>City of Genoa</td></tr><tr><td>Semiramis-based, cross-border authentication service for Cross-border issuance of resident certificate</td><td>Integrate Cross-Border features offered by STRATEGIC and deploy to selected IaaS</td><td>City of Genoa</td></tr><tr><td>Application for managing OpenData</td><td>Cloud Enable Application with usage of STRATEGIC Cloud Orchestrator, publish on STRATEGIC Marketplace for reselling and deploy to selected IaaS</td><td>City of Genoa</td></tr><tr><td>Certificate issuance service</td><td>Cloud Enable Application with usage of STRATEGIC Cloud Orchestrator, publish on STRATEGIC Marketplace for reselling and deploy to selected IaaS</td><td>Municipality of Stari Grad</td></tr><tr><td>Semiramis-based, cross-border certificate issuance service</td><td>Integrate Cross-Border features offered by STRATEGIC, publish on STRATEGIC Marketplace for reselling and deploy to selected IaaS</td><td>Municipality of Stari Grad</td></tr><tr><td>Mail server for Municipality of Stari Grad</td><td>Cloud Enable Application with usage of STRATEGIC Cloud Orchestrator, publish on STRATEGIC Marketplace for reselling and deploy to selected IaaS</td><td>Municipality of Stari Grad</td></tr><tr><td>Application for managing OpenData</td><td>Configure an application that is already published in STRATEGIC Marketplace and deploy to selected IaaS</td><td>Municipality of Stari Grad</td></tr></tbody></table>
## 4 STRATEGIC Cloud Orchestrator Value Proposition

The primary incentive for an organization/public body to adopt the STRATEGIC Cloud Orchestrator is to increase automation. The need to orchestrate really becomes clear when various aspects of cloud management are brought together. The value of adopting an orchestrator derives from the convergence of multiple hypervisors, the need for efficient resource usage, availability, scalability, performance and more. Through the STRATEGIC Marketplace, the pieces are woven together and can be managed more effectively to ensure smooth and rapid service delivery - and delivered in a user-friendly catalogue of services accessible through a single pane. In essence, STRATEGIC orchestration implies simultaneous speed of automation, ease of integration and clear adoption of best practices.

In addition to rapid service delivery, adoption of STRATEGIC Cloud Orchestrator and Marketplace can deliver significant cost savings by eliminating manual intervention and management of varied IT resources or services. Specific benefits include:

* Integration of cloud capabilities across heterogeneous environments and infrastructures to simplify, automate and optimize service deployment.

* Self-service portal for selection of cloud services, including storage and networking, from a predefined menu of offerings.

* Reduced need for intervention to allow lower ratio of administrators to physical and virtual servers.

* Automated high-scale provisioning and de-provisioning of resources with policy-based tools to manage virtual machine sprawl by reclaiming resources automatically.

* Ability to integrate workflows and approval chains across technology silos to improve collaboration and reduce delays.

* Real-time monitoring of physical and virtual cloud resources, as well as usage and accounting chargeback capabilities to track and optimize system usage.

* Pre-packaged automation templates and workflows for most common resource types to ease adoption of best practices and minimize transition time.

* Ability to create cross-Authentication applications and share them in a re-usable manner through an app-store.

In short, many of the capabilities that we associate with cloud computing are in essence elements of orchestration. Using the STRATEGIC cloud orchestrator, public bodies can manage their cloud workloads through a single interface, providing greater efficiency, control and scalability. As cloud environments become more complex and organizations seek greater benefit from their computing resources, the need for sophisticated management solutions that can orchestrate across the entire environment will become ever clearer.
## 5 Conclusion

The rationale of this paper is to provide an overview of STRATEGIC Cloud Orchestrator. For this reason a brief description of STRATEGIC project main goals and the identified requirements and desirable features of a Cloud Orchestrator are provided. For the conception of STRATEGIC Cloud Orchestrator, the high level architecture and component overview has been briefly described, along with the proposed Workload Metadata Model. Finally the pilot use cases overview and the value proposition of the STRATEGIC Cloud Orchestrator are provided.

## 6 Acknowledgments

The work performed in this paper is funded by the Strategic CIP-PSP Project (http://www.strategic-project.eu).

## References

1. www.enisa.europa.eu: Good Practice Guide for securely deploying Governmental Clouds, 2013

2. Optimis project consortium: Optimis project Website, www.optimis-project.eu, Retrieved electronically on January 2015

3. Stork project consortium: Stork Project Website, https://www.eid-stork.eu/, Retrieved electronically on January 2015

4. Semiramis project consortium: Semiramis Project Website, http://www-semiramis-cip.eu/index.html, Retrieved electronically on January 2015

5. IBM: IBM Cloud Orchestrator, http://www-03.ibm.com/software/products/en/ibm-cloud-orchestrator, Retrieved electronically on January 2015

6. STRATEGIC project consortium: Description of Work of “STRATEGIC: Service distribution network And Tools for intEroperable proGrammable, and UnIfied public Cloud services”, 2014

7. STRATEGIC project consortium: D2.1 Report on Stakeholders Requirements, 2014

8. STRATEGIC project consortium: D2.3 Strategic Framework Architecture Technical Specifications, 2014

9. OCCI Community: The Open Cloud Computing Interface Website, http://occi-wg.org/, Retrieved electronically on January 2015

10. STRATEGIC project consortium: D3.1 Specification of Cloud-Enablement and Migration Solutions and Services, 2014