ISOD BCP Document
Discussion and Recommendations
OGF 36, October 8-10, 2012, Chicago, USA
Yuri Demchenko, UvA
Chin Guok, ESnet© 2006 Open Grid ForumOutline• BCP document overview andsuggestions• Discussion on remaining issues andpossible next steps© 2006 Open Grid Forum

2

OGF BCP Document TOC
On-Demand Infrastructure Services Provisioning Best
Practices
1.
2.
3.
4.
5.
6.
7.
8.

Introduction
Infrastructure Services definition
Network Resources Provisioning Systems (NRPS)
General and Cloud Oriented Network Infrastructure Services
Provisioning
Provisioning Infrastructure services in CloudsExisting Standards
Existing Cloud Middleware for Infrastructure Services Provisioning
Summary50 pages
Contributors: 16 from 10 organisations© 2006 Open Grid Forum3

Contributors
Editor: Chin Guok (ESnet)

Scott Campbell (CRC)
Tangui Coulouarn (Forksningsnettet)
Yuri Demchenko (Univ. of Amsterdam)
Freek Dijkstra (SARA)
Michal Giertych (PSNC)
Joan Antoni Garcia-Espin (i2CAT)
Eduard Grasa (i2Cat)
Chin Guok (ESnet)
Jeroen van der Ham (UvA)
Radek Krzywania (PSNC)
Tomohiro Kudoh (AIST)
Mathieu Lemay (Inocybe Technologies)
Atsuko Takefusa (AIST)
Alexander Willner (Univ. of Bonn)
Yufeng Xin (RENCI)© 2006 Open Grid Forum

4

OGF BCP Document Overview (1)1. Introduction
2. Infrastructure Services definition
2.1 General Infrastructure Definition
2.2 Infrastructure services definition in the context of this document
3. Network Resources Provisioning Systems (NRPS)
3.1 Argia
3.2 AutoBAHN
3.3 G-lambda and GridARS
3.4 OSCARS© 2006 Open Grid Forum5

ArgiaSets up and tears down preconfigured
fixed topologies in an APN

Implements the remote workspace,persisting the RMC files

Rich Client that allows infrastructureproviders to partition their infrastructure
and infrastructure integrators to leaseand use it

GUI Resource
DB WS

APN Scenarios WS

Manage user accounts, get user
credentials, authenticate

GUI client(s)Connection WS

Responsible for creating end to end connections(can be one to one, one to many and loopback)

Ethernet
Resource
WS
Transforms the highlevel operations overone or more network
resources into specificcommands that eachparticular opticalswitch device canunderstandUser Workspace
WSTDM
Resource
WSWDM
ResourceWS• Argia is an IaaS
framework forprovisioning
optical network
infratsructuresas a cloud IaaS

FibreResourceWS

Optical Switch WS

Device Partition Resources
Represent a partition of a network element (Ethernetports, VLANs, TDM Channels, WDM wavelengths,Fibre ports)

IaaS Engine
TL1

Nortel OME 6500

TL1

...

Cisco ONS 15454

Byte protocol

Wonesys Proteus• Argia is the evolution of the UCLP CE software•Ongoing effort towards creating a commercial product that can be deployedin production optical networks.

© 2006 Open Grid Forum6

AutoBANH•••

AutoBAHN is the GÉANT
Bandwidth on Demand(BoD) Service for NREN’s
AutoBHAN isimplementing the OGF
NSI CS protocol to support
wider interoperability andintegration

Ongoing development to include enhanced functionality: advanced user
authorisation, new technologies and vendors support, accounting, resiliency© 2006 Open Grid Forum7

G-Lambda and GridARS••

G-lambda project is acollaboration between
Japan’s industrial andgovernmentallaboratories, KDDI
R&D Laboratories,
NTT, NICT and AIST

Defines a Web service-based network service interface GNS-WSI (GridNetwork Service - Web Service Interface) that allows requesting endto-end bandwidth-guaranteed connections© 2006 Open Grid Forum8OSCARS - On-demand Secure Circuitsand Advance Reservation System•

Defines a Web service-based network service interface GNS-WSI (GridNetwork Service - Web Service Interface) that allows requesting endto-end bandwidth-guaranteed connections© 2006 Open Grid Forum9

OGF BCP Document Overview (2)4. General and Cloud Oriented Network Infrastructure Services
Provisioning
4.1 GENI-ORCA: A Networked Cloud Operating System for Extended
Infrastructure-as-a-Service (IaaS)
4.1.1 ORCA Architecture and Information Model
4.1.2 NDL-OWL: Ontology-Based Cloud Resource Representation
4.1.3 IaaS Service Interface for Infrastructure Control
4.1.4 Cross-aggregate Stitching

4.2 GEYSERS Generalised Infrastructure Services Provisioning
4.2.1 GEYSERS Architecture
4.2.2 Physical Infrastructure
4.2.3 Logical Infrastructure Composition Layer (LICL)
4.2.4 Network + IT Control Plane (NCP+)

4.3 OpenNaaS: An Open Framework for Networking as a Service© 2006 Open Grid Forum

10

GENI-ORCA••••

ORCA is one of theGENI Control
Frameworks
ORCA can be
regarded as anoperating system fororchestrated
provisioning ofheterogeneous
resources acrossmultiple federated
substrate sites anddomains

ORCA uses NDL-OWL: Ontology-Based Cloud Resource Representation as a setof uniﬁed semantic schemas (ontologies) for representing resources data models
NDL-OWL developed as an extension of the Network Description Language (NDL)© 2006 Open Grid Forum11

GEYSERS Generalised Infrastructure
Services Provisioning•

Service Consumer

Service Middleware Layer (SML)
Virtual IT Management (VITM)

Logical Infrastructure
Composition Layer (LICL)

IT-aware Network Control Plane (NCP+)

Inter-layer
communication

Virtual Infrastructure
Virtual IT nodecontroller

Virtual Resource Pool

Virtual Network nodecontroller
Virtual IT resource
Physical ITresource

Virtual Network resource•GEYSERSarchitecture requalifies theinterworking of legacy
planes by means of avirtual infrastructure
representation layer for
network and IT
resources
Introduces advanced
resource provisioning
mechanisms

Physical Network
resource

Physical Infrastructure••

Logical Infrastructure Composition Layer (LICL) allows creation and maintenance ofvirtual resources as well as virtual infrastructures
Network + IT Control Plane (NCP+) operates over a virtual infrastructure, composedof virtual optical network and IT resources, located at the network edges© 2006 Open Grid Forum

12

OpenNaaS••••© 2006 Open Grid Forum13OpenNaaS offers aversatile toolset for the
deployment of NaaS
oriented services
Virtualise network
components: routers,switches, links orprovisioning systems
Delegate management
permissions over theinfrastructure resources
At tool for infrastructure
integrators

OGF BCP Document Overview (2a)3. Network Resources Provisioning Systems (NRPS)
3.1 Argia
3.2 AutoBAHN
3.3 G-lambda and GridARS
3.4 OSCARS
4. General and Cloud Oriented Network Infrastructure Services
Provisioning
4.1 GENI-ORCA: A Networked Cloud Operating System for Extended
Infrastructure-as-a-Service (IaaS)
4.2 GEYSERS Generalised Infrastructure Services Provisioning
4.3 OpenNaaS: An Open Framework for Networking as a Service
Recommendation:
Provide short, once sentence definition of the system/tool© 2006 Open Grid Forum14

OGF BCP Document Overview (3)5. Provisioning infrastructure services in Clouds
5.1. Amazon Web Services (AWS)
5.1.3 Network and IP Addresses Management in AWS• Elastic IP address, a public IP address associated with user's EC2account•

A user can associate this IP address to any particular EC2 instance rentedwith that account• Intelligent DNS based load balancing for applications using Amazon
Route 53 DNS service and Latency Based Routing (LBR)•To route application users to AWS end-points (EC2 instance) which have thebest performance

5.2 RackSpace
5.2.2 RackSpace Network Service• No specific service to control network performance or topology• Instead RackSpace provides an advanced internal network
infrastructure with dedicated links and advanced network management© 2006 Open Grid Forum

15

OGF BCP Document Overview (4)6. Existing infrastructure related standards
6.1 NIST Cloud Computing related standards
6.2 IEEE Intercloud Working Group (IEEE P2302)
6.3 IETF Reference Cloud Framework
6.3.2 Cloud Reference Framework
6.3.3 Cloud Service Broker

6.4 ITU-T Focus Group Cloud Computing
6.5 Related activities at OGF
6.5.1 OCCI – Open Cloud Computing Interface
6.5.2 Network Service Interface Working Group (NSI-WG)
6.5.3 Network Markup Language Working Group (NML-WG)© 2006 Open Grid Forum

16

NIST Cloud Computing Reference
Architecture (CCRA) 2.0 (1)• txt© 2006 Open Grid Forum

17

NIST Cloud Computing Reference
Architecture (CCRA) 2.0 - Main Roles (1)• Cloud Carrier as a role to accommodate telecom companies interest© 2006 Open Grid Forum18

IETF I-Draft “Cloud Reference Framework”(Version 0.3, 29 June 2012)
http://tools.ietf.org/html/draft-khasnabish-cloud-reference-framework-03.txt
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 4
2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 5
3. Cloud Services Reference Model . . . . . . . . . . . . . . . 6
3.1. HORIZONTAL LAYERS . . . . . . . . . . . . . . . . . . . . 73.1.1. Application/Service Layer . . . . . . . . . . . . . . 73.1.2. Resources Control Layer . . . . . . . . . . . . . . . 83.1.3. Resources Abstraction and Virtualization Layer . . . . 93.1.4. Physical Resources Layer . . . . . . . . . . . . . . . 10
3.2. VERTICAL LAYERS (planes?) . . . . . . . . . . . . . . . . 103.2.1. Cloud Management Layer . . . . . . . . . . . . . . . . 104. Inter-Cloud Framework . . . . . . . . . . . . . . . . . . . . 17
4.1. Inter-Cloud Requirements . . . . . . . . . . . . . . . . . 17
4.2. Intercloud Framework Components
4.3. Intercloud Control and Management Plane (ICCMP)
4.4. Intercloud Federation Framework (ICFF)
4.5. Intercloud Operation Framework (ICOF)
5. Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . 19
5.1. Virtual Network Management . . . . . . . . . . . . . . . . 19
5.2. Telecom Network Virtualization . . . . . . . . . . . . . . 19
5.3. Virtual Data Center . . . . . . . . . . . . . . . . . . . 21
5.4. Security infrastructure for on-demand provisioned
cloud-based services/infrastructures
6. Security Framework for Clouds . . . . . . . . . . . . . . . . 22
7. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . 24
8. Security Considerations . . . . . . . . . . . . . . . . . . . 25
9. Acknowledgement . . . . . . . . . . . . . . . . . . . . . . . 26
10. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 27
12. Normative references . . . . . . . . . . . . . . . . . . . . . 28
© 2006 Open Grid Forum

B. Khasnabish(ZTE USA)
J. ChuS. Ma
Y. Meng(ZTE)
N. So(Verizon)
P. Unbehagen
Avaya
M. Morrow(Cisco Systems
Switzerland)
M. Hasan(Cisco Systems)
Y.Demchenko
University ofAmsterdam

Version 0.3 – 29 June 2012
Version 0.4 – End July 2012
Version 0.5 – October 2012
(To be considered)19InterCloud Architecture components• Multi-layer Cloud Services Model (CSM)••

Combines IaaS, PaaS, SaaS into multi-layer model with inter-layer interfaces
Including interfaces definition between cloud service layers and virtualisationplatform• InterCloud Control and Management Plane (ICCMP)••

Allows signaling, monitoring, dynamic configuration and synchronisation of thedistributed heterogeneous clouds
Including management interface from applications to network infrastructure andvirtualisation platform• InterCloud Federation Framework (ICFF)•••

Defines set of protocols and mechanisms to ensure heterogeneous cloudsintegration at service and business level
Addresses Identity Federation, federated network access, etc.

InterCloud Operations Framework (ICOF)•RORA model: Resource, Ownership, Role, Action••

RORA model provides basis for business processes definition, SLA and access control

Broker and federation operation© 2006 Open Grid Forum

20

Multilayer Cloud Services Model (CSM)
Compose into one Cloud Services layer

CSM layers
Layer C7
User
Client/ Application

User Applications

Security InfrastructureManagement

IaaS

Layer C6
Cloud Applications(SaaS)SaaS

PaaS

SaaS-PaaS IF
Layer C5
Cloud Platform(PaaS)

PaaS-IaaS Interface
IaaS – Virtualisation Platform Interface

Cloud Management
Software(Functional Definition Proposed)

Cloud Management Software/Platforms
OpenNebulaOpenStack

Virtualisation PlatformKVM

VM

VM

OtherCMS

XEN

VMWareNetwork
Virt

Proxy (adaptors/containers) - Component Services and Resources
StorageResources

ComputeResources

Network
Infrastructure
Hardware/Physical Resources© 2006 Open Grid Forum

VPN

Layer C4
Cloud
Infrastructure(IaaS)
Layer C3
Virtual Resources
Composition andControl(Orchestration)(C7) User Client/Application(C6) Cloud Application(SaaS)(C5) Cloud Platform (PaaS)(C4) Cloud Infrastructure(IaaS)(C3) Virtual Resources
Composition andOrchestration(C2) Virtualisation Layer(C1) Hardware platform anddedicated network
infrastructure

Layer C2
Virtualisation

Layer C1
PhysicalHardware
Platform andNetwork

Control/
Mngnt Links

Data Links

Intercloud Control and Management
Plane (ICCMP) (1)
IaaS Domain

Cloud Layers
Layer 7 - Applications

User
definedPlatformandSW&Apps

InterCloud Control andManagement Plane(ICCMP)

Layer 6 – SaaS/Apps
Layer 5 - PaaS
Cloud based Platform

PaaS Domain
Userdefined
SW&Apps
Layer 4 - PaaS

Layer 4 - IaaSCloud Infrastructure

Layer 3 - IaaS

ProviderdefinedInfrastr.
andVirt&OS
Platform

Layer 3 – Composition

Campus A

Providerdefined
Virt&OS
Platform

Visualisation

Layer 2 - Virtualisation

Visualisation

Layer 1 - Physical
HW Platform/NetworkCE

User
Group A

Campus B

CE

User
User
User

User
User
User
VR6

Cloud 2 PaaS

VR2

User
Group B

VR7
VR4

VR1

VR5

Resource/
Service
ProviderVR3Enterprise/Project basedIntercloud Infrastructure

Cloud 1 IaaS

Resource/
ServiceProvider
CN

CN
CN

CN
CN

CN

Cloud PaaS Provider

CNCN

CN

CN
CN

Cloud IaaS Provider© 2006 Open Grid Forum

22Intercloud Control and Management
Plane (ICCMP) (2)IaaS Domain

Cloud Layers
Layer 7 – Applications
User defined Applications

User defined
Platform
andSW&Apps

Layer 6 – SaaS/Apps
Cloud based Apps/Software
Layer 5 - PaaS
Cloud based Platform

Layer 4 - IaaS

Layer 4 - IaaS
Cloud Infrastructure

IaaS Mware
ProviderdefinedOS&VirtPlatform

Layer 3 - Composition
Virtual Resources Composition
Layer 2 - Virtualisation
Resources Abstraction andVirtualisation

PaaS Domain

User defined
SW&Apps

Layer 5 - PaaS
PaaS Mware

ProviderdefinedInfrastructureandOS&Virt
Platform

Layer 1 - Physical
HW Platform/Network

InterCloud Control and Management Plane (ICCMP)
Standard Interface© 2006 Open Grid ForumNon-standard/proprietary Interface

23

OGF BCP Document Overview (5)7. Existing Cloud Middleware for Infrastructure Services
Provisioning
7.1 OpenNebula
7.1.1 Network Management in OpenNebula
7.1.2 Load-balancing in OpenNebula

7.2 OpenStack
7.2.1 Network management in OpenStack
7.2.2 Load Balancing in OpenStack

7.3 Eucalyptus
7.3.1 Network Management in Eucalyptus
7.3.2 Load-balancing in Eucalyptus© 2006 Open Grid Forum24

Network Management in OpenNebula• OpenNebula manages network connections for its virtualmachines by means of virtual networks• VN consists of a separate set or range of MAC/IP addresses
which can be assigned to a new virtual machine instance• This network is associated with a physical network using a networkbridge• Simulate to EC2, the OpenNebula can attach each VM to both aprivate network with no Internet connectivity and a public networkwith Internet connectivity• This gives each virtual machine instance one public and one private
IP address© 2006 Open Grid Forum25

Network Management in OpenStack••New OpenStack release Folsom added Quantum Network mngnt component
Quantum/Nova logically supports two types of IP address:•••

Quantum/Nova network models supported for fixed IPs••••••Flat mode: each VM instance with a fixed IP is associated with a default network bridge
Flat DHCP mode: additionally a DHCP server is provided to manage fixed IPs
VLAN DHCP Mode (default networking mode): VLAN is created and bridged for each project

The Quantum network manager adds the following new functionalities
API to build rich networking topologies, and configure advanced network
policies in the cloud; e.g. create multi-tier web application topology
Allows adding new plugins (open and closed source) e.g.
••

Fixed associates fixed IP with VM at creation and remain associated till termination
Floating can be dynamically attached/detached IP to/from a running VM at run-time

Use L2-in-L3 tunneling to avoid VLAN limits, provide end-to-end QoS guarantees,used monitoring protocols like NetFlow

Allows building advanced network services (open and closed source) that plug
into Openstack tenant networks e.g.
•VPN-aaS, firewall-aaS, IDS-aaS, data-center-interconnect-aaS.
© 2006 Open Grid Forum

26

ISOD-RG: Remaining issues
and possible next steps• ISOD-RG Charter: Deliverables andtimeline• Next steps with the current document• Possible extensions and spin-off’s• New document on ISOD case study© 2006 Open Grid Forum

27

ISOD RG Deliverbles• Deliverable 1,2 - BCP/taxonomy in existing and on-demand
resources/services provisioning technologies• Including existing Network Resource Provisioning Systems (NRPS) systems
and virtualisation platforms• Including definition of basic terms in infrastructure services• Use cases for On-demand Infrastructure Services provisioning• Deliverable 3 - Requirements to On-demand Infrastructure Servicesprovisioning• Delivered in two deliverables as an initial requirements set and updated
based on the feedback from contributing projects and activities Expected
deliverables (to be reviewed depending on the progress and communityinterest)• Deliverable 4 – Generic Infrastructure as a Service (IaaS) provisioningmodel• Deliverable 5 – Services Lifecycle Management in On-demand
Infrastructure Services provisioning (overview existing frameworks andpractices)© 2006 Open Grid Forum28

ISOD RG Timetable• OGF 31 (Winter/Spring 2010)• Official start of working group• Outline and author list of deliverables• OGF 32 - OGF33 (Summer - Autumn 2011)• First draft of Deliverable 1/2• OGF 34 (Winter/Spring 2012)• Feedback and discussion on Deliverables• Review drafts of Deliverable 1/2• OGF 35 (Summer 2012)• Submission of Deliverable 1/2• Feedback and discussion on Deliverables 1/2, 3• First draft and discussion of Deliverable 4 and/or 5 (depending on
progress with other deliverables)• OGF 36 (Autumn 2012)••••

Review draft and submit Deliverable 1/2
Submission of Deliverable 3Feedback and discussion on Deliverables 4, 5
29
Overall RG progress review andnext plans© 2006 Open Grid ForumOGF BCP Document:
Possible extensions and spin-off’s
1.
2.
3.
4.

Introduction
Infrastructure Services definition
Network Resources Provisioning Systems (NRPS)
General and Cloud Oriented Network Infrastructure Services
Provisioning
5. Provisioning Infrastructure services in Clouds
6. Existing Standards -> Standardisation Overview (Cloud and Network)
7. Existing Cloud Middleware for Infrastructure Services Provisioning
8. Taxonomy and Analysis -> ISOD case study with existing middleware
9. Recommendations -> Based on case study
10. Summary© 2006 Open Grid Forum

30

ISOD case study onInfrastructure Services provisioning• New deliverable “Infrastructure Services provisioning
with existing middleware”• Will include deeper analysis of the major Cloud
middleware: Amazon, OpenStack, OpenNebula• Testbed and experimentation• E.g. at high performance network and cloud testbed atSNE/UvA• Projects, e.g. GEYSERS, GEANT, Helix-Nebula• Contact with and involvement of related developergroups© 2006 Open Grid Forum

31

Discussion• Any other topics and ideas© 2006 Open Grid Forum32

Infrastructure Services definition• Infrastructure definition in the context of Cloud based andgeneral virtualised services, in addition to standard IT
infrastructure, should include such components as••

Virtual Machines (VM), Storage, Utilities, Network
Global distributed centers by Cloud providers• Cloud infrastructure may be multi-layer, including••Internal Cloud provider infrastructure which is provided as a services, andExternal or inter-Cloud infrastructure that can be provided by either Cloud
operator/integrator or network services provider• The provisioned infrastructure services must be characterizedand include the following features:•••

Topology definition for infrastructure services that encompass compute,storage, and network resources
Infrastructure/topology description formats or schemas
Related topology features or characteristics, and transformation operations(homomorphic, isomorphic, QoS, energy aware etc.)© 2006 Open Grid Forum