# Presentation: 763324

## Circuit-switched High-speed End-to-End Transport ArcHitecture (CHEETAH) Roadmap version number: ONT2Sept. 12, 2005

- Malathi Veeraraghavan, UVA
- Ibrahim Habib, CUNY
- Nagi Rao, Bill Wing, Tony Mezzacappa, ORNL
- John Blondin, NCSU

- CHEETAH ONT2 09/06/05

## Outline

- What is CHEETAH?
- Status of CHEETAH
- Today
- End of 2005
- End of 2006 (project ends)
- Roadmap
- Optical Services
- Optical Technologies
- Interoperability Capabilities
- Key themes and research issues

- CHEETAH ONT2

- 09/06/05

## What is CHEETAH

- A shared circuit-switched network to complement connectionless IP service
- establish, use & release, rate-guaranteed (from 10 Mbps to 1 Gbps) host-to-host circuits.
- support TSI (Terascale Supernova Initiative) applications.
- large file transfers
- remote visualization
- remote computational steering
- leverage equipment that supports protocols for the creation of distributed (large-scale) shared circuit-switched networks (SN 16K with EoS data plane and GMPLS control plane).
- Distributed Control Plane (GMPLS) supporting overlay GMPLS and Peer models.
- End hosts with two Ethernet NICs each
- Primary NIC connected to the enterprise LAN/Internet
- Secondary NIC connected to CHEETAH network node.
- C-VLSR software to extend connection-oriented to non-GMPLS devices (based upon the VLSR of DRAGON team).
- Routing decision: when to use CHEETAH for file transfers.
- Optical Connectivity Service (OCS): Obtain remote host’s CHEETAH availability information and MAC address.
- Transport Protocol: FRTP.
- Main Premise: **Dynamic Bandwidth Sharing **among many users.
- Extend solution
- to a connection-oriented internet (e.g., VoD), grid computing, heterogeneous connections.
- to partial connections (impt.: setup triggered from end hosts).

- CHEETAH ONT2

- 09/06/05

## CHEETAH Network (data-plane)September 05

- Cisco
- 7600
- switch

- 1G

- Compute-0-4

- Orbitty Compute Nodes

- 1G

- OC192

- OC192

- GbE

- 1-8-33

- 1-8-34

- 1-8-35

- 1-8-36

- 1-6-1

- 1-6-17

- 1-8-37

- Cisco
- 7600
- switch

- H

- H

- H

- H

- H

- 1G

- 1G

- 1G

- 1G

- 1-7-1

- Compute-0-3

- Compute-0-2

- Compute-0-1

- Compute-0-0

- 1G

- 1G

- 1G

- 1G

- wukong

- H

- 1G

- 1-8-38

- 1-7-17

- cheetah-nc

- 5x1Gbps VLAN

- OC192

- 1-6-1

- 1-6-17

- 10GbE

- 1-7-1

- GbE

- 1-7-33

- 1-7-34

- 1-7-35

- 1-7-36

- 1-7-37

- 1-7-38

- 1-7-39

- 1G

- Zelda1

- H

- H

- H

- 1G

- 1G

- Zelda2

- Zelda3

- 1G

- 1G

- Zelda4

- H

- H

- Zelda5

- 2x1Gbps
- MPLS tunnels

- 1G

- 1G

- Cheetah-atlanta

- OC-192 lamda

- 10GbE

- GbE

- 1-7-33

- 1-7-34

- 1-7-35

- 1-7-36

- Cheetah-ornl

- 1-7-1

- 1-6-1

- OC192

- X1(E)

- UCNS

- 1GFC

- 1G

- 1G

- Juniper
- 320
- router

- Juniper
- 320
- router

- 1G

- 1G

- Force10
- E300
- switch

- ORNL

- Atlanta

- NC

- Direct fibers

- VLANs

- MPLS tunnels

- 1Gbps VLAN

- G. Tech

- Ethernet
- switch

**Hosts**

- 1 GbE

- CHEETAH ONT2

- 09/06/05

## CHEETAH Data Plane Evolution Roadmap

- 1 GbE

- CHEETAH Data Plane Evolution Roadmap

- Raleigh PoP
- (MCNC)
- (Sycamore SN16000)

- Atlanta PoP
- (SoX/SLR)
- (Sycamore SN16000)

- 5 GbEs

- NCSU

- Duke

- 1 GbE

- OC192

- G. Tech

- Dragon

- UVA

- CUNY

- McLean PoP

- Via HOPI

- End of 2005

- End of 2006

- Beyond 2006

- NASA

- ORNL

- To Ultra-Science Net

- MPLS
- Via Abielene

- OC192

- 32 AoA  NY PoP

- International
- networks

- 2 GBE Via Vortex

- 1 GBE via NYSERnet

- New Users

- New Users

- CHEETAH ONT2

- 09/06/05

## CHEETAH Control Plane  - Phase I, as of Sept. 2005

- Out of band signaling through Internet (secured by IPsec tunnels set up by Juniper NS5XT firewall and OpenSwan open source IPsec software).
- IETF GMPLS Overlay model is adopted.
- End hosts run only RSVP (apps. signal SN16K nodes)
- TE links are configured directly between end-host and SN16k.
- BroafLeaf routing (OSPF based) and signaling are used between SN16K nodes.
- Virtual-TE link is configured between SN16ks providing logical adjacencies for the SN16ks that physically host UNI attached client devices (only connectivity information is provided).
- FSC for 1-Gbps EoS circuit setup.

- CHEETAH ONT2

- 09/06/05

## CHEETAH Control Plane  - Phase I, as of Sept. 2005

- 16kA

- 16kB

- BroadLeaf

- Ethernet
- Switch B

- Ethernet
- Switch A

- Super
- computer

- Other
- computers

**TE Link**

- {

- {

**TE Link**

- {

- {

- UNI

- Virtual TE-link

- UNI

- ...

- CHEETAH ONT2

- 09/06/05

## CHEETAH Control Plane - Phase I, as of Sept. 2005 (signaling)

- RSVPD

- bwrequestor

- Application

- bwLib

- bwmgr

- OCS

- CAC

- To edge switch

-   End host initiates path setup

- CHEETAH ONT2

- 09/06/05

## Interaction with SN16KSept. 05 (signaling)

- SN16000

- GbE

- ControlCard

- OC192

- SN16000

- GbE

- ControlCard

- OC192

- RSVP-TE Path

- RSVP-TE Path

- RSVP-TE Path

- BroadLeaf Message

- RSVP-TE Resv

- CHEETAH ONT2

- 09/06/05

## CHEETAH Control Plane - Phase II, at end of 2005

- IETF GMPLS Overlay model is still adopted.
- FSC for 1-Giga EoS circuit setup
- CHEETAH Virtual Label Switch Router (CVLSR)  will be deployed between end-hosts and SN16k.
- CHEETAH Virtual Label Switch Router (CVLSR) is based upon the RSVP-TE Kom and VLSR of Dragon team
- Add VLAN support.
- Add hop-by-hop routing.
- Add Cluster management and rate-limiting functions for cluster members.

- CHEETAH ONT2

- 09/06/05

## CHEETAH Control Plane Evolvement - Phase II, at end of 2005

- 16kA

- 16kB

- BroadLeaf

- VLAN
- Group

- Ethernet
- Switch B

- Ethernet
- Switch A

- Super
- computer

- Other
- computers

**TE Link**

- {

- {

**TE Link**

- {

- {

**TE Links**

- {

- {

**TE Link**

- {

- {

- CVLSR

- CVLSR

- Virtual TE-link

- UNI

- UNI

- CHEETAH ONT2

- 09/06/05

## CHEETAH Control Plane  - Phase III, at end of 2006

- Both IETF GMPLS Overlay model and Peer model will be supported.
- OSPF-TE is deployed within Sycamore cloud to provide both connectivity and bandwidth information.
- More capabilities will be added to CVLSR
- L2SC support (for sub-1Gbps circuit setup)
- Inter-domain routing
- Heterogeneous path setup in multi-region and multi-layer networks.

- CHEETAH ONT2

- 09/06/05

## CHEETAH Control Plane Evolvement - Phase III, at end of 2006

-  **GMPLS Peer Model**

- 16kA

- 16kB

- OSPF-TE

- VLAN
- Group

- Ethernet
- Switch B

- Ethernet
- Switch A

- Super
- computer

- Other
- computers

**TE Link**

- {

- {

**TE Link**

- {

- {

**TE Links**

- {

- {

**TE Link**

- {

- {

- CVLSR

- CVLSR

- TE-link

- CHEETAH ONT2

- 09/06/05

## 1 Gbps FSC end-to-end (with hosts directly connected to the SN16ks in Atlanta and MCNC) EOS circuits have been provisioned through control plane initiated by end host RSVP-TE client.
1 GbE between CCNY and 32 AoA PoP is ready. 
End host file transfer software using FRTP for CHEETAH application is tested.
OSPF adjacency was successfully brought up between CVLSR and SN16k, and TE-link state database was built in CVLSR.
RSVP signaling (endhost-CVLSR-SN16k-SN16k-CVLSR-endhost) before end of Sept. 05

- 1 GbE between CCNY and 32 AoA PoP is ready.
- End host file transfer software using FRTP for CHEETAH application is tested.
- OSPF adjacency was successfully brought up between CVLSR and SN16k, and TE-link state database was built in CVLSR.
- RSVP signaling (endhost-CVLSR-SN16k-SN16k-CVLSR-endhost) before end of Sept. 05

- Work and Test Status (as of Sept. 2005)

- CHEETAH ONT2

- 09/06/05

## Roadmap – Optical Services

- Dedicated lightpaths
- Dynamic lightpath allocation
- TDM mux/demux
- Highly Granulated Optical Subchanneling
- Distributed Control
- Encapsulation Support
- Application Control Signaling
- SONET Switching
- Attribute-Based Lightpath selection

- 2005     2006     2007     2008     2009     2010

- Forecast for future

- Project
- ends

- CHEETAH ONT2

- 09/06/05

## Roadmap – Optical Technologies

- GMPLS
- Distributed Control Systems

- 2005     2006     2007     2008     2009     2010

- Forecast for future

- DWDM and CWDM

- OADM, ROADM

- Optical Packet Switches

- Project
- ends

- CHEETAH ONT2

- 09/06/05

## Roadmap – Interoperability Capabilities

- 2005     2006     2007     2008     2009     2010

- Multiple Region and Layers Connection Setup

- Inter-networks Routing and Signaling
- (CHEETAH, HOPI, DRAGON, NASA, ..others)

- Inter-networks Traffic Engineering

- Control Plane Security

- Services Management (e.g., accounting, policy)

- Forecast for future

- Project
- ends

- CHEETAH ONT2

- 09/06/05

## Key Themes and Issues 

- Connecting with other networks:
- HOPI, DRAGON, Ultra-Science Net, NASA and inter-national networks
- Add new users and applications:
- Remote visualization, Grid-computing, Web-download
- Inter-domain routing
- Heterogeneous path setup in multi-region and multi-layer networks (nested, stitched, contiguous LSP signaling)
- End host transport protocol and signaling engine
- Control plane security
- Scalability (distributed approaches)

- CHEETAH ONT2

- 09/06/05

## Key Research

- Decision on initiating CHEETAH circuit set-up
- CAC and Bandwidth sharing modes:
- Scheduled vs. immediate-request
- Long vs. short durations
- Granularities of calls
- Varying bandwidth rates
- Inter-domain Routing.
- Inter-domain Traffic engineering.

- CHEETAH ONT2

- 09/06/05

## CHEETAH NETWORK 

**Centaur Lab** (900 Main Campus Drive)

- 15454

- 7600

**CMDF** (Main Campus Dr.)

**MCNC** (Building3)

- 15454

- 10G Ethernet
- Switch

- 1G

- ....

- SN16k

- EbE card

- 1-port OC-192

**NLR PoP RAL**

- 15454

- 15808

**NLR Pop ATL** (345 Courtland Street)

- 15808

- Movaz
- Ray Express

**SOX** (56 Marietta Street)

**ORNL**

- CVLSR

- 1G

- GbE

- 1G

- unet1

- 10G Ethernet
- switch

- To Ultra-Science network

- To DC – Dragon

- ORNL
- Gateway

- Firewall

- GbE
- Switch

- Dell
- 2650

- Cray X1
- Phoenix

- HPSS

- GbE
- Switch

- Dell
- 2650

- Dell
- 2650

- Dell
- 2650

- Fiber channel
- switch

- Dell
- 2650

- OC192

- TSILAN

- 10G Ethernet Switch

- Centaur
- GSR

- CMDF
- 15200

- Ra
- 15200

- Ra/GW1
- Downtown GSR
- (quest POP)

- NCNI/
- NCREN

- Abilene

- NCSU campus

- John's
- viz cluster

- OC48

- OC48

- OC48

- OC48

- GbE

- 10GbE

- 100Mbps

- GbE

- Orbitty

- NIC

- 6

- 2

- 1

- NIC

- 10/100M

- CVLSR

**UVA**

- Summit4

- GbE

- 100M

- CVLSR

- MSPP

- 15454

- H 1

- H n

- 100M

- 1GbE

- CHEETAH

- circuit

- Transparent (not controllable)

- New Lambda

- Cheetah Test Host

- DWSM

- OC-192

- Departure Drive

- FESX424

- GbE

- 100M

- CVLSR/AAA server

- MSPP

- 15454

- H 1

- H n

- 100M

- Steinman Hall

- Shepard Hall

- 1GbE fiber

- MSTP

- 15454

**CCNY** (141th St. & Covent Ave)

**NYSERNET POP**
- Convent Ave &138 St.

- 555 West 57th St
- NYSERNET

- Cisco

- Cisco

- 32 Ave.

**CHEETAH NETWORK **

- 5 1-GbE VLANs

- H

- H

- H

- ...

- CVLSR

- HOPI

- Abilene

- New E-series card

- HOPI

- Ciena
- CoreStream

- Ciena
- CoreStream

- SN16k

- SN16k

- H

- H

- H

- Movaz
- Ray
- Express

- Juniper
- E300
- Router

- 2x1GbE
- MPLS tunnels

- 1G

- Juniper
- E300
- Router

- MPLS tunnel

## Hosts

**Ultranet**

**Dynamically**
**Provisioned **
**Ultranet Paths**
**Via Network Management**

**ORNL**
**Super**
**computer**

**Hosts**

**Ultranet **
**SONETXC**** **

** ****Dragon Nodes (MIT Observ, others)**

**Dragon network**
**Dynamic provisioning**
**Via GMPLS**

**GSFC with**
**VLSR**
**Maryland GSFC**

**GSFC 10 GE**
**With VLSR**

**HOPI 10GE **
**With VLSR**

**HOPI 10 GBE**
** ****with VLSR**
**In New York **

**SONET XC**
**S1 (at Atlanta)**

**SONET XC**
**S2 (at MCNC)**

**Ames Router**

**JPL**

**Columbia**
**Project**

**Other nodes**

**NLR in **
**Sunnyvale**

**Ultranet nodes**

**Dynamic Provisioning in**
**Cheetah network via GMPLS control plane **

**USC-SIO**

**Statically  provisioned**
**Links at 1 GBE each**

**Other networks**
**(OPTIPUTR, MATP)**

**Hosts**

**To international networks via**
**Statically provisioned paths **
**In MAN LAN switch in NY POP **

**OC192**

**OC192**

**10GBE**

**10 GBE**

**10 GBE**

**McLean PoP**

**ARC**

**ORNL**

**NCSU 10 GBE**
**With VLSR**

**Other nodes**
**Multiple domains**

**Hosts (Viz. Cluster)**

**NCSU**

- CHEETAH ONT2

- 09/06/05

## CVLSR Architecture

- Ethernet Switch

- GMPLS Engine (Linux PC)

- Control Channel

- Control Channel

- Data Channels

- Data Channels

**CVLSR**

- Routing

- SNMP Msg.

- Parameter Configuration

- Signaling

- CAC

- Cluster
- mgt

- Switch Fabric
- control

- RSVP Daemon

- To / From Next Hop

- To / From Previous Hop

- CHEETAH ONT2

- 09/06/05