# Presentation: 536000

## Optical Metro Network Initiative: OMNInet Testbed

**Joe Mambretti, Director, (**_[j-](mailto:j-mambretti@nwu.edu)__[mambretti](mailto:j-mambretti@nwu.edu)__[@northwestern.](mailto:j-mambretti@nwu.edu)__[edu](mailto:j-mambretti@nwu.edu)_**)**
**International Center for Advanced Internet Research (**_[www.icair.org](http://www.icair.org/)_**)**
**Director, Metropolitan Research and Education Network (**_[www.mren.org](http://www.mren.org/)_**)**
**Partner, StarLight/STAR TAP, PI-OMNINet (**_[www.icair.org/omninet](http://www.icair.org/omninet)_**)**
** **
- Optical Network Testbed 2 Workshop
- NASA Ames
- Sept. 12-14, 2005

## 
Creation and Early Implementation of Advanced Networking Technologies - The Next Generation Internet All Optical Networks, Terascale Networks
Advanced Applications, Middleware, Large-Scale Infrastructure, NG Optical Networks and Testbeds, Public Policy Studies and Forums Related to NG Networks

**Creation and Early Implementation of Advanced Networking Technologies - The Next Generation Internet All Optical Networks, Terascale Networks**
**Advanced Applications, Middleware, Large-Scale Infrastructure, NG Optical Networks and Testbeds, Public Policy Studies and Forums Related to NG Networks**

**Accelerating Leading Edge Innovation **
**and Enhanced Global Communications **
**through Advanced Internet Technologies, **
**in Partnership with the Global Community**

**Introduction to iCAIR:**

## OMNInet

-   **The ****OMNInet Research is Creating New Architectural Approaches for Communication Services Based on Dynamically Provisioned Lightpaths, Supported by Agile Optical Networks**
** ****This Research is Investigating New Architecture and Technologies for L1 – L2, While Also Exploring New Complementary L3 and L4 Methods**
** ****This Research is Creating Fundamentally New  Methods for Agile Optical Transport Enabling Migration From Legacy Systems**
**  ****OMNInet Reduces Hierarchical Layers and Implements Highly Distributed Controls, e.g., Enabling Applications To Provision Lightpaths Dynamically**
** ****Since 2001, the Testbed Has Had No SONET Components, OOO Switches at the Core Have Supported 24 Individually Addressable Lightpaths Among 4 Core Nodes**
**  ****Future Research Will Integrate SONET-Less Optical Transport With SONET Switching**
**  ****Through Various Research Projects, the Testbed has Been Extended to**** ****Sites Nationally and Internationally**** **

## OMNInet

-   **The OMNInet Testbed is Developing New Architectural Designs for Communication Services Based on Dynamically Provisioned Lightpaths, Supported by Agile Optical Networks**
** ****This Research is Investigating New Architecture and Technologies for L1 – L2, While Also Exploring New Complementary L3 and L4 Methods**
** ****This Research is Creating Fundamentally New  Methods for Agile Optical Transport Enabling Migration From Legacy Architecture, Esp. Those Oriented to Centralized Management and Control**
**  ****The OMNInet Testbed Reduces Hierarchical Layers and Implements Highly Distributed Controls, e.g., Enabling Applications To Provision Lightpaths Dynamically**
** ****Since 2001, the Testbed Has Had No SONET Components, OOO Switches at the Core Have Supported 24 Individually Addressable Lightpaths Among 4 Core Nodes**
**  ****Next - Integration of SONET-Less Optical Transport W/SONET Switching**
**  ****Through Various Research Projects, the Testbed has Been Extended to Sites Nationally and Internationally**** **

## Services Based on New Technologies

**Enhanced Volume/Capacity**
**Enhanced Device Performance**
**Enhanced Device Addressibility/Flexibility**
**Decentralized Control**
**Spectral Efficiency f(Rate and Channel Distance)**
**Transparency**
**Minimal Conversions, Esp. OEO**
**Distance**
**Flexibility (Esp. Dynamic Adjustments)**
**Et al**

## Multilayer Layer Control Planes and Optical Packet Switching

**Optical Packet  Router**

**Edge**
**Device Cluster**

**Edge**
**Device-Router**

**Optical Packet  Router**

**Optical Packet  Router**

**Optical Packet  Router**

**Optical Packet  Router**

**Multilayer Layer Control Planes and Optical Packet Switching**

**Ubiquitous**
**Control**
**Plane**
**Provisioning**
**Wavelength**
**Assignment**
**Wavelength Routing**

**Data Plane – **
**Optical Transport**

**Optical Layer – Switched Lightpaths**

**Optical Routing**

**Ubiquitous**
**Management**
**Plane**
**Access**
**Engineering**
**Restoration**
**Performance**
**Resource Use Audits**

## CSW

- Multiwavelength Optical Amplifier

- Multiwavelength Fiber

- ASW

- ASW

****
****
****
****

- GE Links

- GE Links

- 

*******N*N**

- LAN PHY
- Interface, eg, 15xx nm
- 10GE serial

- GE Links

- GE Links

- Optical,
- Monitors, for
- Wavelength Precision, etc.

**Power Spectral Density **
**Processor, **
**Source + Measured PSD**

- DWDM Links

- Multiple Per Fiber

- Computer Clusters Each Node = 1GE
- Multi 10s, 100s, 1000s of Nodes

- Multiple Optical Impairment
- Issues, Including Accumulations

**Grid Clusters**

**Grid Clusters**

**Near Term **
**Potential for 10 G Elec.**
** ****to BP**
**Longer Term Potential for **
**Driving Light to BP via Si, **
**New Polymers**

## New: Intelligent Application Signaling *

**Controller**

**Client Data Plane Server**

**IAS Server**

**Controller**

**Controller**

**Controller**

**New: Intelligent Application Signaling ***

**Client Layer Control Plane: Communications Service Layer**
**Service Layer, Policy Based Access Control, Client Message**
**Receiver, Signal Transmission, Data Plane Controller, **
**Data Plane Monitor**

**Optical Layer Control Plane**

**Client Layer **
**Traffic Plane**

**Optical Layer – Switched Traffic (Data) Plane**
**Multiiservice: Unicast, BiDirectional, Multicast,**
**Burst Switching**

**UNI**

**I-UNI**

**CI**

**CI**

**CI**

*** Also Control Signaling, et al**

## Example Control Plane Signaling Functions

**Multi-Dimensional Signal Processing (Distributed)**
**Signal Processing From Clients, e.g., Application, Systems, Device, Including Ad Hoc Demand for Resources**
**Signalling ******** Management Plane, e.g., Provisioning, Restoration**
**Signally ******** Resource Management, Including Resource Discovery, Scheduling/Reservation (IETF RSVP Extensions), Resource Contention Resolution**
**Lightpath Provisioning (E2E), Deletion, Characterization**
**Via Signaling to Device Interfaces, e.g., Optical Switch Configuration with Tl1, GMPLS, et al**
**Data Plane Signal Processing, e.g., Resource Advertisements**
**Signaling ******** Data Plane, e.g., Wavelength Assignment, Wavelength Routing**
**Signaling ******** Data Plane Management Systems**
**Optimization Signaling ******** IETF Extensions for OSPF for Optical Routing**
**Et al**
**Implications for Signaling Related to Optical Packet Switching**

## Architecture

**Resource**

**Resource**

**Resource**

**Physical Processing Monitoring and Adjustment**

**HP-PPFS**

**HP-APP2**

**HP-APP3**

**HP-APP4**

**VS**

**VS**

**VS**

**VS**

**ODIN Server**
**Creates/Deletes**
**LPs, Status Inquiry**

- tcp

- tcp

**Access**
**Policy (AAA)**
**Process Registration**

**Discovery/Resource**
**Manager, Incl Link Groups**
**Addresses **** **

**Previously OGSA/OGSI, Soon OGSA/OASIS WSRF**

**Process**
**Instantiation**
**Monitoring**

- ConfDB

**Lambda Routing:**
**Topology discovery,  DB of physical links**** **
**Create new  path, optimize path selection **
**Traffic engineering**
**Constraint-based routing**
**O-UNI interworking and control integration**
**Path selection,  protection/restoration tool -  GMPLS**

**Data**
**Plane**

**System Manager**
**Discovery**
**Config**
**Communicate**
**Interlink**
**Stop/Start Module**
**Resource Balance**
**Interface Adjustments**

**GMPLS Tools (with CR-LDP)**
**LP Signaling for I-NNI**
**Attribute Designation, eg**
**Uni, Bi directional**
**LP Labeling**
**Link Group designations**

**Control Channel monitoring, physical fault detection, isolation, adjustment, connection validation etc**

**OSM**

**UNI-N**

**Architecture**

## OMNInet Technology Trial: 2002-05

**4x10GE**

- Northwestern U

**Optical**
**Switching**
**Platform**

**Passport**
**8600**

**Application**
**Cluster**

**OMNInet Technology Trial: 2002-05**

**A four-site network in Chicago -- the first 10GE **_**service**_** trial!**
**A test bed for all-optical switching/advanced high-speed services (No SONET!)**
**Partners: SBC, Nortel, iCAIR at Northwestern, EVL, CANARIE, ANL**

**Application**
**Cluster**

**Optical**
**Switching**
**Platform**

**Passport**
**8600**

**4x10GE**

- StarLight

**OPTera **
**Metro**
**5200**

**Application**
**Cluster**

**Optical**
**Switching**
**Platform**

**Passport**
**8600**

**4x10GE**

**8x1GE**

- UIC

- (1st @CA*net3/4—Chicago)

**Optical**
**Switching**
**Platform**

**Passport**
**8600**

**Application**
**Cluster**

**8x1GE**

**8x1GE**

**8x1GE**

**600 ****South**** Federal **

## OMNInet Network Configuration

**OMNInet Network Configuration**

**10 GE**

**10 GE**

**To Ca*Net 4**

**Lake Shore**

**Photonic **

**Node**

**S. Federal**

**Photonic **

**Node**

**W Taylor**

**Sheridan**

**Photonic **

**Node**

**10/100/**
**GIGE**

**10/100/**
**GIGE**

**10/100/**
**GIGE**

**10/100/**
**GIGE**

**10 GE**

**Optera**
**5200**
**10Gb/s**
**TSPR**

**Photonic **

**Node**

****

****

**PP**

**8600**

**10 GE**

**PP**

**8600**

**PP**

**8600**

****

****

****

****

****

****

****

****

****

****

****

****

****

****

**10 GE**

**10 GE**

**10 GE**

**10 GE**

**PP**

**8600**

**...**

**CAMPUS**
**FIBER (16)**

**EVL/UIC**
**OM5200**

**LAC/UIC**
**OM5200**

**CAMPUS**
**FIBER (4)**

**INITIAL**
**CONFIG:**
**10 LAMBDA**
**(all GIGE)**

**10GE LAN PHY (Dec 03)**

**8x8x8******** Scalable photonic switch**
**Trunk side – 10 G WDM**
**OFA on all trunks**

**TECH/NU-E**
**OM5200**

**CAMPUS**
**FIBER (4)**

**INITIAL**
**CONFIG:**
**10 LAMBDAS**
**(ALL GIGE)**

**Optera Metro  5200 OFA**

**NWUEN-1**

**NWUEN-5**

**NWUEN-6**

**NWUEN-2**

**NWUEN-3**

**NWUEN-4**

**NWUEN-8**

**NWUEN-9**

**NWUEN-7**

**DOT**
**Clusters**

## iCAIR Grid Clusters and OM5200 DWDM System

- Leverone Hall Data Com Center

- Up to 16xGE
- (SMF LX)

- 4-fibers
- ~1km

- DOT Clusters
- For Telecom2003 Demo

- Technological Institute

- 10GE WAN/LAN PHY to OMNInet

- OM5200

- OM5200

- PP8600

**~20m**

- DWDM Between Cluster Site and OMNInet Core Node in Evanston

- The implementation is lambdas (unprotected).
- Installed shelf capacity and common equipment permits expansion of up to 16 lambdas through deployment of additional OCLD, and OCI modules.
- A fully expanded OM5200 system is capable of supporting 64 lambdas (unprotected) over the same 4-fiber span.

**DWDM on**
**Dedicated**
**Fiber**

**~20m**

## GRID Distributed Optical Testbed Components

**GRID Distributed Optical Testbed Components**

**Enviromental Conditioning, Power**

**Cluster**

**Cluster**

**Advanced**
**Photonics**

## Chicago

**Chicago**

## DARPA DWDM-RAM Large Scale Data+Dynamic Lambdas – Demonstrated at GGF9 & SC2003

- Dynamic Lightpaths

-  Grid L3-L7 OGSA Compliant

- Data Web Services

**Data Intensive App2**

-  Dynamic vLANs

-  **Dynamic Path Services (ODIN, THOR, etc),OGSA Compliant**, **Soon WSRF**

- Grid Data
- Management
- Services

- Data Grid Services

**Data Intensive App3**

**HP-PPFS**

**Data Intensive App4**

- Physical Processing Monitoring and Adjustment

**New**
**Control Plane**
**And **
**Management**
**Plane **
**Processes**

## DOT Sites, I-WIRE, and OMNInet

**UIUC/NCSA**

**Starlight**
**(NU-Chicago)**

**Argonne**

**UChicago**

**IIT**

**UIC**

- Illinois Century Network
- James R. Thompson Ctr
- City Hall
- State of IL Bldg

- Level(3)
- 111 N. Canal

- McLeodUSA
- 151/155 N. Michigan
- Doral Plaza

- Qwest455 N. Cityfront

- UC Gleacher
- 450 N. Cityfront

**OMNInet**

**All DOT Links **
**Here= GE**

**Not Yet Provisioned**

**Because of SL**
**Renovation **
**This Cluster is at iCAIR**

**Not Yet Part of Testbed**

## Some Results

**Almost Lightpaths Had Minimal to No Packet Loss**
**In a Number of Tests, Large Scale Data Streams Were Transported For Many Hours With No Packet Losses (Measured)**
**Measured Performance of Various Provisioning Processes**
**More Than 1000 Successful Lightpath Setup/Teardown Operations**
**No Optical Component Failures - Several Electronic Component Failures**
**Multiple Successful Demonstrations of Multiple New Service/Tech Capabilities including New Provider Services, New Internal Optical Transport Capabilities**
**For Some Traffic, SONET/Routers Not Required (Would Have Been a Performance Barrier), for Some Traffic, Multi-Service Approach**
**Exceptional Grid Application Results – Extremely High Performance**
**Have Created and Successfully Demonstrated Multi Times a Basic Control/Management Plane Architectural Model, & Prototype Implementation**
**Demonstrated the Utility of Dynamic Lightpath Switching to High Performance Applications, **
**Created “Optical Dynamic Intelligent Network” Service Layer Architecture**
**Created Lightpath Control Protocol**
**Demonstrated the Potential of “Photonic Data Services”**
**Demonstrated that A Number of Emerging Technologies are Ready for Production (e.g., GMPLS Can be a Basis for Production Services)**

## Summary Optical Services: Baseline + 5 Years 

| 2005 | 2006 | 2007 | 2008 | 2009 | 2010 |
| --- | --- | --- | --- | --- | --- |
| New Services
Abstractions | Enhanced Direct
Addressing  | WS Multidomain Announcements | Multi New Services | Enhanced Reach | Multiple Sites
National, Global |
| Application Optical LP
Integration | Optical Grid Net
And Instrument Services API-Op  | Extensions to Additional Edge Devices | Extensions to Optical BPs | Optical Edge Services | Multiple Sites
National, Global |
| Access to Highly Distributed
Control Plane | Multi-Domain
Distributed
Control Access | Multi Site Access to Services, National, Global | Persistent Inter Domain Signaling
National, Global | Extension to 
Additional Net
Elements | Persistence: Common Facilities |
| Deterministic
Paths (App as Service) | Close Integration 
w/ App Signaling | Increased Attribute Parameters | Increased Adjustment Parameters  | Performance Metrics and Methods | Enhanced Recovery
Restoration |
| Dynamic Lightpath Allocation | Multi-Domain
Alloc of DLP | Wavelength
Conversion | Extensions of DLP Peering | E2E DLP
 | Large Scale Dist
Virtual  Optical 
Backplanes |
| Dedicated Switched
Lightpaths | Enhanced via WDM Mux
Demux | Enhanced Granularity | Increased Allocation Capacity Global | Increased  Allocation Capacity US | Increased  Allocation Capacity: Sites |
| SONET-Less
Optical Trans. | Integration With
SONET | Optical
SubChanneling | E2E Transport
 | New Digital Frame Services | New E2E Framed Services |
| Multi-Service
Layer Integration | Integration with
Optical Services | Multi-Domain Integrated Servs | Distributed Management  | Monitoring
Techniques | Analysis Techniques |
| Wavelength Routing | Selectable
Wavelength Routing | Multi-Domain
Wavelength Routing | Multi-layer
Integration | Multi-Services
Integration | Enhanced Recovery
Restoration |

## Summary Optical Technologies: Baseline + 5 Years 

| 2005 | 2006 | 2007 | 2008 | 2009 | 2010 |
| --- | --- | --- | --- | --- | --- |
| O-APIs | O-API Signaling | App Specific
APIs  | Variable APIs | Multidomain
Signaling | E2E Signaling |
| Distributed Control Systems,
Multi-Domain | Integration with 
Standard OADM
 | Integration with
ROADMs | Enhanced Granularity | Enhanced Addressibility | Enhanced Edge Integration |
| OOO Core
Switches | At Selected
Core Sites | At Selected
Core, Edge Sites | + Experimental
Solid State OSWs | Solid State OSW
Deployment | Solid State (PIC)
At Core, Edge  |
| O-UNIs | O-UNI v2 | O-UNI v3 | Enhanced O-UNI
Signaling | At Selected
Core, Edge Sites | Deployment At Key Sites Global |
| Service Abstraction –GMPLS Integr. | Additional Sig. Integration 
ODIN 2.0 | Increased Transparency,
LayerElimination | Increas’d Integra. w/ ID/Obj.Dis ODIN3 | Prototype Arch for App Specific
Serv Abstraction | Enhanced Architecture
ODIN v 3.n |
| SONET-Less Transport | New Types of Digital Framing 
 | Metro Core Framing Architecture | LH Framing Architecture | Integration With
PICs | Integration with BPs |
| New Id, Object and Discovery Mechanisms | Integration of New Id, Obj, Dis w/ New Arch. | Integration 
With Multiple
Integrated Serv. | Integration w/New Management Sys | Extensions to various TE Functions | Persistent at
Core, Edge Facilities |
| DWDM | DWDM
CWDM  | Integration with Edge Optics | Integration with BP Optics | Additional
MUX/DMUX | Increased Stream
Granularity |
| 2D MEMs | 3D LP Switches
 | Experimental Opt Packet SWs | Prototype Deployed OPSW | NanoPhotonic
Devices | At Edge and Core Sites |

## Summary Optical Interoperability Issues: Baseline + 5 Years 

| 2005 | 2006 | 2007 | 2008 | 2009 | 2010 |
| --- | --- | --- | --- | --- | --- |
| Common Open R&D Services
Definitions Draft | Common Services R&D  | Common Services
Experimentation | Initial Standards
Formalization | Establish CSD Enhancement Process | 
On-Going
 |
| Prototype COS
Architecture | Initial Implementations | Expansion of
Functionality | Initial Standards
Formalization | Enhancement 
Process | On-Going |
| Open Protocols
And Standards | Initial Implementations | Expansion of
Functionality | Initial Standards
Formalization | Enhancement 
Process | On-Going
 |
| Distributed
Control  | V2 with WS
Integration | Multi-Service
Integration | New Services
Integration | Extensions, Horizontal, Vert | Integration with New Opt Core |
| Multi-Domain
Interoperability | Enhancement of
Signaling Functionality | Access Policy
Services | Expansion to Additional Domains | Increasing US, Global Extensions | Increasing US, Global Extensions |
| Interconnect
At GLIF Open 
Exchanges (5) | 5-10 OE Sites | 10-20 OE Sites
 | 20-30 OE Sites

 | 30-40 OE Sites | 40-50 OE Sites |
| GLIF R&D Sites
Via OE | 15-30 Sites | 30-60 Sites | 60-90 Sites | 90-120 Sites | 120-150 Sites |
| Interop at 10
Key US Research Sites  | 20 Sites | 30 Sites | 40 Sites | 50 Sites | 50 Sites |
| Interop at 3 Internl. Sites  | 6 Sites | 12 Sites  | 24 Sites | 48 Labs | 48 Labs |

## OMNInet Key Themes and Issues

- A Key Goal Is Enhancing Service Layer Abstractions and Enabling Direct Manipulation of Core Optical Resources
- Major Improvements Over Centralized Control of Core Resources Via High Distributed Control
- Decentralization: Applications Can Directly Control Lightpaths
- Advanced Dynamic Lightpath Provisioning Based on Controllable, Deterministic Optical Networks
- Increased Integration Between Edge and Core Infrastructure
- Agile Solid State Components (e.g, CMOS-Based, PIC-Based)
- Availability of Cost-Effective Fiber and DWDM Equipment Provides for Highly Disruptive Price/Capability Ratios
- Ref--  iGRID2005

## OMNInet Key Research Issues

**Research Basic Should Be Oriented Toward Difficult Fundamental Problems vs Specific Implementation Issues**
**Research Must Be Oriented to Long Term Objectives **
**Large Scale Research Testbeds Are Required To Investigate Grand Challenges of Advanced Networking**
**Research Environments Must Allow for Multiple, Different Experimental Approaches**
**Prototypes Are Key Resources**
**Research Projects Supporting Interdisciplinary Methods for Enabling Applications with Advanced Research Infrastructures Are Important**
**Communications Infrastructure Research Funding is Required**

## New Testbed Site Fiber

**710 North**
**Lake Shore Drive**

**600 South Federal**

**1940 West**
**Taylor**

**New Testbed Site Fiber**

**Sheridan, **
**Evanston**

**350 E. Chicago**

**Core Node**

**111 North Canal**

## September 26-30, 2005
University of California, San Diego
California Institute for Telecommunications and Information Technology [Cal-(IT)2]
United States

**University of California, San Diego**
**California Institute for Telecommunications and Information Technology [Cal-(IT)****2****]**
**United States**

**World Of Tomorrow 2005**

***i***

**Grid **** ****2****oo****5**

**T**** ****H**** ****E  G**** ****L**** ****O**** ****B**** ****A**** ****L  L**** ****A**** ****M**** ****B**** ****D**** ****A  I**** ****N**** ****T**** ****E**** ****G**** ****R**** ****A**** ****T**** ****E**** ****D  F**** ****A**** ****C**** ****I**** ****L**** ****I**** ****T**** ****Y**** **

**Co-Organizers: Tom DeFanti, Maxine Brown**