# Presentation: 159140

## Update on National Networks:Status, Application Targets, Challenges & Opportunities

***Update on National Networks:******Status, Application Targets, Challenges & Opportunities***

*Charlie Catlett, Senior Fellow, Computation Institute*
*University of Chicago and Argonne National Laboratory*
*Director, NSF TeraGrid Initiative*

**Notes:**

THESE SLIDES ARE ©UNIVERSITY OF CHICAGO AND MAY BE USED PROVIDING THE TeraGrid LOGO REMAINS ON THE SLIDES, AND
THAT THE SCIENCE GROUPS ARE ACKNOWLEDGED IN CASES WHERE SCIENTIFIC IMAGES ARE USED.

## Office of Science US Community

**SC program sites**

**Pacific Northwest**
**National Laboratory**

**Ames Laboratory**

**Argonne National ****Laboratory**

**Brookhaven**
**National**
**Laboratory**

**Oak Ridge**
**National Laboratory**

**Los Alamos**
**National Laboratory**

**Lawrence Livermore**
**National Laboratory**

**Lawrence**
**Berkeley National**
**Laboratory**

**Fermi**
**National**
**Accelerator **
**Laboratory**

**Princeton**
**Plasma**
**Physics**
**Laboratory**

**Thomas Jefferson National Accelerator Facility**

**National**
**Renewable Energy Laboratory**

**Stanford**
**Linear**
**Accelerator **
**Center**

**Idaho National **
**Laboratory**

**General Atomics**

**Sandia**
**National Laboratories**

***Bill Johnston, ESNET***

**Notes:**
Correct SLAC representation

## TeraGrid PI’s By Institution as of May 2006

**TeraGrid PI’s**

**Blue: 10 or more PI’s**
**Red: 5-9 PI’s**
**Yellow: 2-4 PI’s**
**Green: 1 PI**

***TeraGrid PI’s By Institution as of May 2006***

**Notes:**
This Google Map mashup (using www.mapbuilder.net) shows TeraGrid principal investigators for roughly 1,000 allocated projects as of June 2006.  
Different icons represent different numbers of Pis per institution.

## TeraGrid Science Gateways Initiative:Community Interface to Grids

**Common Web Portal or application interfaces (database access, computation, storage, workflow, etc).**
**“****Back-End” use of TeraGrid computation, information management, visualization, or other services.**
**Standard approaches so that science gateways may readily access resources in any cooperating Grid without technical modification.**

- TeraGrid

- Grid-X

- Grid-Y

**Notes:**
The objectives of the TeraGrid Science Gateways initiative include working with many gateway projects and peer grid projects to define interaction
protocols, mechanisms and policies such that gateways can be developed to operate with TeraGrid as well as other grid infrastructures and facilities.  

This collaborative approach involves international workshops and TeraGrid leadership in initiatives such as the “Grid Interoperation Now” (GIN)
group, consisting of some 20 grid facilities from around the world pursuing interoperation in several specific
areas during 2006.  GIN uses the Global Grid Forum as an administrative home for the activities, see forge.ggf.org.

## TeraGrid Science Gateway Partner Sites

**TG-SGW-Partners**

- 21 Science Gateway Partners (and growing) - Over 100 partner  Institutions

***TeraGrid Science Gateway Partner Sites***

**Notes:**
A Google Maps mashup (using www.mapbuilder.net) of institutions that are part of one or more science gateway teams.

## Some Observations

- While many challenges and concepts are not new...
- The need for huge pipes remains constant; the definition of huge continues to grow
- There is a large dynamic range of bandwidth required between average and peak - this too is not new, but the prefixes change (Mb->Gb->TB...)
- Switched circuits are older than the Internet, certainly not new, but the names and the bandwidth both change (POTS, ATM SVC, switched lambdas...)
- The nature of applications really does seem to be changing
- Service oriented architectures
- Web services
- More direct control in the hands of application developers... for everything but the network...

## Examples

- Many Flows leading to huge loads: YouTube
- After one year, YouTube drives 20 Gb/s
- Traffic growth is at 20% per month
- Web Services enabling growth driven by embedding services within applications
- Amazon S3 - many clients, can write your own (it is a web service), and supports bittorrent
- We will “big brother” ourselves
- More video...larger email attachments!

## Driver for user controlled networks

- Increasingly more and more organizations are acquiring their own fiber networks
- Universities, schools, hospitals, business
- Acquiring fiber in the long haul is very expensive to light and obtain
- Alternative is to use “dim fiber” –point to point wavelengths
- But want flexibility to do configuration and change management as with dark fiber
- Increasingly science needs dedicated networks for specific applications and disciplines for high data volume grids
- Want to be able to manipulate the network in the same way they can manipulate the application

***Bill St. Arnaud (CANARIE)                          ***

## Application Requirements Driving ESnet Architecture

***Bill Johnston, ESNET***

##  Next Generation ESnet

- Architecture and capacity is driven by the SC Program requirements
- Main architectural elements and the rationale for each element
- 1) A High-reliability IP core (e.g. the current ESnet core) to address
*General science requirements, Lab operational requirements, Backup for the SDN core, Vehicle for science services, Full service IP routers*
- 2) Metropolitan Area Network (MAN) rings to provide
*Dual site connectivity for reliability, Much higher site-to-core bandwidth, Support for both production IP and circuit-based traffic, Multiply connecting the SDN and IP cores*
*2a) Loops off of the backbone rings to provide for dual site connections where MANs are not practical*
- 3) A Science Data Network (SDN) core for
*Provisioned, guaranteed bandwidth circuits to support large, high-speed science data flows, Very high total bandwidth, Multiply connecting MAN rings for protection against hub failure, Alternate path for production IP traffic, Less expensive router/switches, Initial configuration targeted at LHC, which is also the first step to the general configuration that will address all SC requirements, Can meet other unknown bandwidth requirements by adding lambdas*

***Bill Johnston, ESNET***

## NLR Allocated Waves

**RATO**

**BATO**

**SAND**

**STAR**

**CHIC**

**SALT**

**HOUS**

**DALL**

**SYRA**

**TULS**

**PENS**

**ELPA**

**KANS**

**PHOE**

**LOSA**

**ALBU**

**PITT**

**WASH**

**BOIS**

**CLEV**

**ATLA**

**PORT**

**RALE**

**NEWY**

**SANA**

**DENV**

**SUNN**

**SEAT**

**JACK**

**OGDE**

- *  Fiber on the SAND-LOSA-SUNN path belongs to CENIC

*% used/Free*

- 5%/19

- 15%/17

- 60%/8

- 23%/31

- 23%/31

- 23%/31

- 30%/28

- 35%/26

- 56%/14

- 40%/12

- 25%/15

- 35%/13

- 25%/30

- 20%/16

- 25%/15

- 10%/18

- 15%/34

- 15%/27

- 19%/26

- 19%/26

- 15%/27

- 15%/27

- 19%/26

- 19%/26

- 19%/26

- 22%/25

- 22%/25

- 25%/24

- 25%/24

- 25%/24

- 25%/24

- 25%/24

- 19%/26

***NLR Allocated Waves***

***Tom West, NLR***

## Layer 1 Topology with IP Network

***Layer 1 Topology with IP Network***

- PROVISIONAL TOPOLOGY – SUBJECT TO DISCUSSION

**Notes:**
Image Slide

## Virtual Circuit Network Services

***Virtual Circuit Network Services***

- A top priority of the science community
- Today
- Primarily to support bulk data transfer with deadlines
- In the near future
- Support for widely distributed Grid workflow engines
- Real-time instrument operation
- Coupled, distributed applications
- To get an idea of how circuit services might be used to support the current trends, look at the one year history of the flows that are currently the top 20
- Estimate from the flow history what would be the characteristics of a circuit set up to manage the flow

## CANARIE Approach: UCLP

***Bill St. Arnaud (CANARIE)                          ***

***CANARIE Approach: UCLP***

- User Controlled LightPaths – a configuration and provisioning tool built around grid technology using web services
- Third party can concatenate cross connects together from various links, routers and switches to produce a wide are network that is under their control
- Articulated Private Network (APN)
- Next generation VPN
- Uses Service Oriented Architecture (SOA) and so network can be integrated with other web service applications

## Extending Networks into Applications

***Extending Networks into Applications***

***Bill St. Arnaud (CANARIE)                          ***

## Hybrid Networks: A Blast from the Past ( 1991 ! )

***Hybrid Networks: A Blast from the Past ( 1991 ! )***

- Technical Issues
- Rapid growth of Internet
- New applications increasing bandwidth requirements and network usage
- End-to-end performance
- Applications
- Distributed computing
- Digital libraries
- Require peak bursts of bandwidth several orders of magnitude greater than average traffic
- Proposed Architecture
*“**The Internet architecture should, wherever possible, combine the advantages of packet switched networks and of virtual circuit networks [to support] the ability to increase dynamically in capacity..."*

## Conclusions

- National Networks will do on demand today, and better on demand next year
- Today in days or weeks - in 2007/8 will do it in minutes
- Today granularity is per site - multiple efforts trying to move to per application
*CANARIE UCLP*
*ESnet OSCARS*
*I2 HOPI*
- Issues will remain
- Getting a switched lambda to a desktop is not a national backbone issue
*Regional networks*
*Campus/Lab networks*
- Maybe we are doing OK!