# Presentation: 662025

## Internet2 Network of the Future

- Steve Corbató
- Director, Backbone Network Infrastructure
- HENP Networking WG meeting
- Ann Arbor USA
- 26 October 2001

**Notes:**
This is a general overview presentation about Internet2. Internet2 is a consortium, led by US universities, which is recreating the partnership among academia, industry and government that fostered today’s Internet in its infancy.

## Internet2 Network of the Future

- Current state of Abilene
- Evolution of optical networking
- Next phase of Abilene

## Abilene partnership

- A UCAID project with outstanding partners
- Cisco Systems
- Nortel Networks
- Qwest Communications
- Indiana University (Network Operation Center)
- Internet2 Test and Evaluation Centers (ITECs)
- North Carolina
- Ohio

## Abilene focus

- Enabling innovative applications and services not possible over the commercial Internet
- Service efforts
- Multicast
- IPv6
- QoS
- Measurement
- Security
- DDoS detection efforts

## Abilene status – October, 2001

- IP-over-SONET (OC-48c) backbone
- 51 direct connections (3 pending)
- 3 OC-48c connections (most recent: MAX)
- 22 will connect via at least OC-12c by year end
- 201 primary participants
- All 50 states, District of Columbia, & now Puerto Rico
- 15 regional GigaPoPs support ~70% of participants
- 37 sponsored participants
- 14 state education networks (SEGPs)
- Collaboration of sponsoring member universities and Abilene connectors

## Slide 6

## International peering

- Transoceanic R&E bandwidths growing!
- Key international exchange points facilitated by Internet2 membership and the U.S. scientific community
- STARTAP  STAR LIGHT – Chicago
- Pacific Wave – Seattle
- AMPATH – Miami
- New York City – EP under development
- CUDI peering  - CENIC and UTEP
- Media: general migration from ATM to Gigabit Ethernet/10GE

## Current state of optical networking 

- Dense Wave Division Multiplexing (DWDM)
- Current systems can support >160 10-Gbps ’s (1.6 Tbps!)
- Optical growth can overwhelm Moore’s Law (routers)
- Costs scale dramatically with distance
- Three possible scenarios for the future
- Enhanced IP transport (higher BW and circuit multiplicity)
- Fine-grained traffic engineering
- p2p links between campuses, HPC centers, & Gigapops
- Physical manifestation of switched circuits (a la ATM SVCs)
- Evolution of optical switching will be critical
- Leading international efforts in R&E exploration
- The Netherlands, Canada, STAR LIGHT (Chicago)

## TeraGrid Wide Area Network - NCSA, ANL, SDSC, Caltech

- TeraGrid Wide Area Network - NCSA, ANL, SDSC, Caltech

**NCSA/UIUC**

**ANL**

**UIC**

***Multiple Carrier Hubs***

**Starlight / NW Univ**

**Ill Inst of Tech**

**Univ of Chicago**

**Indianapolis (Abilene NOC)**

**I-WIRE**

***StarLight***
**International Optical Peering Point**
**(see www.startap.net) **

**Los Angeles**

**San Diego**

- DTF Backplane (4x: 40 Gbps)

**Abilene**

**Chicago**

**Indianapolis**

**Urbana**

- OC-48 (2.5 Gb/s, Abilene)

- Multiple 10 GbE (Qwest)

- Multiple 10 GbE (I-WIRE Dark Fiber)

- Solid lines in place and/or available by October 2001
- Dashed I-WIRE lines planned for summer 2002

**Source: Charlie Catlett, Argonne**

**Notes:**
Explanation of dashed lines:
St. Louis:  State of Illinois fiber between St. Louis and Chicago will be connected to I-WIRE by November 2001.  This fiber will terminate at 900 Walnut Street-- the Switch Data Services carrier collocation facility in St. Louis (location of St. Louis Gigapop).  In Chicago the State of Illinois fiber will connect both directly to Argonne (which will serve as one of the State’s repeater/opto-electronic equipment hubs) and to the James R. Thompson Center downtown.  I-WIRE fiber connects the James R. Thompson Center to the Starlight hub via the Qwest POP.
Indianapolis:  We are working with Indiana University to obtain fiber either to Urbana or Chicago.  We have preliminary pricing and expect at least a pair of fiber to be available by Summer 2002 if not before. 

## National optical networking options

- 1 - Incremental wavelengths
- Provision 10-Gbps ’s from provider(s) in the same way that SONET circuits are done for Abilene now
- Exploit smaller incremental cost of additional ’s
- 2 - Dim Fiber
- Acquisition of fiber IRU and subsequent O&M agreement for inter-PoP services (amps, regens, DWDMs?)
- National footprint of 1-2 fiber pairs
- IRU would cost $10-20M
- Most likely awaits the development of lower-cost optical transmission equipment

## Future of Abilene

- Original UCAID/Qwest MoU amended on October 1, 2001
- Extension of Qwest’s original commitment to Abilene for another 5 years – 10/01/2006
- Originally expired March, 2003
- Upgrade of Abilene backbone to optical transport capability - ’s
- x4 increase in the core backbone bandwidth
- OC-48c SONET (2.5 Gbps) to 10-Gbps DWDM
- Capability for flexible provisioning of ’s to support future point-to-point experimentation & other projects

## Key aspects of the next backbone

- IPv6
- Running natively concurrently with IPv4
- Replicate multicast deployment strategy
- Motivations
- Resolving IPv4 address exhaustion issues
- Preservation of the original End-to-End Architecture
- International collaboration
- Router and host capabilities
- Close collaboration with Internet2 IPv6 Working Group
- Network resiliency
- MPLS/TE fast reroute or IP-based IGP fast convergence
- Opportunity for new measurement capabilities
- Support of End-to-End Performance Initiative

## Next generation network deployment

- October, 2001: Detailed technical design starts
- February, 2002: PoP upgrades start
-  deployment in three phases
- April, 2002 – Phase 1
- October, 2002 – Phase 2
- April, 2003 – Phase 3
- October 2003 - Completion of 10-Gbps upgrade

## Detailed technical design process

- Qwest  service characterization
- Interface selection: OC-192c POS, 10GE WAN/LAN PHY
- Next generation router selection
- 10-Gbps interface selection
- Native v6 routing and high-performance forwarding
- Existing features: high-performance v4, ASM/SSM multicast & flow characterization
- IPv6 coordination & planning

## Network design overview

- Overall next generation topology is expected to be very similar to current design
- Previous iterations to router locations
- Washington DC, Chicago, Sunnyvale, Houston
- Some differences expected due to Qwest DWDM deployment
- Expect same number of backbone routers

## Optical fanout

- Next generation architecture: Regional & state based optical networking projects are critical
- Three-level hierarchy: backbone, GigaPoPs, campuses
- CENIC ONI, I-WIRE, SURA Crossroads, Indiana, Ohio
- Collaboration with the Quilt
- Regional Optical Networking project
- Carrier DWDM access is now not nearly as widespread as with SONET circa 1998

## The Quilt

- A UCAID project support regional advanced networking initiatives
- 15 charter GigaPoPs
- EDUCAUSE and SURA
- Quilt GigaPoPs support over 70% of Abilene participants
- Initial projects
- Commodity Internet Services
- Regional Optical Networking
- Measurement
- Led by Wendy Huntoon (Pittsburgh SC)

## Conclusions

- Abilene partnership with Qwest extended through 2006
- Backbone to be upgraded to 10-Gbps in three phases by late 2003
- Capability for flexible  provisioning in support of future experimentation in optical networking
- Overall approach to the new technical design and business plan is for an incremental, non-disruptive transition

## For more information

- Web:    _[www.internet2.edu/abilene](http://www.internet2.edu/abilene)_
- E-mail: _[abilene](mailto:abilene@internet2.edu)__[@internet2.](mailto:abilene@internet2.edu)__[edu](mailto:abilene@internet2.edu)_

## www.internet2.edu

**www.internet2.edu**