# Presentation: 787785

## Project Quad Charts

**Office of Science**
**MICS Division**

**Department of Energy**

**High-Performance Networking Research Program**
**Program Manger: Thomas D. Ndousse**
**Tel: 301-903-9960**
**Email: tndousse@er.doe.gov**

**Project Quad Charts**

## Bandwidth Estimation: Methodologies and Applications

**Bandwidth Estimation: Methodologies and Applications**
**k claffy, CAIDA at SDSC &** **Constantinos Dovrolis, Univ. of Delaware**

**Brief Summary of the Project **
** ****Task  1: **Develop accurate, fast, and non-intrusive bandwidth estimation (**bwest**) methodologies and measurement tools.
** ****Task 2: **Compare and evaluate different **bwes**t tools (both for end-to-end and per-hop bandwidth metrics), characterizing any observed errors.
** ****Task 3: **Use **bwest** methodologies in transport protocols and applications to optimize throughput for high bandwidth-delay-product paths.
** ****Task 4: **Prototype **bwes**t middleware to monitor performance between  network domains in real-time.

** **

***High-Performance Network Research ******	******	******	******SciDAC Project***

**MICS Program Manager:** Thomas Ndousse

-  Innovative end-to-end probing techniques to measure ***capacity*** (max possible throughput in empty path) and ***available bandwidth*** (max throughput under current load):
-   Packet Train Dispersion (**PTD**).
-   Variable Packet Size (**VPS**).
-   Self-Loading Periodic Streams (**SLoPS**)
-   Methodologies to check for overbuffered or underbuffered  network paths.
-   Smooth pacing in TCP, driven by **bwest** measurements.
-   Smooth **bwest** driven  rate-control for UDP-based applications.

**The Novel Ideas **

-  Compare and evaluate existing **bwest** tools:
-       - Hop-by-hop tool survey                **               Jun01 - Aug02**
-       - End-to-end tool survey                                **Jun 01 - Jun02**
-  Bandwidth measurement middleware
-       - Create/maintain testbed                                **Jun01 - Jun04 **
**      ****-** Collect link characteristics         **                  Jun01 - Jun04**
-       - Correlate active/passive measurements **      Jun01 - Jun04**
-  Capacity estimation tool **(*****pathrate***)  v2.1.2       **Dec01  DONE **
-       - Add GUI  to aid analysis of results             **               Dec02 **
-   Available bandwidth tool (***pathload***)                             **Mar02**
-       - Paper at PAM’02                 **                                      Mar02**
-   Develop UDP-based rate-controlled file transfer app        driven from **bwest** measurements                                       **Dec02**
-   Real-time path  monitor using **bwest** middleware           **Dec03**

**Milestones/Dates/Status**

-   _IMPACT_: Allow scientific applications (transferring terabytes of data) to efficiently use high-performance networks .
-  Use explicit **bwest** measurements instead of implicit **bwest** via TCP’s congestion control algorithms.
-  Provide easy-to-use tools for monitoring network path performance.
- _CONNECTIONS_:
-  Apply** bwest** methodologies to Web100 and Net100 projects.
-  Correlate **bwes**t to loss/delay (e.g. PingER project)
-  Establish prototype **bwest**  middleware in ESnet and for DOE labs and investigators.

**Impact and Connections**

## Security and Policy for Group Collaboration

**Security and Policy for Group Collaboration**
- Steven Tuecke, Argonne National Laboratory,  Carl Kesselman, USC Information Sciences Institute                             Miron Livny, U. Wisconsin, Madison

**September 2001**

**MICS Program Manager:** Thomas Ndousse

***Community Authorization Service***

***High-Performance Network Research******	******	******	******	******SciDAC Project***

## INCITE:  Edge-based Traffic Processing and Inference for High-Performance Networks 

***INCITE*****:  ****Edge-based Traffic Processing and Inference for High-Performance Networks**
- Richard Baraniuk, Rice University;  Les Cottrell, SLAC;  Wu-chun Feng, LANL

**INCITE Summary**
** ****Task 1: **Multiscale traffic analysis and modeling
-  **Task 2: **Inference algorithms for network paths and links
** ****Task 3:**** **Network tomography
-  **Task 4:**** **Active network measurement: PingER
-  **Task 5:**** **Passive network Measurement: MAGNeT, TICKET
-  **Task 6:**** **Passive path monitoring and tomography toolkit

**Date Prepared: **10 Jan 02

***High-Performance Network Research******	******	******	******	******SciDAC Project***

**MICS Program Manager:** Thomas Ndousse

**incite.rice.edu**

## Logistical Networking

**Logistical Networking**
**PIs: Micah Beck, Jack Dongarra, James S. Plank / Tennessee; Rich Wolski / UCSB**

**Logistical Networking: ****Developing a communicative infrastructure with persistence **
**Tasks:**
** ****-**develop/deploy network storage depots
-  -develop layered storage stack & tools
-  -develop/validate scheduling techniques
-  -optimize application performance
- loci.cs.utk.edu

**Date Prepared: 1/10/02**

***High-Performance Network Research ******	******	******	******	******      ******SciDAC Project***

**MICS Program Manager:** Thomas Ndousse

- 6-12mos

- 12mos

- 12-18mos

- 18-36mos

## Net100

**Net100**
**PIs: Wendy Huntoon/PSC,** **Tom Dunigan/ORNL,** **Brian Tierney/LBNL**

**NET100: ****Developing network-aware operating systems **
**Tasks:**
** ****-**develop/deploy network probes/sensors
-  -develop network metrics data base
-  -develop transport protocol optimizations
-  -develop network-tuning daemon
-    *www.net100.org*

**Date Prepared: 1/7/02**

***High-Performance Network Research -******	******	****** ******	******	******  ******Base Project***

**MICS Program Manager:** Thomas Ndousse

## Self-Configuring Network Monitor (SCNM)

**Self-Configuring Network Monitor (SCNM)**
**PIs: Brian Tierney/LBNL and Deb Agarwal/LBNL**

**SCNM: ****Developing a distributed passive network monitoring system **

**Date Prepared: 1/7/02**

***High-Performance Network Research ******	******	******	******	******Base Project***

**MICS Program Manager:** Thomas Ndousse

## High-Performance Transport Protocols

**High-Performance Transport Protocols**
**PI:  Wu-chun (Wu) Feng, Los Alamos National Laboratory and The Ohio State University**

**The Novel Ideas**

*Dynamic Right-Sizing:  TCP Flow-Control Adaptation for Grids & the Next-Generation Internet*
- Automatically enhance network performance over the WAN by as much as an order of magnitude while abiding by TCP semantics.
*RAPID:  Rate-Adjusting Protocol for Internet Delivery*
- Provide smoother QoS support over the best-effort Internet for grids and NGI while minimizing the need for widespread deployment of DiffServ or IntServ.

***Goal:  To significantly improve network performance in support of all computing environments, particularly grids and NGI.****** ***
*** ******	*****TCP/IP ******** Make the network fast but TCP friendly.**
**Eliminate TCP’s flow-control bottleneck **
** ****	****by automatically tuning buffer sizes.**
**	****RAPID ******** Make the network more adaptable.**
**Smooth QoS support over a best-effort network.**
**User-settable reliability, providing a spectrum of QoS from unreliable UDP to reliable TCP.**

**January 16, 2002**

***High-Performance Network Research - ******	******	******	******	******Base Project***

**MICS Program Manager:**  Thomas Ndousse-Fetter

## IQ-ECho

**IQ-ECho**
**PIs: Schwan, Ahamad, Eisenhauer, Yalamanchili  -- Georgia Institute of Technology**

**IQ-ECho** – Interactive Quality of Service Across Heterogeneous Hardware/Software

**Date Prepared: **1/10/02

***High-Performance Network Research ******	******	******	******	****** ******Base Project***

**MICS Program Manager:** Thomas Ndousse

- integrated QoS management through *quality attributes *
- dynamic code generation relocates application-level functionality to the most appropriate location
- configurable protocols and kernel-level monitoring provide the system-level support required for online quality management
- vertical programming allows extending platforms while programming applications

**IQ-ECho Novel Ideas**

- represent information flows as event streams in event-based IQ-ECho middleware
- use dynamic code generation to migrate application-level filtering/ data processing to appropriate network locations
- use network-level feedback to drive application-level quality of service adaptations.
***http://www.cc.gatech.edu/systems/projects/IQECho***

## PingER

**PingER**
**PIs: Les Cottrell SLAC**

**PingER: ****Active End-to-end performance monitoring for the Research and Education communities **
**Tasks:**
** ****-**develop/deploy simple, robust ssh based active end-to-end measurement and management  infrastructure
-  -develop analysis/reporting tools
-  -integrate new application and network measurement tools into the infrastructure
-  -compare & validate various tools, and determine regions of applicability
-    *www-iepm.slac.stanford.edu*

**Date Prepared: 1/7/02**

***High-Performance Network Research******	******	******	******	******Base Project***

**MICS Program Manager:** Thomas Ndousse

## Stability Modeling and Control of Transport Protocols for High-Speed Data Grids

**Stability Modeling and Control of Transport Protocols for High-Speed Data Grids**
**Nageswara S. Rao, Oak Ridge National Laboratory**

**Understand and Control the End-to-End Transport Dynamics of High-Speed Grids**** **
**  ****Detailed analysis of transport processes**
** ****rigorous treatment using non-linear control and chaos theory**
**  ****Develop provably effective transport methods for:**
**high throughput, and **
**end-to-end dynamics control**
**  ****Implement and test on grid environments**

**Date Prepared: 01/09/02**

***High-Performance Network Research ******	******	******	******	******Base Project***

**MICS Program Manager:** Thomas D. Ndousse

## Pushing the Network Simulation Envelope

**Pushing the Network Simulation Envelope**
**W. R. Wing - Oak Ridge National Laboratory**

**SSFnet - Creating a Terascale network simulator that can model SciDAC applications**
**Tasks:**
** **Verify SM SSFnet on candidate architectures
-  Develop initial DM version of SSFnet
-  Develop and verify instrumentation
-  Develop application-level IDE
-  Distribute to DOE network research community
-  Develop 2nd-Gen DM scheduler and DML

**Date Prepared **01/08/ 02** **

***High-Performance Network Research******	******	******	******	******Base Project***

**MICS Program Manager:** T. Ndousse

## High-Performance Transport Protocols

**High-Performance Transport Protocols**
**PI:  Wu-chun (Wu) Feng, Los Alamos National Laboratory and The Ohio State University**

**The Novel Ideas**

*Dynamic Right-Sizing:  TCP Flow-Control Adaptation for Grids & the Next-Generation Internet*
- Automatically enhance network performance over the WAN by as much as an order of magnitude while abiding by TCP semantics.
*RAPID:  Rate-Adjusting Protocol for Internet Delivery*
- Provide smoother QoS support over the best-effort Internet for grids and NGI while minimizing the need for widespread deployment of DiffServ or IntServ.

***Goal:  To significantly improve network performance in support of all computing environments, particularly grids and NGI.****** ***
*** ******	*****TCP/IP ******** Make the network fast but TCP friendly.**
**Eliminate TCP’s flow-control bottleneck **
** ****	****by automatically tuning buffer sizes.**
**	****RAPID ******** Make the network more adaptable.**
**Smooth QoS support over a best-effort network.**
**User-settable reliability, providing a spectrum of QoS from unreliable UDP to reliable TCP.**

**January 16, 2002**

***High-Performance Network Research******	******	******	******	******Base Project***

**MICS Program Manager:**  Thomas Ndousse-Fetter