# Presentation: 525178

## Internet measureware: topology, workload, performance and routing

*workshop on *middleware -- above transport layer ?
- 4 dec 1998
- kc claffy, ucsd/sdsc/caida
*kc@caida.org  - www.caida.org*

## premise

*“**middleware”* -  (re?)definition
*“**measure*ware*?”* - CAIDA focused on
- advancing the capacity to monitor, depict, and predict traffic behavior on current and advanced networks
- developing and deploying tools to better engineer and operate networks and to identify traffic anomalies in real time

## measureware

- insights for vendors re next generation hw/sw requirements
- calibration for users, e.g., monitoring sla’s
- diagnostic and planning tools for ISPs
- windows into the infrastructure for researchers

## no dearth of activity

## active measurement: skitter

- goals:
- dynamically discover/ depict network topology (directed graphs rooted at sources)
- correlate effects of BGP routing changes
- correlate path performance with specific events
- Daniel McRobb (UCSD/CAIDA) developer

## skitter: infrastructure-wide measurements

- 6 monitors
- 23K (eventually 60K) destinations
- architecture
- parallel ICMP probes
- 52-byte packets
- kernel time stamping
*ssh* / Kerberos

- _[www.](http://www.caida.org/ISMA/isma9808/slides/isma98-skitter)__[caida](http://www.caida.org/ISMA/isma9808/slides/isma98-skitter)__[.org/ISMA/isma9808/slides/isma98-skitter/](http://www.caida.org/ISMA/isma9808/slides/isma98-skitter)_

## visualizations of connectivity / topology

- _[colored by distance from source ](http://www.caida.org/Tools/Skitter/viz/hal.html)_
- _[www.](http://www.caida.org/Tools/Skitter/viz/hal.html)__[caida](http://www.caida.org/Tools/Skitter/viz/hal.html)__[.org/Tools/Skitter/](http://www.caida.org/Tools/Skitter/viz/hal.html)__[viz](http://www.caida.org/Tools/Skitter/viz/hal.html)__[/](http://www.caida.org/Tools/Skitter/viz/hal.html)__[hal](http://www.caida.org/Tools/Skitter/viz/hal.html)__[.html](http://www.caida.org/Tools/Skitter/viz/hal.html)_

- _[colored by country-level domain](http://www.caida.org/Tools/Otter/Skitter/Images/)_
- _[www.](http://www.caida.org/Tools/Otter/Skitter/Images/)__[caida](http://www.caida.org/Tools/Otter/Skitter/Images/)__[.org/Tools/Otter/Skitter/Images/](http://www.caida.org/Tools/Otter/Skitter/Images/)_

## skitter as rtt analysis tool

- path connectivity & performance: used in assessing route stability and ISP performance (~5 minute)
- end2end performance: rtt between source and destination sites (10-20 pps)
- h/w performance: depicts nuances of specific h/w & OS (ms granularity)

##       skitter: rtt/loss & distribution (.se)

## skitter: rtt/loss & distribution (.jp)

## skitter: rtt history (.se)

## rtt performance: h/w

## research priorities...

- _visualizations_ - RTT performance;  top routers; hyperbolic space; collapse nodes into ASes
- _routing_ - time series analysis; compare routing policy w/ reality; path optimization; correlate w/ BGP announcements
- _analysis_ - average number of hops (`wingspan') and  ASes

- _[graphics.](http://graphics.stanford.edu/papers/h3/)__[stanford](http://graphics.stanford.edu/papers/h3/)__[.](http://graphics.stanford.edu/papers/h3/)__[edu](http://graphics.stanford.edu/papers/h3/)__[/papers/h3/](http://graphics.stanford.edu/papers/h3/)_

## passive measureware 

- workload profiling (s/w & h/w design, architecture optimizing, capacity planning)
- security
- performance analysis
- QOS assurance across ISPs
- accounting/billing
- many tools:  netramet, netflow, cflowd, coral
- “some suck less”             ...evolution requires use

## coral ocXmon monitorsup to OC12 (OC48?)

- persistent, real-time, full-frame traffic collection
- dynamic packet filtering triggered by attack precursors
- security policy
- compliance auditing  (passive)
- enforcement (active)
- must address privacy issues
*http://www.caida.org/Tools/Coral*

## cflowd flow-export analysis software

- Cisco routers (***cflowd***) - up to OC3 speeds _[http://www.](http://www.caida.org/Tools/Cflowd)__[caida](http://www.caida.org/Tools/Cflowd)__[.org/Tools/](http://www.caida.org/Tools/Cflowd)__[Cflowd](http://www.caida.org/Tools/Cflowd)_
- used primarily for capacity planning and trend analysis
- AS-to-AS matrices
- net-to-net matrices
- port and protocol tables
- forward IP path
- measurement specification _[http://www.](http://www.caida.org/Docs/meas_spec.html)__[caida](http://www.caida.org/Docs/meas_spec.html)__[.org/Docs/](http://www.caida.org/Docs/meas_spec.html)__[meas](http://www.caida.org/Docs/meas_spec.html)_*_spec.html*

## cflowd flow format & collector

##  analysis for peering & capacity planning

- _[www.](http://www.caida.org/Tools/Cflowd)__[caida](http://www.caida.org/Tools/Cflowd)__[.org/Tools/](http://www.caida.org/Tools/Cflowd)__[Cflowd](http://www.caida.org/Tools/Cflowd)_
- _[www.](http://www.caida.org/Tools/Coral)__[caida](http://www.caida.org/Tools/Coral)__[.org/Tools/Coral](http://www.caida.org/Tools/Coral)_

## traffic analysis:  current & future networks

- _[http://www.](http://www.caida.org/Learn/PrefixLength/)__[caida](http://www.caida.org/Learn/PrefixLength/)__[.org/Learn/](http://www.caida.org/Learn/PrefixLength/)__[PrefixLength](http://www.caida.org/Learn/PrefixLength/)_

- _[http://www.](http://www.caida.org/Learn/Size/)__[caida](http://www.caida.org/Learn/Size/)__[.org/Learn/Favoritism/](http://www.caida.org/Learn/Size/)_

## visualizing metrics:multicast

*manta* displays the geographical placement of Mbone infrastructure using data from the *mwatch* *mrinfo *utilities
*otter* displays topological views of the multicast infrastructure

*http://www.caida.org/Tools/Manta*

## mbone colored by metrics

## otter visualizations: multipurpose tool

- manual or semi geographic
- placement algorithms
*http://www.caida.org/Tools/Otter/*

##  from here to middleware

- ‘seamless’: no such thing
- measurement tools/infrastr must be well-considered, strategically deployed, collaboratively maintained
**much** more infrastructure-relevant research on resulting data, feedback into tool design
- correlation among data sources/types, 		simulation, visualization
- proactive top-down (app devel’s scoping constraints) and bottom-up (ISP cooperation) participation

## kc@caida.orgcooperative association for Internet data analysis (CAIDA)University of California’s San Diego Supercomputer Centerhttp://www.caida.org