Deployment ofperfSONAR
The 26th APAN Meeting , Queenstown, 7 Aug 2008

Takatoshi Ikeda,
APAN-JP NOC/
KDDI R&E Labs/NICT

www.jp.apan.net/noc/

Contents
1. Introduction
2. Deployment
3. Applications
4. Other Deployments
5. Future WorkThe 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Introduction
Deployment
Applications
Other Deployments
Future WorkThe 26th APAN Meeting , Queenstown, 7 Aug 2008

Motivation
Inefficiency of support for demos and experiments
 Checking the network data of othernetworks

NW1

APANTokyo

NW2

We need to
1. Search the web page for the data
2. Check what data is available
3. Recognize the different format of the graphs and data.

 Preparation for measurement

APANTokyo

We need to
1. Check the available measurement servers and tools onother networks
2. Exchange the information about the measurement servers Much
Time !
3. Coordinate the measurement schedule
4. Exchange the measurement data

NW1

Iperf?
Yes
IP & port?
Information
When
Date and TimeThe 26th APAN Meeting , Queenstown, 7 Aug 2008

MeasurementtimeWhat we can do Efficient support for events

 Looking at whole network data over multi-domain network
efficiently
 Measuring the network performance immediately between
domains

 Advanced monitoring Monitoring the multi-domain network
 Integrated monitoring with several network metrics

 Contribution to research activity

 Providing network data in quasi-real-time while researcher isdoing experiment.
 Providing measurement data to people who research therouting /path control
The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Introduction

DeploymentApplications
Other Deployments
Future WorkThe 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/EnvironmentDeployment point APAN Tokyo XP
 TransPAC2 LATokyoXP
TransPAC2JP-LA 10G

perfSONAR software
 v0.9 perfSONAR-PS software package

The 26th APAN Meeting , Queenstown, 7 Aug 2008

TransPAC2 LA

www.jp.apan.net/noc/

perfSONAR Services
PerfSONAR-PS v0.9
Packages

Deployment Services

Lookup Service

Lookup Service

Topology

Topology Service

resource registration anddiscovery for the
perfSONAR services

Authentication

Circuit Status
Measurement Archive

PerfSONAR Services
LookupTransformation
Resource Protector

12Interface Usage

Status Measurement
Archive

expose Interface Usage data

3

SNMP Measurement
ArchiveThroughput

Measurement Archive
perfSONAR-BUOY

4Measure throughput andexpose its data

Delay

Measurement Point
PingER Services
The 26th APAN Meeting , Queenstown, 7 Aug 2008

Measure delay andexpose its data

www.jp.apan.net/noc/

Server Allocation
Server Allocation & Install Packages
N Serviceo

PerfSONAR-PS
PackageHostname
APAN

TP2

1 Lookup
Service(LS)Lookup Service

ps1.jp.apan.net

134.68.142.46

2 Interface
SNMP MA
Usage(Usage)

nms2.jp.apan.net

nms7.transpac2.net

3 Throughput

PerfSONAR-BUOY

nms1.jp.apan.net

nms1.transpac2.net
nms6.transpac2.net

4 DelayPerfSONAR-BUOY

nms4.jp.apan.net

nms4.transpac2.net
nms6.transpac2.net

The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/Hardware Specification
Hardware (APAN Tokyo XP)
No Service
1234LS

Usage
Throughput
Delay

Spec
Barebone

SuperMicro SuperServer 6015X-TV

CPUIntel Xeon QuadCore 2.66GHz *2

MemoryDDR2-667 1GB * 2

Disk

SATA 500GB * 2 (RAID1)

NIC

On-board 10/100/1000 * 2

Barebone

SuperMicro SuperServer 6013P

CPUIntel Xeon 3.06GHz *2

MemoryDDR266 1GB * 2

DiskSAS 73GB * 2 (RAID1)

NIC

On-board 10/100/1000 * 2The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Software Specification (1/3)
OS & Kernel (APAN Tokyo XP)
No ServiceOSKernel

1LSCentOS 5.1 x86_64(Linux)2.6.18-53.1.21.el5

2

Usage

3

Throughput

CentOS 5.1 i386
(Linux)2.6.24.7 +web100-2.5.19

4

Delay

2.6.18-53.1.21.el5

The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Software Specification (2/3)
Software for perfSONAR
ServiceTool

Description

Ver.

LookupServicedbxml

an embedded XML databasewith XQuery-based access.

2.3.10UsageperfSONAR-PS Provide perfSONAR Lookup
Lookup Service Service

0.9

RRDtool

Database which store trafficdata

1.2.23NET-SNMP

Open source SNMP tool.

5.3.124

SNAPP(or Cacti)

Gathering usage data ofrouters by SNMP

2.0(0.8.7b)

perfSONAR_PS
SNMP MA

Expose data stored in RRD
file.

0.9

The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Software Specification (3/3)
ServiceTool

Description

Ver.

Throughput

Iperf

Throughput Measurement tool

2.0.2

BWCTLa command line client application 1.3RC
and a scheduling and policy
daemon that wraps Iperf

AMI

measure throughput and oneway delay on a regularlyscheduled basis

perfSONAR- Expose measurement data.
BUOY
DelayOWAMP

One-way delay measurement

AMISee above.

perfSONAR- Expose measurement data.
BUOY
The 26th APAN Meeting , Queenstown, 7 Aug 20083.0c

www.jp.apan.net/noc/

Network Configuration

134.68.142.46(LS)TransPAC2
US-JP
10Gbps

APAN
TokyoXP
10G Backbone
JuniperT640
1 GbE
Coppernms1(Throughput)

TransPAC2LA POP
10G Backbone
Juniper
T320

AlaxalaAX7808S
1 GbE
Coppernms7(usage)

nms2(Usage)
nms4(Delay)ps1(Lookup)

1 GbE
CopperHP ProCurve
Switch 3400cl

Dell
PowerConnect5324

The 26th APAN Meeting , Queenstown, 7 Aug 2008

nms6(Throughput& Delay)

www.jp.apan.net/noc/

Installation (OS ＆ Basic Setting)OS Basic Installation for the server Add some packages for development
 SELinux is “Disabled”

Basic Setting Update the installed packages
 Stop unnecessary services(daemons) Change run level Configure TCP Wrapper
 Configure Perl CPAN
The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Installation (software for perfSONAR) perfSONAR-PS•••

Software is available at CPAN
Some configuration file is necessary for the specificservice
perfSONAR-PS daemon can be configured by using
configure utility (psConfigureDaemon) Other software•••

Some software can be installed by yum
Tar ball of other software are available. Do
installation manually.
Some specific configuration are necessary for
perfSOANR-PS
The 26th APAN Meeting , Queenstown, 7 Aug 2008

Installation ReportDocument
Installation Report v0.9
http://www.jp.apan.net/noc/perfSONAR/installation-report-v0.9.doc

The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/Introduction
Deployment

Applications
Other Deployments
Future WorkThe 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Applications (investigating) Providing data set for
project basis• Collect the network data related tospecific project• Provide suitable data to user and ProjectA
operator

ProjectA

ProjectB

ps
ps
ps

NW2
APAN
Tokyo

NW1

ProjectB

 Advanced monitoring withscheduler• Monitoring network withbandwidth schedule• efficient utilization of sharednetwork
The 26th APAN Meeting , Queenstown, 7 Aug 2008

psps

NW2
APANTokyowww.jp.apan.net/noc/

Introduction
Deployment
Applications

Other deployments
Future WorkThe 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Deployments in Japan
JGN2plus
 JGN2plus plans to deploy pS-PS
 Candidate POP• Tokyo, Osaka, Kyusyu and Kashima

SINET3
Tsukuba WAN
These 2 networks are interested in ps-PS

The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Deployments in APAN region

The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Introduction
Deployment
Applications
Other DeploymentsFuture WorkThe 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Future Work
Further implementation
 Topology Service
 Circuit Status

Lookup ServiceTopology Service
Circuit Status
Measurement Archive
Status Measurement
Archive-> Monitoring L2 path
Monitoring path created by DCN

SNMP Measurement
Archive Status MA

perfSONAR-BUOY
PingER Services

donesoonSupport of deployment to other networks
 Update the web page and document
http://www.jp.apan.net/noc/perfSONAR/
The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

Schedule
DateWork

2008/8-9

Implement of Topology Service, Status,
Circuit Status MA .
Start to monitoring L2 path as experiment

2008/10-11 Creating web page of perfSONAR data forJapanese SC08 participants
2009/3

Report at APAN Kaohsiung Meeting

The 26th APAN Meeting , Queenstown, 7 Aug 2008

www.jp.apan.net/noc/

ReferenceperfSONAR
http://www.perfsonar.net/

perfSONAR-PS
http://www.internet2.edu/performance/pS-PS/

APAN-JP PerfSONAR
http://www.jp.apan.net/noc/perfSONAR/TransPAC2
http://www.transpac.org/

PerfSONAR UI
http://monstera.man.poznan.pl/jra1wiki/index.php/PerfsonarUIThe 26th APAN Meeting , Queenstown, 7 Aug 2008

www.themegallery.com