# Presentation: 061903

## The Zero-Force MPI Toolkit –Toward Tractable Toolkits for HPC

- Magdalena Slawinska
- Dawid Kurzyniec
- Jaroslaw Slawinski
- Vaidy Sunderam
**Emory University**

## Goals
New approach to resource sharing
Aggregation and virtualization resourcesat the client side
Automating tasks
MPI environment configuration
Uploading and compiling computational applications
Staging input data / result collection

**New approach to resource sharing**
**Aggregation and virtualization resources****at the client side**
**Automating tasks**
**MPI environment configuration**
**Uploading and compiling computational applications**
**Staging input data / result collection**

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## Architecture
Client side: Interactive console
Unified and coherent interface
Resource virtualization
Mediators – “service-drivers”
Provider side: Access daemons
E.g., sshd, ftpd
Prototype implementation
FT-MPI
Java
JSch (SSH2 implementation)

**Client side: Interactive console**
**Unified and coherent interface**
**Resource virtualization**
**Mediators – “service-drivers”**
**Provider side: Access daemons**
**E.g., sshd, ftpd**
**Prototype implementation**
**FT-MPI**
**Java**
**JSch (SSH2 implementation)**

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## Add computational resource to DVM 
• Upload FT-MPI	 • Install
• Decompress sources	 • Launch FT-MPI daemons

**Invoke standard shell commands**

**Run MPI programs**

**DVM assembly**

**Data sync**

**Compile and build**

**Application launch**

**Add computational resource to DVM**** **
**•**** ****Upload FT-MPI****	**** ****•**** Install**
**•**** ****Decompress sources****	**** ****•**** Launch FT-MPI daemons**

**ZF-MPI console**

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

**zf-mpi> ft_mpi setNS compute**
**zf-mpi> ft_mpi add lab6a,lab6b,lab6c,lab6d,compute**
**zf-mpi> sync ~/NPB3.2.1/NPB3.2-MPI ~/zf-mpi/**
**zf-mpi> cd ~/zf-mpi/NPB3.2-MPI**
**zf-mpi> make bt NPROCS=****4**** CLASS=B**
**zf-mpi> mv bin/bt.B.****4**** $HARNESS_BIN_DIR/$HARNESS_ARCH/**
**zf-mpi> ft_mpi ftmpirun compute -np ****4**** -o bt.B.****4**** > log**
**z****f-mpi> cat log | grep "Time in seconds"**
**zf-mpi> ft_mpi console haltall**

***Set ZF-MPI VM: login user ******“******joe” on hosts and install FT-MPI***

***Set FT-MPI Name Service on host ******“******compute”***

***Create FT-******MPI ******VM with all hosts***

***Copy****** NP******B****** ******source code****** to ******all hosts in ZF-MPI VM***

***Change directory ******in ZF-MPI VM***

***Build****** NPB on ******ZF-MPI VM***

***Move ******executables****** to ******proper***** *****FT-******MPI ******VM ******directory***

***Execute****** FT-MPI****** application (BT benchmark)***

***Get****** result from log file***

***Stop****** ******FT-MPI VM***

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## Experimental evaluation 
NAS Parallel Benchmarks 3.2 for MPI
Linux/i86
Pentium 4 (2.4-2.8 GHz), 1 GB RAM
Linux Mandriva 2006 (kernel 2.6.12-12)
Solaris (non-GNU-based UNIX)
Sun Blade 2500, UltraSPARC-III, 1280 MHz
1 MB cache memory per processor, 2 GB RAM
Connected directly to 100 Mbit HP network switches
SunOS 5.10
Homogeneous cluster: class A, up to 16 processes
Heterogeneous cluster: class B, 8, 9 processes

**NAS Parallel Benchmarks 3.2 for MPI**
**Linux/i86**
**Pentium 4 (2.4-2.8 GHz), 1 GB RAM**
**Linux Mandriva 2006 (kernel 2.6.12-12)**
**Solaris (non-GNU-based UNIX)**
**Sun Blade 2500, UltraSPARC-III, 1280 MHz**
**1 MB cache memory per processor, 2 GB RAM**
**Connected directly to 100 Mbit HP network switches**
**SunOS 5.10**
**Homogeneous cluster: class A, up to 16 processes**
**Heterogeneous cluster: class B, 8, 9 processes**

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## Summary
ZF-MPI
Implements the new resource sharing model
Demonstrates feasibility of the run-not-install approach
Significantly reduces efforts such as deployment and execution
Does not affect performance of MPI applications

**Summary**
**ZF-MPI**
**Implements the new resource sharing model**
**Demonstrates feasibility of the run-not-install approach**
**Significantly reduces efforts such as deployment and execution**
**Does not affect performance of MPI applications**

- The Zero-Force MPI Toolkit –Toward tractable toolkits for HPC

## Contacts

- Magdalena Slawinska
- Emory University
- magg@mathcs.emory.edu
- Jaroslaw Slawinski
- Emory University
- jaross@mathcs.emory.edu
- Vaidy Sunderam
- Emory University
- vss@mathcs.emory.edu

-   Slawinska_ZF- MPI_SC07