# Presentation: 922582

## Vision for System and Resource Managementof the Swiss-Tx class of Supercomputers

- Josef Nemecek
- ETH Zürich & Supercomputing Systems AG

## Agenda

- The Supercomputer Lifecycle then and now
- The Swiss-T1 Management SW: **COSMOS**Commodity Supercomputer Management Operating System
- The goals of COSMOS
- The concept of COSMOS
- Implementation of COSMOS
- Software Integration with existing Parts
- Roadmap of **COSMOS**

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## Supercomputers – Then and Now

- Development by vendor
- Hardware was hand-made
- Software was tailored for hardware
- Customers just had to orderout of the vendor’s catalogue

**Test**

**Manage**

**Need**

**Order**

**$$$**

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## Supercomputers – Then and Now

- System looks like a puzzle
- Commodity parts, multiple vendors
- Zoo of interacting software components
- Individual system management
- Millions of lines of code (scripts, daemons)

**Simulation**

**Manage**

**Thought**

**Design**

**$$$ & t******

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Goals

- Integrated management for whole lifecycle
- Design the supercomputer on-line
- Simulate the supercomputer performance on-line
- Build the designed and simulated supercomputer
- Manage the built supercomputer
- Complete run-time system management
- Fault-tolerance on all (or most) system levels
- Remote manageability of the whole supercomputer
- Low run-time overhead for the system management

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Supercomputer Design

**Architecture selection**
**SAN technology**
**Nodes technology**
- Topology selection
- Every topology has it’s +/–
- Resource usage
- Cost of the supercomputer
- Space, electrical power
- Performance estimation

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Supercomputer Design

- Architecture selection
- SAN technology
- Nodes technology
**Topology selection**
**Every topology has it’s +/–**
- Resource usage
- Cost of the supercomputer
- Space, electrical power
- Performance estimation

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Supercomputer Design

- Architecture selection
- SAN technology
- Nodes technology
- Topology selection
- Every topology has it’s +/–
**Resource usage**
**Cost of the supercomputer**
**Space, electrical power**
- Performance estimation

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Supercomputer Design

- Architecture selection
- SAN technology
- Nodes technology
- Topology selection
- Every topology has it’s +/–
- Resource usage
- Cost of the supercomputer
- Space, electrical power
**Performance estimation**

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Goals

- Single-system view of whole system
- Allows one-point system management
- Allows remote system management
- High availability of the system management
- Allows high over-all system up-times
- Allows dynamic configuration changes
- Modular software design
- System-independent concept & design
- Interfaces to existing management software modules

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Concept

**Configuration**
- Control the system
**Monitoring**
- Observe the system
**Planning**
- When? Who? What?

**Security**
- Stability & independence
**Faults & Traps**
- Help the system
**Accounting**
- Charge the usage

**Complete, integrated system management**
**Remote management from everywhere**
**No administrative programming necessary**

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Implementation

**System Management**

**Node Management**

**SAN Management**

**Process Management**

**Resource Management**

**Storage Management**

**LAN Management**

**User Interface**

- State control and monitoring
- of the nodes, accounting

- SAN-dependent management
- and monitoring, accounting

- Support of and co-operation with parallel environments as MPI/FCI

- Resource management:
- Priorities, allocation, queues

- Vendor-dependent storage
- management software

- SNMP-based management of
- used LAN components

- User-privilege-based
- management and monitoring

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Implementation

**Management Center**

**COSMOS Center**

**Node 0**

**COSMOS Agent**

**Node 1**

**COSMOS Agent**

**Node 3**

**COSMOS Agent**

**Node 2**

**COSMOS Agent**

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## Gridware GRD/Codine

- Powerful resource management
- Integrates resource and batch management
- Ticket-based job scheduling scheme
- Well-defined interfaces
- Some drawbacks at this moment
- GRD/Codine is not topology-aware
- GRD/Codine is a commercial product

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## COSMOS – Interaction with GRD/Codine

**System Management**

**Node Management**

**SAN Management**

**Process Management**

**Storage Management**

**LAN Management**

**User Interface**

**GRD/Codine**

**Node Monitoring**

**Process Monitoring**

**Resource Management**

**User Interface**

**Accounting**

**Resource Management**

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## Roadmap of COSMOS Development

- Prototype release plan for COSMOS
- 1Q2000	– Centralised process and SAN management
- 2Q2000	– Distributed system management framework
- 3Q2000	– Complete non-interactive management
- 4Q2000	– Complete interactive management
- Interaction between COSMOS & GRD/Codine
- Transfer of topology and configuration information
- Exchange of monitoring information

- SOS Workshop 2000 (New Orleans, LA)

- 09.03.2000

## Vision for System and Resource Managementof the Swiss-Tx class of Supercomputers

- Josef Nemecek
- ETH Zürich & Supercomputing Systems AG