# Presentation: 520610

## SSS Deployment using OSCAR

- John Mugler, Thomas Naughton & Stephen Scott

*August 2005,   Oak Ridge, TN                                                                           SSS Face-to-face meeting*

**Notes:**
[Version: 1.12,  8/17/05]
John Mugler, Thomas Naughton & Stephen Scott
Oak Ridge National Laboratory

ChangeLog.
(8/17/05) 
    o update RoadMap and add hackfest-agenda/TODO

(5/11/05) 
    o added RoadMap slide
    o updated/modified the schedule table

* (5/10/05) Updated slides:
   o re-order some slides (move oscar v4.1 summary to front/mid)
   o add ‘discussion/comments’ slide
   o few minor wording changes elsewhere

(5/10/05) Updated slides:
SSS-OSCAR Release Schedule
Goals for sss-oscar-2.0

(5/8/05) Updating to include:
   o status of sss-oscar-1.1 release (oscar-3.0 based)
   o comments for next v1.2 release (oscar-4.1 based)
   o review release schedule
   o comment on upcoming FRE testbed/repository (into TODO list)

- (1/24/05) Updating to include:
   o Review of sss-oscar-1.0 release
      o TODO/issues for upcoming sss-oscar-1.1 release (oscar-3.0 based)
      o Release schedule for 2005/sc'05
      o Highlight coming OSCAR features/changes
      o Mention possible [new] testbed at ORNL in the FRE (enclave)
      o Removed Phil’s name from this version b/c it is mainly new material and he’s back at ETSU

 - (8/26/04) Updating TODO & Resource slides. Adding “Current Status” and “Release” slides.

  - (5/5/04) 
       + Updated Wizard screen cap to a 3.0 capture.
       + 
 - SSS-OSCAR update.  
   The first slides (1-5) are the same as those presented at the 9/11/03 SSS meeting, with only minor revisions.

## OSCAR: Cluster Toolkit

- Framework for cluster management
- simplifies installation, configuration and operation
- reduces time/learning curve for cluster build
- requires: pre-installed headnode w. supported Linux distribution
- thereafter: wizard guides user thru setup/install of entire cluster
- Package-based framework
- Content:  Software  +  Configuration, Tests, Docs
- Types:
- Core:  SIS, C3, Switcher, ODA, OPD, (Support Libs)
- Non-core: selected & third-party
- Access: repositories accessible via OPD/OPDer

## OSCAR Wizard

*** OSCAR-3.0 release**

## Using OSCAR for SSS

***Problem***:  Helping users obtain and install SSS software.
***Solution***: Leverage OSCAR framework to package and distribute the SSS suite,  *sss-oscar*.
-    *sss-oscar*  A release of OSCAR containing all SSS software in single downloadable bundle.

## OSCAR-ized  SSS Components

- Bamboo – *Queue/Job Manager** *
- BLCR – *Berkeley Checkpoint/Restart*
- Gold – *Accounting & Allocation Management System*
- LAM/MPI (w/ BLCR) – *Checkpoint/Restart enabled MPI*
- MAUI-SSS – *Job Scheduler*
- SSSLib – * SSS Communication library*
*Includes: SD, EM, PM, BCM, NSM, NWI*
- Warehouse – *Distributed System Monitor*
- MPD2 – *MPI Process Manager*

** As of Aug 2005*

**Notes:**
TJN: (5/8/05)
  - I updated the “As of...” note, but it is the same as the previous “As of Apr. 2004”

TJN: (4/10/04)
Notes:
  - SSSLib – also contains the Build & Configuration components (node state mgr, etc.)
      However, the Service Directory, Event Mgr, and underlie communication infrastructure 
      are the primary aspects of this components.

## Current Status

- _Released_ v1.0 at SC’04
- Based on oscar-3.0 (using Red Hat 9/x86)
- All SSS components represented
- _Released_ v1.1 on July 8, 2005
- Based on oscar-3.0 (using Red Hat 9/x86)
- Misc. fixes and minor package updates
- Working on v1.2
- Based on oscar-4.1 (using Fedora Core 2/x86)
- Primary features being new oscar & newer distro
- Then to v2.0
- Based on oscar-4.x (using Fedora Core 2/x86)
- Note, if v2.0 is the SC’05 release, should this be FC4?
- Focus to be Less-Restrictive Syntax change over

**Notes:**
TJN: (8/17/05) – Update to show v1.1 and info about v1.2

TJN: (5/8/05) – We await further testing in order to release v1.1
                     -- The oscar-4.1 release is done, so now we’re ready to start integrating and update to newer linux 2.6 distro (FC2), etc.

TJN: (1/24/05) – updating for Jan’05 face-to-face (post SC’05 sss-oscar-1.0 release)

TJN: (5/5/04) -- updated for May face-to-face, 0.2a6 timeframe
   + Note, the OSCAR test framework shouldn’t require PBS and should enforce/allow set ordering.

## Goals for SC’05 release

- Release sss-oscar v2.0/2.0.1 at SC’05
- Compatible with oscar-5.0
- Support more current Linux distribution(s)
- Fedora Core 4
- Improved testing
- Supply thorough installation/validation/performance tests
- Documentation
- Specifications for component interfaces (schemas), etc.
- Improve interoperability with standard OSCAR
- Track more closely to SC’05 release
*Post SC’05 – “Package Sets”, SSS OPD Repository*

## SSS-OSCAR Release Schedule(updated Aug’05)

| SSS Version | Freeze Date | Release Date/Target | Based on OSCAR |
| --- | --- | --- | --- |
| v1.0 | ??? | Nov 10, 2004 | v3.0 |
| v1.1 | Feb 15 | Jul 8, 2005 | v3.0 |
| v1.2 | Jun 15 | July Aug | v4.1 |
| v2.0 | Aug 15  26? | Sept | v4.x |
| v2.0.1 | Oct 15 | Nov - SC’05 | v5.0 |

**Notes:**
TJN: (8/17/05)
 - Updated to reflect releases (done) and targets

## Roadmap(updated Aug’05)

- 1.2 (frz: jun, rel: jul aug)
- Fedor Core 2 / Pkg rebuild
- BLCR upgrade to linux-2.6
- Improved install/validation tests
- oscar-4.1 opkg modifications (updates)
- Updates to HOWTO as needed
- Simplify XML meta file
- Close (most) open tracker issues
- 2.0 (frz: aug, rel: sep)
- LRS change over
- Fedora Core 4 / Pkg rebuild
- Improved install/validation tests
- Add performance/stress tests?
- oscar-4.x opkg modifications (updates)
- Updates to HOWTO as needed
- Meta-scheduler (Silver)?

- 2.0.1 (frz: oct, rel: nov)  [SC’05]
- Any bugfixes/minor updates
- 2.0.2 or 2.1
- SSS oscar-pkg set
*# Do we want to use Fedora Core 2?*
- #         If not FC4, what for SC’05???

**Notes:**
TJN: (8/17/05) – updated and reorganized for two column presentation
TJN: (5/11/05) – added during meeting from group discussion

## TODO / Hackerfest (1)

- SecureID tokens
- Cindy’s working on this...
- Warehouse
- Testing/integration w/ Dave
- Integration of new version into suite release?
- BLCR
- Opps...
- Todd’s tests/analysis
- Look at any particular (directed) testing – Maui, Gold, etc.
- Jobs in queue not restart (hold state?)
- Gold
- RPMS into sss-oscar tree for 1.2!
- Extend SSS component tests
- Installation, Validation
- Durability/Stress, Performance

## Testing v1.2beta
Work on testing for release
Testing v2.0 features
Less-Restrictive-Syntax changeover
Documentation
Update OPkg Howto (if needed)
Update v1.2 release notes
SSS schemas/component specs.
SSS-OSCAR Tracker 
clean up / close out bugs
OSCAR stuffo
API script ordering via XML
Draft plan/prototype “Package Sets”
RH EL 4 system / testing

- Work on testing for release
- Testing v2.0 features
- Less-Restrictive-Syntax changeover
- Documentation
- Update OPkg Howto (if needed)
- Update v1.2 release notes
- SSS schemas/component specs.
- SSS-OSCAR Tracker
- clean up / close out bugs
- OSCAR stuffo
- API script ordering via XML
- Draft plan/prototype “Package Sets”
- RH EL 4 system / testing

**TODO / Hackerfest (2)**

**Notes:**
TJN: (8/18/05)
  - Note – trying to work on RH EL 4 support to help with ORNL cluster (to arrive in sept’05)

## Testing v1.2beta
Work on testing for release
Testing v2.0 features
Less-Restrictive-Syntax (LSR) changeover

Q: Should we create a 1.2 branch now and let folks start checking in LSR changeover stuff during “hackerfest” time?

How close is v1.2?  looking at this now...
How active is the LSR work in coming days?

- Work on testing for release
- Testing v2.0 features
- Less-Restrictive-Syntax (LSR) changeover
- _Q:_ Should we create a 1.2 branch now and let folks start checking in LSR changeover stuff during “hackerfest” time?
- How close is v1.2?  *looking at this now...*
- How active is the LSR work in coming days?

**SSS-OSCAR CVS**

## Resources

- ORNL test clusters
- Systems: *xtorc-sss*, *test1*
- Access via ORNL SSH Login Server
- Must do reservations/coordinate use  (Note, no remote power mgmt)
- SSS-OSCAR Project page
- Hosted at http://sourceforge.net/projects/sss-oscar/
- OSCAR Homepage
- http://www.OpenClusterGroup.org/OSCAR/
- Includes “*HOWTO: Create an OSCAR Package*” document

**Notes:**
TJN: (8/17/05)
 - Removing the following material related to FRE, no time right now
   if it comes online...we’ll use.
        o Investigating ORNL “FRE” (enclaves)
          - Add “testX” system to alleviate ORNL SSH Login Server

TJN: (1/24/05) changed things up, including wording & URLs, also adding the info about possible “FRE”

TJN: (8/26/04) changed most everything in order to fit info about the “Test1” cluster.

TJN: (5/5/04) – updated sss-oscar ver#

## Color code:

- BCWG

- RMWG

- PMWG

_**Color code:**_

**Working Components and Interfaces (bold)**
***Spr’03***

**Validation & Testing**

- VIWG

*N/A*

**Notes:**
TJN: (4/10/04)
I have set it to “hidden”.

This slide is only included to show the various SSS component areas, if you choose to.  

#-----------------------------------------------------------------------------------------
The BCWG model is not exactly accurate HIM & NSM are missing.
   - Hardware Infrastructure Manager (HIM)
   - Node State Manager (NSM)

These are considered part of the Node Configuration & Build Manager (NCBM) in this slide.
(Also, the “User DB” doesn’t really exist currently but is depicted in this slide.  This again would likely
fall under the NCBM umbrella.)
These components don’t really interact with components outside the BCWG domain so this is not a major issue.

## TODO / Hackerfest

- SecureID tokens
- Cindy’s working on this...
- Warehouse
- Testing/integration w/ Dave
- Integration of new version into suite release?
- BLCR
- Opps...
- Todd’s tests/analysis
- Look at any particular (directed) testing – Maui, Gold, etc.
- Jobs in queue not restart (hold state?)
- Gold
- RPMS into sss-oscar tree for 1.2!
- SSS-OSCAR Tracker
- clean up / close out bugs

- Testing v1.2beta
- Work on testing for release
- Testing v2.0 features
- Less-Restrictive-Syntax changeover
- Documentation
- Update OPkg Howto (if needed)
- Update v1.2 release notes
- SSS schemas/component specs.
- Extend SSS component tests
- Installation, Validation
- Durability/Stress, Performance
- OSCAR stuffo
- API script ordering via XML
- Draft plan/prototype “Package Sets”
- RH EL 4 system / testing

**Notes:**
TJN: original single slide version ... hiding for now (possibly good for printout?)