This document details the setup, installation, and configuration of the
Rocks server from both a hardware and software standpoint. It also
details the creation of the appropriate appliances that USCMS will be
defining for its new installation.

Rocks Server Installation:

The initial installation of a Rocks server must be done with the use of
a video monitor, keyboard and CDROM drive. The actual installation is
fairly straightforward, but the post-configuration of the Rocks server
to make it Fermi compliant can take a fair bit of time.

So, sitting at the machine do the following:

1.  Make sure BIOS is correct.

    1.  Hyperthreading is on.

    2.  Serial console is on and set to 115200,8,1n with hardware flow
        control.

    3.  Other parameters?

2.  Obtain current stable Rocks CD-ROM (3.0.0 and HPC roll)

    1.  The new (beta) version of rocks is necessary in order to get the
        latest network drivers. This requires two disk, the base "roll"
        disk and the HPC "roll" disk.

    2.  These will be provided by Joe Kaiser at install time.

```{=html}
<!-- -->
```
3.  Insert CD into ASA machine and boot.

    1.  Type "frontend" at boot prompt.

    2.  When it asks if you have a roll choose "Yes"

    3.  Insert HPC Roll CD when prompted.

    4.  Choose "No" when it asks for another roll.

    5.  Put Rocks Base CD back in when prompted. It should probe,
        monitor, video, and mouse and bring you to Cluster information.

    6.  Fill in cluster information.

        1.  Cluster Name -- USCMS

        2.  Owner:

        3.  Contact: - <cms-team@fnal.gov>

        4.  URL: [http://machine.name](http://machine.name/).

        5.  LatLong:

    7.  It will ask for your partitioning method -- "Choose Disk Druid"

        1.  Create a swap partition double the size of the ram

        2.  Create a root partition of about 10 GB

        3.  Create a /var of about 2-3GB

        4.  Create a /tmp of about 2-3 GB

        5.  Create a /export on the SECOND drive.

    8.  Networking.

        1.  If there is no private subnet then eth0 is the public
            address

        2.  Fill in netmask which is:

        3.  Fill in nameservers: 131.225.8.120, 131.225.17.150

        4.  Hostname -- is cmssrv?.fnal.gov

    9.  Fill in root password.

    10. Authentication configuration

        1.  disable NIS

        2.  Leave the rest alone.

        ```{=html}
        <!-- -->
        ```
        8.  Now it will format partitions and install packages.

            1.  It will say "Installing Roll \'Rocks Base\' This will
                take some time

            2.  Wait.

            3.  It will ask for the HPC roll disk again. Insert and
                choose OK.

            4.  It will say "Installing Roll \'hpc\'. This will take
                some time\.....

            5.  Wait.

            6.  The node will automatically reboot. Take out the CD.

```{=html}
<!-- -->
```
4.  Configuration

    1.  Login as root.

        1.  It will prompt you for an SSH key. Just hit return until you
            get a root prompt.

    2.  Turn off unneccesary services

        1.  chkconfig --level 2345 \<service\> off

        2.  pvfsd, pbs_server, maui, ypserv ypbind iptables ipchains,
            named, mgr, sgi_fam, apmd, lpd, sendmail

    3.  Get kerberized SSH.

        1.  gftp to [linux.fnal.gov](http://linux.fnal.gov/)

        2.  cd /linux/73rolling/i386/RedHat/RPMS

        3.  mget openssh-\*

        4.  quit

        5.  rpm -ivh openssh-\*

    4.  Reboot to get the proper ssh and to make sure all services are
        running correctly.

    5.  Obtain the rest of the Rocks distribution

        1.  cd /export/home/ install

        2.  rocks-dist mirror

        3.  Wait until it downloads.

        4.  

    6.  Sync with fermi distribution.

        1.  rocks-dist \--mirror-host linux.fnal.gov -r 73rolling -a
            i386 -l \" \" \--mirror-dir linux mirror

5.  configure dhcp

mirror fermi distro

create rocks-dist

install fermi comps file from old rocks server

create rocks-dist

install worker node is it correct

Create appliances (import old fermi graph)

I.  Rocks Software installation

    A.  Install Rocks 2.3.2

    B.  rsync distribution from Fermi 73rolling

    C.  Create Appliances (create graphs)

        i.  Server

            a.  create appropriate xml graph files

            b.  create comps file definition ?

            c.  Partitioning scheme

            d.  create fermi-server.xml

        ii. Worker node

            a.  create xml graphs

            b.  comps file definition?

            c.  partitioning scheme

            d.  create replace/extend compute-node.xml

        iii. Console

             a.  create xml graphs

             b.  comps file def

             c.  partitioning scheme

             d.  install console rpm

             e.  create fermi-console.xml

        iv. dCache pool

            a.  create xml graphs

            b.  comps file definition

            c.  partitioning scheme

            d.  fermi-dcpool xml

        v.  Interactive node for (UAF) cluster

            a.  create xml graphs

            b.  comps file def

            c.  partitioning scheme

    D.  Insert MAC address/IP/node type mappings into db

        i.  Check insert-ethers options

        ii. Create python script

    E.  Voldemort configuration and installation

        i.  Install on rocks server

        ii. Create node database

        iii. Create system wide files

             a.  Minimal passwd ?

        iv. Create localized files

            a.  servers

                -   webservers ?

                -   Dcache ?

                -   FBSNG head node?

                -   MOP Master?

            b.  Workers

                -   UAF

                -   PG

                -   Burn-in configuration

            c.  console?

        v.  

    F.  Test install

        i.  Install worker node