# Chiba Barnraising Instructions

v1.0, 17 October 1999

## Overview

Each team is responsible for building 1 **rack** of the Chiba computing
nodes.

A town in Chiba is formed from 2 racks that are configured a bit
differently. We'll call them a [Net rack]{.underline} and a [Mayor
rack]{.underline}. So, it will take 2 teams to build a complete Chiba
town of 32 nodes.

These instructions are for both types of racks, and in some places the
instructions will differ. You will need to remember which one you're
building.

See the back pages of this document for detailed maps of cables and such
for the racks. They may be helpful when working through this.

### Net Rack

A Net Rack has the following hardware in it:

16 VA Linux 501 Server compute nodes

1 Cisco 4000 ethernet switch (hence the \"net\")

2 rocketport serial units

5 baytech power units

1 "dumb" power strip

1 "dumb" power hub

### Mayor Rack

A Mayor Rack has the following hardware in it:

16 VA Linux 501 Server compute nodes

1 IBM Netfinity 5000 used as a town mayor (hence the \"mayor\")

1 IBM rack of disks

2 rocketport serial units

# Building Procedure

We\'ve divided the installation procedure up into \"tasks\". Each task
revolves around a specific goal.

Many of the tasks can be done at the same time as other tasks. We
recommend that each team break into two groups of 2 people, and that
each group work on different tasks in parallel.

Here is map of the tasks, which shows which ones we think can be done in
parallel, and where the team must come back together.

One group can do the things on the left, one group can do the things on
the right. The tasks in the middle require input from both groups.

#   {#section .unnumbered}

# Task 1 - Prepare the Rack

2 people.

The goal here is to get the rack into a place that it can be worked on,
and prepare it to install the first 8 computing nodes on the bottom of
the rack.

## Step 1. - Rack Location

1.  Move the rack into the right spot to build it. (It will probably
    already be there.)

2.  Lock the front wheels down so that it won't move.

## Step 2. - Prepare sides

1.  The sides should already be off.

2.  The back door should be on.

3.  Take the glass door off the front of the rack. You may need may need
    a flathead screwdriver to lift the door pins.

4.  Put the door pins on the team's parts table.

5.  Check to make sure that there are four fans mounted in the roof of
    the rack, and that they are in the back four positions.

6.  Confirm that there is not a power strip mounted in the rack.

## Step 3. - Position rails

Move the vertical rails as close together as possible:

1.  Loosen the allen bolts holding front rails and slide rails all the
    way back.

2.  Repeat for the back rails except sliding toward the front.

## Step 4. - Front Cage Nuts 

Using the silver cage nut pincher, put cage nuts into the rack for the
computers to be attached to as follows:

On the front rails, counting from the bottom hole, put cage nuts in like
this:

-   1 nut, skip 4 holes, 1 nut. (For the 1^st^ computer)

-   1 nut, skip 4 holes, 1 nut. (For the 2^nd^ computer)

-   \....

-   Repeat for 8 computers.

See the example rack to see exactly what to do.

## Step 5. - Rear Cage Nuts

Now put cage nuts on the back rails. Here we only put in nuts for every
4^th^ computer:

-   1 nut, skip 4 holes, 1 nut. (For the 1^st^ computer)

-   skip 18 holes

-   1 nut, skip 4 holes, 1 nut. (For the 5^th^ computer)

## Step 6. - Rails

The 1^st^ and 5^th^ computers will be mounted on rails in the back.

These should be pre-installed as follows:

-   With each computer will be 2 aluminum extender brackets and bolts
    for mounting them.

-   Attach 1 pair to the lowest set of cage nuts in the back.

-   Attach them loosely, to be tightened later.

-   Attach 1 pair to the next set of cage nuts in the back.

-   Again, attach them loosely, to be tightened later.

## Done

The rack is now ready to mount the first 8 computers in it.

**Task 2 - Prepare the first 8 nodes**

1-2 people

The goal here is to unbox the first 8 computing nodes, make sure
everything is there, remove the computers and prepare them to be put in
the rack, and get rid of the rest of the stuff it came with.

## Step 1. Find A Computer

These are the computing nodes that are stacked around the machine room
in large piles of white boxes. They say "VA Linux" on them.

## Step 2. Unbox

Open up a box near the pile where you found it. Don't open these up in
the main work area in the machine room, or we'll run out of room.

## Step 3. Get Computer

From the box, remove:

the metal rails

the 8 screws in the ziplock bag

the metal handles that are in bubble wrap

the power cable

the computer

Take all of these to your team's worktable and stack them up to be put
in the rack.

## Step 4. Get rid of Cruft

From the box, take the book and the CD:

Put the book in the kitchen under the white board.

Put the CD in the kitchen in the box by the white board.

Or feel free to keep them.

Take everything else (i.e. the box and wrapping) and put it neatly in
the hall outside the kitchen to be thrown away.

## Step 5. Take screws off the computers

Use a powerdriver.

1.  Take out all of the top screws that hold the cover on the computer,
    except for one screw in the back.

2.  Leave the left screw (as viewed from the back.)

3.  You'll remove a total of 9 screws:

-   3 on left

-   3 on right

-   2 on top front

-   1 on back

4.  Put these in a little box on the team worktable.

## Step 6. Put rack handles on

1.  Remove the 4 black screws from the front of each side.

2.  Attach the rack handles that came in the box.

3.  Rescrew them on using the same 4 black screws

## Done

You should now have 8 computers ready to go in the rack. Depending on
how the rest of your team is doing, you can start putting them in the
rack (Task 3), or start preparing the next eight computers (Task 4).

**Task 3 - Put the 1^st^ 8 nodes in the Rack**

2-3 people

The goal here is to put the first 8 nodes into the bottom of the rack,
ensuring that the computers and the rack were prepared correctly. At
completion, the computers should be firmly in the rack, but not yet have
network, serial, or power.

## Step 1. 1^st^ node into bottom

1.  Slide the 1^st^ node into the bottom of the rack.

-   Slide from the bottom of the rack.

2.  Use 4 silver screws to attach the front:

-   The bottom 2 screws will need a flathead screwdriver, the power
    driver won't reach.

3.  Attach the node to the rails on the sides using 4 black screws.

-   Get them loosely screwed into the rails and the holes.

4.  Tighten the screws that attach the rails to the back.

5.  Tighten the screws on the side of the node.

The node should now be snuggly installed.

## Step 2. The next 3 nodes.

1.  Slide the next node in on top of the previous node.

2.  Bolt it in on front using silver screws, with the powerdriver at 3.

3.  Don't attach anything on back.

Repeat until 3 computers have been put in this way.

## Step 3. Node 5.

Attach this one just above node 4.

See Step 1 for instructions. This node should have the side rails
attached.

## Step 4. The next 3 nodes.

See Step 2.

## Done

When you\'re done, you should have 8 computers snuggly in the bottom of
the rack.

#   {#section-1 .unnumbered}

# Task 4 - Prepare the remaining 8 nodes

1-2 people.

The goal here is to prepare the other 8 nodes to be put in the rack.
This is a separate task because it's easier to do eight at a time - the
piles of computers stay smaller, and you might swap around who is doing
which thing.

See Task 2 for instructions.

# Task 5.Net Rack - Put the Other Things in the Rack

(These instructions are specific to the [Net Rack]{.underline}.)

2-3 people

The goal here is to finish putting the hardware in the rack. Exactly
what goes in depends on if you're installing a Net rack or a Mayor rack.
These instructions are for the Net rack.

By now you should have a pretty good idea how cage nuts work and how to
attach things to the rack, so we'll just list what should be installed
where.

Put them on in this order:

2 rocketport serial switches at the very very top.

-   These get mounted with black mounting brackets, 1 on each side.

-   The cage nuts are in positions 1 and 3.

> 4 computing nodes just below the rocketports.

-   Put the bottom of the 4 in first, and attach it to rails on the
    side.

-   Then put the 3 above that.

-   Remember that the cage nuts are in positions 1 and 6.

-   Remember the rails on the bottom computer.

-   May have to loosen bottom rocket port to fit the top machine
    (node 16) underneath it.

> 4 computing nodes just below the top 4 computing nodes.

-   Put the bottom of the 4 in first, and attach it to rails on the
    side.

-   Then put the 3 above that.

-   Remember that the cage nuts are in positions 1 and 6.

-   Remember the rails on the bottom computer.

> 1 Cisco Ethernet switch right on top of the bottom 8 computing nodes.

-   The lower cage nuts go 2 holes above node 8. (I.e. leave 1 hole
    empty.)

-   Skip 14 holes and then put a cage nut in for the top of the Cisco.

> Now the unusual part. Put 5 Baytechs in the [back]{.underline} of the
> rack, below node 9.

-   Insert a cage nut underneath the aluminum bracket from node 9, in
    the back.

-   Skip a hole and insert another cage nut, then insert another caged
    nut right underneath that one.

-   Repeat for 7 more cage nuts, then repeat on the other side.

-   You should have a total of 10 caged nuts on each side.

-   Install 5 baytech power units using 20 silver screws.

> Install a black power strip underneath the Baytechs.

-   These cage nuts are 1 hole apart.

-   Mount the powerstrip using 4 silver screws.

> Install a "dumb hub".

-   A dumb ethernet hub is used to manage the baytechs.

-   Just set it on top of the top baytech, behind node 9.

That's all the hardware that goes in the Net Rack.

# Task 5.Mayor Rack - Put the Other Things in the Rack

(These instructions are specific to the [Mayor Rack]{.underline}.)

2-3 people

The goal here is to finish putting the hardware in the rack. Exactly
what goes in depends on if you're installing a Net rack or a Mayor rack.
These instructions are for the Mayor rack.

By now you should have a pretty good idea how cage nuts work and how to
attach things to the rack, so we'll just list what should be installed
where.

Put them on in this order:

1.  2 rocketport serial switches at the very very top.

-   These get mounted with black mounting brackets, 1 on each side.

-   The cage nuts are in positions 1 and 3.

2.  4 computing nodes just below the rocketports.

-   Put the bottom of the 4 in first, and attach it to rails on the
    side.

-   Then put the 3 above that.

-   Remember that the cage nuts are in positions 1 and 6.

-   Remember the rails on the bottom computer.

-   May have to loosen bottom rocket port to fit the top machine
    (node 16) underneath it.

3.  4 computing nodes just below the top 4 computing nodes.

-   Put the bottom of the 4 in first, and attach it to rails on the
    side.

-   Then put the 3 above that.

-   Remember that the cage nuts are in positions 1 and 6.

-   Remember the rails on the bottom computer.

4.  1 disk tray exactly **above** the bottom 8 computing nodes. You may
    need to get help from the IBM rep on this - these instructions are
    not quite complete.

-   The cage nuts for the disktray should be 6 apart, i.e:

-   start exactly above node 24

-   have 4 blank holes

-   then the top cage nut

-   Install the rails for the disktray into these cage nuts.

-   On the front, only put the bottom 2 bolts into the disktray.

-   Loosen 4 silver screws in the middle of the rails.

-   Take the front cover off the disk tray unit.

-   Slide the unit in place and secure it in place with 2 included
    screws in the remaining holes in front.

-   Slide the disks into the disktray.

5.  The mayor goes in the remaining space. It will be mounted on a
    sliding rail.

-   In the front of the rack, the cage nuts go like this:

-   Skip 4 holes from the top of the disk tray.

-   Put a cage nut in the 5^th^ hole.

-   Skip 4 holes going up.

-   Put a cage nut in the next hole.

-   Skip 1 hole going up.

-   Put a cage nut in the next hole.

-   There should be 3 holes left before node 25 starts.

-   In the back, put cage nuts in to match the top two cage nuts in
    front.

-   Mount the sliding rails on the top set of cage nuts you just
    installed.

-   Extend the sliding rails.

-   Put the mayor into the sliding rails.

-   To slide in the mayor, you will have to push some little button
    thingys inside the sliding rail.

-   Push in the mayor.

-   Put 2 screws into the front of the mayor to lock it into place.

That's all the hardware that goes in the Mayor Rack.

# Task 6.Net Rack - Prepare the computing nodes to be cabled

(These instructions are specific to the [Net Rack]{.underline}.)

1-2 people

These are merely the final steps before beginning to cable the racks.

## Step 1. Label the nodes

1.  Pre-number 16 labels from number 1-16.

2.  Put the labels on the appropriate computer:

-   in back

-   in the indented part of the back

-   just to the right of the parallel port

-   see the example towns

3.  Start with 1 on the bottom node, end with 16 on the top node.

## Step 2. Attach serial adapters

1.  Each computer should get two serial adapters attached to it.

2.  1 goes on the serial port on the upper left.

3.  1 goes on the serial port on the lower left.

4.  The adapters should be snuggly attached, with powerdriver set to
    torque 1.

## Step 3. Label the baytech power strips

1.  The top one should have a label with: B1: 1-8

2.  The next one down gets the label: B1: 7-16

3.  The next one down gets the label: B1: 17-24

4.  The next one down gets the label: B1: 25-32

5.  The bottom one gets the label: B1: net,mayor,disk,disk

# Task 6.Mayor Rack - Prepare the computing nodes to be cabled

(These instructions are specific to the [Mayor Rack]{.underline}.)

1-2 people

These are merely the final steps before beginning to cable the racks.

## Step 1. Label the nodes

1.  Pre-number 16 labels from number 17-32.

2.  Put the labels on the appropriate computer:

-   in back

-   in the indented part of the back

-   just to the right of the parallel port

-   see the example towns

3.  Start with 17 on the bottom node, end with 32 on the top node

4.  Don\'t number the mayor or the disk tray.

## Step 2. Attach serial adapters

1.  Each computer should get two serial adapters attached to it.

-   1 goes on the serial port on the upper left.

-   1 goes on the serial port on the lower left.

-   The adapters should be snuggly attached, with powerdriver set to
    torque 1.

2.  The mayor should also get two serial adapters. These go on the two
    upper serial ports (labeled \"A\" and \"C\" on the sticker below the
    ports).

## Step 3. Attach the disk to the mayor

1.  Attach a SCSI cable that connects the disk on BUS1 to the Mayor\'s
    right-most port.

#   {#section-2 .unnumbered}

# Task 7.Net Rack - Prepare the cables

(These instructions are specific to the [Net Rack]{.underline}.)

2 people

The goal is to get all the sets of cables ready to go into the racks.

This work may be easiest to do in an open space, where the cables can be
strung out.

## Step 1 - Blue Cables, for Serial

1.  Get 16 blue cables.

2.  Label them on both ends with the silver marker:

-   The labels should be "1", "2", "3", etc.

-   The labels should be on the flat part of the cable head, writing on
    it with the cable end facing away from you. In other words, you
    should be able to read the number right side up while plugging the
    cable into something.

3.  Bundle them into groups of 4:

-   Put cables 1-4 together.

-   Wire tie them tightly about a foot from each end.

```{=html}
<!-- -->
```
-   Put 3 wire ties down the lengths of the cables, with the goal of
    keeping all the cables pretty tightly together.

-   Trim the wire ties.

4.  Repeat for bundles 5-8, 9-12, 13-16.

## Step 2 - Purple Cables, for EMP

Same as the 16 blue cables.

## Step 3 - Black Cables, for network

Same as the 16 black cables.

## Step 4 - Power cables

1.  Get the 16 power cables from the cpus.

2.  Label them 1-16 on both ends.

3.  Bundle them into groups of four, wiretied.

4.  Get the power cable from the cisco.

5.  Label it "C" on both ends.

## Step 5 - Red Dumb Hub Network

This one is a bit different.

1.  Take **5** red cables.

2.  Label them 1-5.

3.  Wire tie both ends.

4.  Wire tie the middles.

## Done

As each of these steps are finished, the people working on the racks can
start to plug them into the appropriate place.

#   {#section-3 .unnumbered}

# Task 7.Mayor Rack - Prepare the cables

(These instructions are specific to the [Mayor Rack]{.underline}.)

2 people

The goal is to get all the sets of cables ready to go into the racks.

This work may be easiest to do in an open space, where the cables can be
strung out.

## Step 1 - Blue Cables, for Serial

5.  Get 16 blue cables.

6.  Label them on both ends with the silver marker:

-   The labels should be "17", "18\", \"19\" etc.

-   The labels should be on the flat part of the cable head, writing on
    it with the cable end facing away from you. In other words, you
    should be able to read the number right side up while plugging the
    cable into something.

7.  Bundle them into groups of 4:

-   Put cables 17-20 together.

-   Wire tie them tightly about a foot from each end.

```{=html}
<!-- -->
```
-   Put 3 wire ties down the lengths of the cables, with the goal of
    keeping all the cables pretty tightly together.

-   Trim the wire ties.

8.  Repeat for bundles 21-24, 25-28, 29-32

## Step 2 - Purple Cables, for EMP

Same as the 16 blue cables.

## Step 3 - Black Cables, for network

Same as the 16 black cables.

## Step 4 - Power cables

6.  Get the 16 power cables from the cpus.

7.  Label them 16-32 on both ends.

8.  Bundle them into groups of four, wiretied.

9.  Get the power cable from the mayor.

10. Label it "M" on both ends.

11. Get the power cables from the disk tray.

12. Label them \"d1\" and \"d2\" on both ends.

## Done

As each of these steps are finished, the people working on the racks can
start to plug them into the appropriate place.

# Task 8.Net.Rack - Plug in the Rack-Specific Cables

(These instructions are specific to the [Net Rack]{.underline}.)

2 people

The goal at this point is to install all of the cables that are specific
to this rack. (I.e. they don't get connected to the other rack.)

## Step 1 - Blue Serial Cables

1.  Connect the first bundle of blue cables:

-   Cable number 1 goes into Node 1's lower serial port. (COM1).

-   The other end of cable number 1 goes into the leftmost port on the
    lower rocketport.

-   The cable path should go up the left side of the rack (when looking
    at the back of the rack) so that the bundle of cables isn't in the
    way of the back of the system.

-   Do cables 2-4, continuing to connect across the lower rocketport.

-   Wiretie the end of the bundle near the rocketport to the back rail
    so that there is no weight on the rocketport connections.

2.  Repeat for cables 5-16.

## Step 2 - Purple Serial Cables

Exactly like Step 1, except that these cables go into the upper
rocketport.

## Step 3 - Power Cables

Install power cords into the appropriate nodes.

Run the power cord from node 1 into the leftmost power outlet on the top
baytech.

Attach 2 next to that, and so on through node 8.

Attach the top 8 nodes to the 2^nd^ rocketport.

## Step 4 - Black Network Cables

These cables go from the ethernet port on the back of the machine, up or
down the right side of the rack (when looking at it from the back), and
then into the Cisco.

These cables are a bit different. They go into the Cisco like this:

> 1 3 5 7 \... 15
>
> 2 4 6 8 \... 16

These should be wiretied to the right side of the rack near the Cisco to
anchor them.

## Step 5 - Red Dumb Hub Cables

1.  Plug cable 1 into bay tech 1, 2 into 2, and so on.

2.  Plug cable 1 into port 4 on the dumb humb, 2 into 5, and so on.

3.  Coil up the red cables, and wiretie them into one little bundle.

4.  Set them on top of the baytechs, next to the dumb hub.

5.  Tie them to the side.

# Task 8.Mayor Rack- Plug in the Rack-Specific Cables

(These instructions are specific to the [Mayor Rack]{.underline}.)

2 people

The goal at this point is to install all of the cables that are specific
to this rack. (I.e. they don't get connected to the other rack.)

## Step 1 - Blue Serial Cables

3.  Connect the first bundle of blue cables:

-   Cable number 17 goes into Node 17's lower serial port. (COM1).

-   The other end of cable number 17 goes into the leftmost port on the
    lower rocketport.

-   The cable path should go up the left side of the rack (when looking
    at the back of the rack) so that the bundle of cables isn't in the
    way of the back of the system.

-   Do cables 18-20, continuing to connect across the lower rocketport.

-   Wiretie the end of the bundle near the rocketport to the back rail
    so that there is no weight on the rocketport connections.

4.  Repeat for cables 21-32.

## Step 2 - Purple Serial Cables

Exactly like Step 1, except that these cables go into the upper
rocketport.

## Step 3 - Power Cables

Install power cords into the appropriate nodes.

They\'ll be connected into the other rack in a page or two.

## Step 4 - Black Network Cables

These also get connected into the other rack. Do nothing with them yet.

## Step 5 - Serial Control Cables

On the back of the mayor, in the PCI slots on the right, are 4 ports
that look sort of like complex serial ports. These are the ports used to
control the Rocketport boxes. There\'s 1 for each Rocketport. They are
arranged this way:

  ----------------------------------- -----------------------------------
  Net Rack Lower Rocketport           Net Rack Upper Rocketport

  Mayor Rack Lower Rocketport         Mayor Rack Lower Rocketport
  ----------------------------------- -----------------------------------

1.  Attach a white serial cable extender to each of these ports.

2.  Using black serial cable extenders, attach the correct mayor rack
    ports to the rocketports in this rack.

3.  Attach black serial cable extenders to the cables intended to go to
    the net rack, to be connected shortly.

# Task 9 - Position the Rack

2-3 people

Now we get the racks ready to be connected to each other and into the
central wiring infrastructure.

## 

## Step 1 - Floor Holes

Check with JP to get the correct type of tile on the floor. It should
have a hole cut in it.

## Step 2 - Roll the Rack

Roll the rack into the correct spot on the floor, being careful of the
hole.

## Step 3 - Align the Racks

Looking from the front of the systems, the rack with the Cisco in it
should be on the right, the rack with the mayor in it should be on the
left.

Leave a little space between for now to maneuver.

## Step 4 - Plug in the Power (Net Rack only)

Pop the tile next to the rack open so that you can get under the floor.

You\'ll find a really big electric outlet nearby.

Plug in the baytechs and the power strip like this:

  ----------------------------------- -----------------------------------
                                      B1

                                      B2

                                      B3

                                      B4

  PS                                  B5
  ----------------------------------- -----------------------------------

> PS = power strip
>
> B1 = Baytech 1
>
> Etc.

This is done this way so that we have the correct balance across
circuits.

## Step 5 - Connectivity cables

From the side, also pull these cables up and hang them in the rack for
later reference.

[Net Rack:]{.underline}

> Pull up the 2 gigabit ethernet fibers.
>
> Pull up the 1 red ethernet cable.

[Mayor Rack:]{.underline}

> Pull up the long blue console cable for the mayor
>
> Pull up the long purple EMP cable for the mayor

# Task 10 - Cross-Connect the Cables - Both Racks

2-3 people.

Now it's time to connect the two racks. This includes power for the
mayor rack and network for the mayor rack.

## Step 1 - Power from the Mayor Rack

1.  Install power cables into nodes 17-32 of the mayor rack.

2.  Run them between the racks into Baytech 3 (nodes 17-24) and into
    Baytech 4 (nodes 25-32).

3.  Attach the mayor power cable into Baytech 5, port 2.

4.  Attach the two disk power cables into Baytech 5, ports 3 and 4.

## Step 2 - Black Network Cables from the Mayor Rack

The network cables go from the ethernet port on the back of the machine,
up or down the right side of the rack (when looking at it from the
back), and then into the Cisco in the other rack.

These cables go into the Cisco like this, continuing the pattern
established before:

> 17 19 21 23 \... 31
>
> 18 20 22 24 \... 32

These should be wiretied to the left side of the rack near the Cisco to
anchor them.

## Step 3 - Mayor 100mbit

Plug the mayor's black 100mbit ethernet cable into port 33 on the Cisco.

Anchor it reasonably with wireties.

## Step 4 - Mayor GigE fiber

Plug the mayor's orange fiber cable into the leftmost GigE port on the
Cisco.

-   The red connector should be on the left, the black on the right.

-   On the mayor, the red connector should be on top and the black on
    the bottom.

## Step 5 - Dumb Power

Plug in the few things that we won\'t reset remotely into the black
power strip:

1.  Plug the fans from both racks into the black power strip.

2.  Plug the power from the dumb hub into the black power strip.

## Step 6 - Serial Control Cables

Plug in the serial control cables from the back of the mayor into the
appropriate rocketports in the net rack. See the diagram in Task 8.Mayor
Rack for details on which goes to which.

# Task 11 - Dock the Racks

2 people

At this point, the racks can be connected to the rest of the world.

## Step 1 - Gigabit Ethernet Uplink

Two fiber pairs should have been pulled from the floor back in task 9.

They should have labels on them - gige1 and gige2.

If not, grab JP.

Connect these into the Cisco GigE ports on the back.

-   GigE1 goes into GigE port 5.

-   GigE2 goes into GigE port 6.

-   The connector with the black tape on it should go on the right.

## Step 2 - Dumb hub uplink

Connect the red ethernet cable from the floor into port 1 on the dumb
hub.

## Step 3 - Serial uplink

Connect the blue serial cable from the floor into the back of the mayor
on the serial port on the left..

## Step 4 - EMP uplink

Connect the purple serial cable from the floor into the back of the
mayor on the serial port on the right.

## Step 5 - Lock down the racks

Now position the racks snuggly against each other.

Lock down the wheels.

# Task 12 - Boot and Load the OS

Everything is now connected and ready to go. Time to shift from hardware
installation to software installation and testing.

## Step 1 - Floppies

Put a pre-configured build floppy into the floppy disk of each node.

Don't put one in the mayor.

## Step 2 - Find Dan

1.  Yell "DAN".

2.  Yell "DAN" again.

3.  Break out a can of Mountain Dew. Pop the lid open.

4.  Dan should appear.

5.  Dan should confirm that testing software now is a good idea.

## Step 3 - Boot the mayor

The mayor should already be configured.

1.  Get Dan to boot it.

2.  Monitor the boot progress at the monitoring station.

## Step 4 - Power on all the nodes.

That\'s pretty much it. Push up on all the power switches on the nodes.

Keep an eye out for smoke.

## Step 5 - Watch on the monitoring station as the nodes boot

The self-test process on the compute nodes takes a while.

Following the self-test, the nodes will pull their Linux image off the
net and install it onto their local hard drives.

Then they will reboot and be running Linux off their own disks.

Because of the long self-test, this process takes about 20 minutes.

Progress can be monitored from the monitoring station.

## Step 6 - Record any problems on the white board.

There may be some miscabling to fix, or something might have blown up,
or there may be a software problem.

In any case, note town and node number, and write it on the problem log
on the white board.

# Task 13 - Test the installation and connectivity with an MPI program

We are now up, unless something really bad happened.

Every node in the town should be running Linux.

An enormous amount of work has yet to be done before these are actually
usable by someone other than root, but we can test connectivity and
functionality by running a simple MPI program.

## Step 1 - Make sure you still have a Dan available

## Step 2 - From the monitoring station, log in to the town mayor

What will happen at this point is that we will have a root shell on the
town mayor. (This is *not* how things will normally work once the entire
cluster is up and the rest of the software is working.)

From the town mayor, we start an MPI program on the 32 town nodes that
runs **pmandel**, a program that ships with MPICH, to test that basic
connectivity is working across the town.

## Step 3 - Run the pmandel test program

Play around with it.

Re-run with multiple processes on nodes.

## Step 4 - Party!!!

Thanks for helping with the Chiba Barnraising! We hope that you had a
good time.

Make sure you get your T-shirt before you leave, courtesy of VA Linux
and IBM.

# Town configuration Schematics

## Detail of Serial Control, 100Mbit Ethernet, Gig uplink

Ethernet(2)\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--\|

\| \-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--\| \|

\-\--\>\| \| V

\| \-\-\-\-\-\-\-\-\-\--RocketPort-\|
\-\-\-\-\-\-\-\-\-\-\--\|-\>RocketPort\<\--\|

\| \| \-\-\-\-\-\-\-\--RocketPort\-- \| \|-\>RocketPort\<-\|\|

\| \| \|\-\--Node32 \| \|\-\-\--Node16\-\-\-\-\-\-\-\-\-\--\|\|

Serial\-\--\|-\>\| \|\-\--Node31 \| \| Node15\-\-\-\-\-\-\-\-\-\--\|\|
Serial

\(32\) \| \| \|\-\--Node30 \|
Ether(8)Node14\-\-\-\-\-\-\-\-\-\--\|\|\<\-\--(32)

\| \| \|\-\--Node29 Ether(8) \| \| Node13\-\-\-\-\-\-\-\-\-\--\|\|

\| \| \|\-\--Node28\-\-\-\-\-\-\-\-\-\-\-\-\-\--\|\-\-\--\|
Node12\-\-\-\-\-\-\-\-\-\--\|\|

\| \| \|\-\--Node27 \| \| Node11\-\-\-\-\-\-\-\-\-\--\|\|

\| \| \|\-\--Node26 \| \| Node10\-\-\-\-\-\-\-\-\-\--\|\|

\| \| \|\-\--Node25 \| \| Node9\-\-\-\-\-\-\-\-\-\-\--\|\|

\|\-\-\-\-\-\-\--Netfinity\-\-\-\-\-\-\-\-\-\-\--\| /\--\|\-\-\--\\ 2u
empty \|

\|\-\-\-\-\-\-\-\--/ Disk \\ \| \|\-\--\>Cisco 4000 \|

\| \|\-\-\-\--Node24 \| Gigabit \| \| Node8\--\|\-\-\-\-\-\-\-\-\--\|

\| \|\-\-\-\--Node23 \|\-\-\-\-\-\-\-\-\-\-\--/ \|
Node7\--\|\-\-\-\-\-\-\-\-\--\|

\| \|\-\-\-\--Node22 Ether(8) Node6\--\|\-\-\-\-\-\-\-\-\--\|

\| \|\-\-\-\--Node21 Ether(8) \| Node5\--\|\-\-\-\-\-\-\-\-\--\|

\| \|\-\-\-\--Node20\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--\|
Node4\--\|\-\-\-\-\-\-\-\-\--\|

\| \|\-\-\-\--Node19 \| Node3\--\|\-\-\-\-\-\-\-\-\--\|

\| \|\-\-\-\--Node18 \-\-\-\--Node2\--\|\-\-\-\-\-\-\-\-\--\|

\| \-\-\-\-\--Node17 Node1\--\|\-\-\-\-\-\-\-\-\--\|

\| \|

\| \|

Cat5 2 cables to Emp and Com1 Gigabit(2)

to city rack to city rack

##  

## Detail of Power Cords, Power hub

RocketPort RocketPort

RocketPort RocketPort

Node32\-\-\-\-\-\-\-\-\-\-\-\--\| Node16\-\-\-\-\-\-\-\-\-\--\|

Node31\-\-\-\-\-\-\-\-\-\-\-\--\| Node15\-\-\-\-\-\-\-\-\-\--\|

Node30\-\-\-\-\-\-\-\-\-\-\-\--\| Node14\-\-\-\-\-\-\-\-\-\--\|

Node29\-\-\-\-\-\-\-\-\-\-\-\--\| Node13\-\-\-\-\-\-\-\-\-\--\|

Node28\-\-\-\-\-\-\-\-\-\-\-\--\| Node12\-\-\-\-\-\-\-\-\-\--\|

Node27\-\-\-\-\-\-\-\-\-\-\-\--\| Node11\-\-\-\-\-\-\-\-\-\--\|

Node26\-\-\-\-\-\-\-\-\-\-\-\--\| Node10\-\-\-\-\-\-\-\-\-\--\|

Node25\-\-\-\-\-\-\-\-\-\-\-\--\| Node9\-\-\-\-\-\-\-\-\-\-\--\|

DiskTray\-\-\-\--\| \| \-\-\-\-\--\>powerhub 1\<\-\-\-\-\--\| Cisco

Netfinity\-\-\--\| \| \| powerhub 2\<\-\-\-\-\--\| 4000

\| \-\-\-\--\|\-\-\-\--\>powerhub 3 \| \|

\| \-\-\-\--\|\-\-\-\--\>powerhub 4 \| \|

\-\-\-\-\-\-\-\-\-\--\|\-\-\-\--\>powerhub 5\<\-\-\-\-\-\-\-\-\--

Node24\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node8\-\-\-\-\-\-\-\-\-\-\--\|

Node23\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node7\-\-\-\-\-\-\-\-\-\-\--\|

Node22\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node6\-\-\-\-\-\-\-\-\-\-\--\|

Node21\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node5\-\-\-\-\-\-\-\-\-\-\--\|

Node20\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node4\-\-\-\-\-\-\-\-\-\-\--\|

Node19\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node3\-\-\-\-\-\-\-\-\-\-\--\|

Node18\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node4\-\-\-\-\-\-\-\-\-\-\--\|

Node17\-\-\-\-\-\-\-\-\-\-\-\--\| \| Node1\-\-\-\-\-\-\-\-\-\-\--\|

\|

DumbHub\-\-\-\--\|\<\-\-\--(5) Ethernets 1 to

\| each hub

\|

\|

Control Net uplink to city rack (1 Ethernet)

## Naming and Numbering

RocketPort RocketPort

RocketPort RocketPort

Node32 Node16

Node31 Node15

Node30 Node14

Node29 Node13

Node28 Node12

Node27 Node11

Node26 Node10

Node25 Node9

DiskTray 2u empty (Baytechs in back)

Netfinity Cisco 4000

Node24 Node8

Node23 Node7

Node22 Node6

Node21 Node5

Node20 Node4

Node19 Node3

Node18 Node2

Node17 Node1

##