+----------+------------------------------+----------+--------+-------+
| **M      |                              |          |        |       |
| ilestone |                              |          |        |       |
| (ID#):** |                              |          |        |       |
| Develop  |                              |          |        |       |
| a        |                              |          |        |       |
| hi       |                              |          |        |       |
| gh-level |                              |          |        |       |
| interp   |                              |          |        |       |
| rocessor |                              |          |        |       |
| commu    |                              |          |        |       |
| nication |                              |          |        |       |
| network  |                              |          |        |       |
| for      |                              |          |        |       |
| p        |                              |          |        |       |
| etaflops |                              |          |        |       |
| c        |                              |          |        |       |
| omputing |                              |          |        |       |
| (#36)    |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **       |                              |          |        |       |
| Level**: |                              |          |        |       |
| 2        |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Fiscal |                              |          |        |       |
| Year**:  |                              |          |        |       |
| FY06     |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **DOE    |                              |          |        |       |
| Area/Cam |                              |          |        |       |
| paign**: |                              |          |        |       |
| ASC      |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Co     |                              |          |        |       |
| mpletion |                              |          |        |       |
| Date**:  |                              |          |        |       |
| 9/30/06  |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **ASC    |                              |          |        |       |
| nWBS     |                              |          |        |       |
| Subpr    |                              |          |        |       |
| ogram**: |                              |          |        |       |
| Compu    |                              |          |        |       |
| tational |                              |          |        |       |
| Systems  |                              |          |        |       |
| &        |                              |          |        |       |
| Software |                              |          |        |       |
| Eng      |                              |          |        |       |
| ineering |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Parti  |                              |          |        |       |
| cipating |                              |          |        |       |
| Sites:** |                              |          |        |       |
| SNL      |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Descri |                              |          |        |       |
| ption**: |                              |          |        |       |
| The      |                              |          |        |       |
| interco  |                              |          |        |       |
| nnection |                              |          |        |       |
| network  |                              |          |        |       |
| between  |                              |          |        |       |
| pr       |                              |          |        |       |
| ocessors |                              |          |        |       |
| in a     |                              |          |        |       |
| super    |                              |          |        |       |
| computer |                              |          |        |       |
| is one   |                              |          |        |       |
| of the   |                              |          |        |       |
| fun      |                              |          |        |       |
| damental |                              |          |        |       |
| building |                              |          |        |       |
| blocks   |                              |          |        |       |
| in       |                              |          |        |       |
| m        |                              |          |        |       |
| assively |                              |          |        |       |
| scalable |                              |          |        |       |
| systems. |                              |          |        |       |
| To       |                              |          |        |       |
| deliver  |                              |          |        |       |
| general  |                              |          |        |       |
| purpose  |                              |          |        |       |
| p        |                              |          |        |       |
| etaflops |                              |          |        |       |
| scale    |                              |          |        |       |
| co       |                              |          |        |       |
| mputing, |                              |          |        |       |
| the      |                              |          |        |       |
| network  |                              |          |        |       |
| will     |                              |          |        |       |
| need to  |                              |          |        |       |
| deliver  |                              |          |        |       |
| 30       |                              |          |        |       |
| g        |                              |          |        |       |
| igabytes |                              |          |        |       |
| per      |                              |          |        |       |
| second   |                              |          |        |       |
| (per     |                              |          |        |       |
| dir      |                              |          |        |       |
| ection), |                              |          |        |       |
| 500 ns   |                              |          |        |       |
| MPI      |                              |          |        |       |
| latency, |                              |          |        |       |
| and 15   |                              |          |        |       |
| million  |                              |          |        |       |
| messages |                              |          |        |       |
| per      |                              |          |        |       |
| second   |                              |          |        |       |
| of       |                              |          |        |       |
| thr      |                              |          |        |       |
| oughput. |                              |          |        |       |
| A        |                              |          |        |       |
| hi       |                              |          |        |       |
| gh-level |                              |          |        |       |
| network  |                              |          |        |       |
| arch     |                              |          |        |       |
| itecture |                              |          |        |       |
| will be  |                              |          |        |       |
| d        |                              |          |        |       |
| eveloped |                              |          |        |       |
| to       |                              |          |        |       |
| deliver  |                              |          |        |       |
| this     |                              |          |        |       |
| level of |                              |          |        |       |
| per      |                              |          |        |       |
| formance |                              |          |        |       |
| for      |                              |          |        |       |
| de       |                              |          |        |       |
| ployment |                              |          |        |       |
| in       |                              |          |        |       |
| p        |                              |          |        |       |
| etaflops |                              |          |        |       |
| scale    |                              |          |        |       |
| co       |                              |          |        |       |
| mputers. |                              |          |        |       |
| The      |                              |          |        |       |
| arch     |                              |          |        |       |
| itecture |                              |          |        |       |
| will     |                              |          |        |       |
| address  |                              |          |        |       |
| network  |                              |          |        |       |
| issues   |                              |          |        |       |
| from the |                              |          |        |       |
| co       |                              |          |        |       |
| nnection |                              |          |        |       |
| to the   |                              |          |        |       |
| primary  |                              |          |        |       |
| p        |                              |          |        |       |
| rocessor |                              |          |        |       |
| to the   |                              |          |        |       |
| network  |                              |          |        |       |
| i        |                              |          |        |       |
| nterface |                              |          |        |       |
| arch     |                              |          |        |       |
| itecture |                              |          |        |       |
| to the   |                              |          |        |       |
| en       |                              |          |        |       |
| d-to-end |                              |          |        |       |
| rel      |                              |          |        |       |
| iability |                              |          |        |       |
| issue to |                              |          |        |       |
| the      |                              |          |        |       |
| router   |                              |          |        |       |
| arch     |                              |          |        |       |
| itecture |                              |          |        |       |
| and      |                              |          |        |       |
| topology |                              |          |        |       |
| to       |                              |          |        |       |
| connect  |                              |          |        |       |
| the      |                              |          |        |       |
| nodes.   |                              |          |        |       |
| The      |                              |          |        |       |
| effort   |                              |          |        |       |
| will     |                              |          |        |       |
| include  |                              |          |        |       |
| pre      |                              |          |        |       |
| liminary |                              |          |        |       |
| si       |                              |          |        |       |
| mulation |                              |          |        |       |
| studies  |                              |          |        |       |
| to       |                              |          |        |       |
| validate |                              |          |        |       |
| archi    |                              |          |        |       |
| tectural |                              |          |        |       |
| design   |                              |          |        |       |
| choices. |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Co     |                              |          |        |       |
| mpletion |                              |          |        |       |
| Cri      |                              |          |        |       |
| teria**: |                              |          |        |       |
| A full   |                              |          |        |       |
| speci    |                              |          |        |       |
| fication |                              |          |        |       |
| of the   |                              |          |        |       |
| hi       |                              |          |        |       |
| gh-level |                              |          |        |       |
| arch     |                              |          |        |       |
| itecture |                              |          |        |       |
| i        |                              |          |        |       |
| ncluding |                              |          |        |       |
| a        |                              |          |        |       |
| speci    |                              |          |        |       |
| fication |                              |          |        |       |
| of both  |                              |          |        |       |
| the      |                              |          |        |       |
| network  |                              |          |        |       |
| i        |                              |          |        |       |
| nterface |                              |          |        |       |
| and      |                              |          |        |       |
| router   |                              |          |        |       |
| that     |                              |          |        |       |
| will be  |                              |          |        |       |
| capable  |                              |          |        |       |
| of       |                              |          |        |       |
| de       |                              |          |        |       |
| livering |                              |          |        |       |
| the      |                              |          |        |       |
| per      |                              |          |        |       |
| formance |                              |          |        |       |
| needed   |                              |          |        |       |
| for      |                              |          |        |       |
| p        |                              |          |        |       |
| etaflops |                              |          |        |       |
| scale    |                              |          |        |       |
| c        |                              |          |        |       |
| omputing |                              |          |        |       |
| will be  |                              |          |        |       |
| co       |                              |          |        |       |
| mpleted. |                              |          |        |       |
| The      |                              |          |        |       |
| arch     |                              |          |        |       |
| itecture |                              |          |        |       |
| speci    |                              |          |        |       |
| fication |                              |          |        |       |
| will     |                              |          |        |       |
| include  |                              |          |        |       |
| fu       |                              |          |        |       |
| nctional |                              |          |        |       |
| diagrams |                              |          |        |       |
| illu     |                              |          |        |       |
| strating |                              |          |        |       |
| the      |                              |          |        |       |
| basic    |                              |          |        |       |
| co       |                              |          |        |       |
| mponents |                              |          |        |       |
| required |                              |          |        |       |
| in both  |                              |          |        |       |
| the      |                              |          |        |       |
| network  |                              |          |        |       |
| i        |                              |          |        |       |
| nterface |                              |          |        |       |
| and      |                              |          |        |       |
| router   |                              |          |        |       |
| and      |                              |          |        |       |
| their    |                              |          |        |       |
| intercon |                              |          |        |       |
| nection. |                              |          |        |       |
| The      |                              |          |        |       |
| fu       |                              |          |        |       |
| nctional |                              |          |        |       |
| behavior |                              |          |        |       |
| of each  |                              |          |        |       |
| block    |                              |          |        |       |
| will be  |                              |          |        |       |
| fully    |                              |          |        |       |
| d        |                              |          |        |       |
| escribed |                              |          |        |       |
| along    |                              |          |        |       |
| with the |                              |          |        |       |
| int      |                              |          |        |       |
| eraction |                              |          |        |       |
| between  |                              |          |        |       |
| blocks.  |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Cus    |                              |          |        |       |
| tomer**: |                              |          |        |       |
| ASC as a |                              |          |        |       |
| procurer |                              |          |        |       |
| of       |                              |          |        |       |
| systems  |                              |          |        |       |
| le       |                              |          |        |       |
| veraging |                              |          |        |       |
| the      |                              |          |        |       |
| network  |                              |          |        |       |
| tec      |                              |          |        |       |
| hnology. |                              |          |        |       |
| The      |                              |          |        |       |
| analyst  |                              |          |        |       |
| c        |                              |          |        |       |
| ommunity |                              |          |        |       |
| as a     |                              |          |        |       |
| user of  |                              |          |        |       |
| those    |                              |          |        |       |
| systems. |                              |          |        |       |
| The HPC  |                              |          |        |       |
| industry |                              |          |        |       |
| as       |                              |          |        |       |
| builders |                              |          |        |       |
| of the   |                              |          |        |       |
| systems  |                              |          |        |       |
| using    |                              |          |        |       |
| the      |                              |          |        |       |
| tec      |                              |          |        |       |
| hnology. |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **M      |                              |          |        |       |
| ilestone |                              |          |        |       |
| Certi    |                              |          |        |       |
| fication |                              |          |        |       |
| M        |                              |          |        |       |
| ethod:** |                              |          |        |       |
|          |                              |          |        |       |
| 1 - A    |                              |          |        |       |
| program  |                              |          |        |       |
| review   |                              |          |        |       |
| is       |                              |          |        |       |
| c        |                              |          |        |       |
| onducted |                              |          |        |       |
| and its  |                              |          |        |       |
| results  |                              |          |        |       |
| are      |                              |          |        |       |
| doc      |                              |          |        |       |
| umented. |                              |          |        |       |
|          |                              |          |        |       |
| 2 -      |                              |          |        |       |
| Prof     |                              |          |        |       |
| essional |                              |          |        |       |
| docume   |                              |          |        |       |
| ntation, |                              |          |        |       |
| such as  |                              |          |        |       |
| a report |                              |          |        |       |
| or a set |                              |          |        |       |
| of       |                              |          |        |       |
| vi       |                              |          |        |       |
| ewgraphs |                              |          |        |       |
| with a   |                              |          |        |       |
| written  |                              |          |        |       |
| summary, |                              |          |        |       |
| is       |                              |          |        |       |
| prepared |                              |          |        |       |
| as a     |                              |          |        |       |
| record   |                              |          |        |       |
| of       |                              |          |        |       |
| m        |                              |          |        |       |
| ilestone |                              |          |        |       |
| com      |                              |          |        |       |
| pletion. |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Su     |                              |          |        |       |
| pporting |                              |          |        |       |
| Reso     |                              |          |        |       |
| urces**: |                              |          |        |       |
| FTE      |                              |          |        |       |
| Funding  |                              |          |        |       |
| will be  |                              |          |        |       |
| required |                              |          |        |       |
| to       |                              |          |        |       |
| support  |                              |          |        |       |
| the      |                              |          |        |       |
| design   |                              |          |        |       |
| effort.  |                              |          |        |       |
| Compute  |                              |          |        |       |
| cycles   |                              |          |        |       |
| will be  |                              |          |        |       |
| required |                              |          |        |       |
| for      |                              |          |        |       |
| pre      |                              |          |        |       |
| liminary |                              |          |        |       |
| si       |                              |          |        |       |
| mulation |                              |          |        |       |
| studies  |                              |          |        |       |
| of       |                              |          |        |       |
| network  |                              |          |        |       |
| f        |                              |          |        |       |
| eatures. |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **       |                              |          |        |       |
| Codes/Si |                              |          |        |       |
| mulation |                              |          |        |       |
| Tools    |                              |          |        |       |
| Emp      |                              |          |        |       |
| loyed**: |                              |          |        |       |
| Computer |                              |          |        |       |
| system   |                              |          |        |       |
| and      |                              |          |        |       |
| hardware |                              |          |        |       |
| si       |                              |          |        |       |
| mulation |                              |          |        |       |
| appli    |                              |          |        |       |
| cations. |                              |          |        |       |
| ASC      |                              |          |        |       |
| appl     |                              |          |        |       |
| ications |                              |          |        |       |
| to       |                              |          |        |       |
| provide  |                              |          |        |       |
| input to |                              |          |        |       |
| drive    |                              |          |        |       |
| network  |                              |          |        |       |
| design   |                              |          |        |       |
| choices. |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Cont   |                              |          |        |       |
| ribution |                              |          |        |       |
| to the   |                              |          |        |       |
| ASC      |                              |          |        |       |
| Pr       |                              |          |        |       |
| ogram**: |                              |          |        |       |
| The ASC  |                              |          |        |       |
| program  |                              |          |        |       |
| is       |                              |          |        |       |
| res      |                              |          |        |       |
| ponsible |                              |          |        |       |
| for      |                              |          |        |       |
| p        |                              |          |        |       |
| roviding |                              |          |        |       |
| scalable |                              |          |        |       |
| c        |                              |          |        |       |
| omputing |                              |          |        |       |
| r        |                              |          |        |       |
| esources |                              |          |        |       |
| to solve |                              |          |        |       |
| the most |                              |          |        |       |
| cha      |                              |          |        |       |
| llenging |                              |          |        |       |
| problems |                              |          |        |       |
| in the   |                              |          |        |       |
| weapons  |                              |          |        |       |
| program. |                              |          |        |       |
| Recent   |                              |          |        |       |
| studies  |                              |          |        |       |
| indicate |                              |          |        |       |
| the need |                              |          |        |       |
| for      |                              |          |        |       |
| p        |                              |          |        |       |
| etaflops |                              |          |        |       |
| scale    |                              |          |        |       |
| c        |                              |          |        |       |
| omputing |                              |          |        |       |
| and this |                              |          |        |       |
| effort   |                              |          |        |       |
| is the   |                              |          |        |       |
| first    |                              |          |        |       |
| step in  |                              |          |        |       |
| de       |                              |          |        |       |
| livering |                              |          |        |       |
| the      |                              |          |        |       |
| interco  |                              |          |        |       |
| nnection |                              |          |        |       |
| network  |                              |          |        |       |
| that     |                              |          |        |       |
| will be  |                              |          |        |       |
| needed   |                              |          |        |       |
| to       |                              |          |        |       |
| support  |                              |          |        |       |
| it.      |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **Cont   |                              |          |        |       |
| ribution |                              |          |        |       |
| to       |                              |          |        |       |
| S        |                              |          |        |       |
| tockpile |                              |          |        |       |
| Stewar   |                              |          |        |       |
| dship**: |                              |          |        |       |
| S        |                              |          |        |       |
| tockpile |                              |          |        |       |
| Ste      |                              |          |        |       |
| wardship |                              |          |        |       |
| relies   |                              |          |        |       |
| on       |                              |          |        |       |
| scalable |                              |          |        |       |
| c        |                              |          |        |       |
| omputing |                              |          |        |       |
| r        |                              |          |        |       |
| esources |                              |          |        |       |
| provided |                              |          |        |       |
| through  |                              |          |        |       |
| ASC for  |                              |          |        |       |
| weapons  |                              |          |        |       |
| sim      |                              |          |        |       |
| ulations |                              |          |        |       |
| in       |                              |          |        |       |
| support  |                              |          |        |       |
| of the   |                              |          |        |       |
| S        |                              |          |        |       |
| tockpile |                              |          |        |       |
| Ste      |                              |          |        |       |
| wardship |                              |          |        |       |
| mission. |                              |          |        |       |
| The      |                              |          |        |       |
| sca      |                              |          |        |       |
| lability |                              |          |        |       |
| of these |                              |          |        |       |
| r        |                              |          |        |       |
| esources |                              |          |        |       |
| depends  |                              |          |        |       |
| on high  |                              |          |        |       |
| per      |                              |          |        |       |
| formance |                              |          |        |       |
| ne       |                              |          |        |       |
| tworking |                              |          |        |       |
| capab    |                              |          |        |       |
| ilities. |                              |          |        |       |
+----------+------------------------------+----------+--------+-------+
| **No.**  | **Risk Description**         | **Risk   |        |       |
|          |                              | As       |        |       |
|          |                              | sessment |        |       |
|          |                              | (low,    |        |       |
|          |                              | medium,  |        |       |
|          |                              | high)**  |        |       |
+----------+------------------------------+----------+--------+-------+
|          |                              | **Conse  | **     | **    |
|          |                              | quence** | Likeli | Expos |
|          |                              |          | hood** | ure** |
+----------+------------------------------+----------+--------+-------+
| 1        | The MPI bandwidth, latency,  | Low      | medium | m     |
|          | and message throughput       |          |        | edium |
|          | objectives may not be        |          |        |       |
|          | achievable given the         |          |        |       |
|          | limitations of technology in |          |        |       |
|          | the timeframe where          |          |        |       |
|          | petaflops scale computing is |          |        |       |
|          | expected. The risk has been  |          |        |       |
|          | mitigated by preliminary     |          |        |       |
|          | analysis that indicates      |          |        |       |
|          | technology can definitely    |          |        |       |
|          | approach these objectives.   |          |        |       |
+----------+------------------------------+----------+--------+-------+