# Presentation: 235610

## System Design of the Kennedy Space Center Toplevel World Wide Web (WWW) Server

- 1

*System Design of the Kennedy Space Center Toplevel World Wide Web (WWW) Server*

- This talk covers the underlying system design and technical aspects of KSC Top Level WWW server, including hardware and software systems and interfaces to external sources of information.
**Jim Dumoulin -  NASA Payload Operations**
**Internet Systems Lab - Kennedy Space Center**

## KSC’s WWW Toplevel Server

*KSC’s WWW Toplevel Server*

- DEC Alpha 2100/5000 Servers
- Multiple DEC Alpha Processors
- 640Mbytes of RAM, 24Gbytes Disk (RAID 5 and RAID 1) on main Public server  - 160Gbytes total on cluster
- Redundant hot-swappable power supplies
- Multiple Networks (1FDDI, 3 Ethernets)
- Workload spread across 13 other systems
- Digital OSF/1 Unix, Apache HTTPD

## KSC’s server on Launch Day

*KSC’s server on Launch Day*

- Saturates E-1 and Fractional T-3 Circuits into KSC
- 1.8 Million hits within a few hours around launch time.
- CPU capacity not the problem but network congestion requires constant tweaking to handle load.

## WWW.KSC.NASA.GOV

- Cluster of 4 multi-processor Dec Alpha Servers on
- a 100Mb/s FDDI ring.  Current Disk Capacity 160Gbytes

## Internet Lab System Hardware

- NOMAD01

*Internet Lab System Hardware*

- TITAN01
- VMS 7.1
- 128MB RAM
- (User Accounts)

- 16G Raid 5

- TITAN03
- OSF/1 4.2
- 128MB RAM
- (News/WAIS)

- 22G Raid 5

- TITAN02
- OSF/1 4.2
- 512MB RAM
- (User Accounts)

- 9-Track Tape

- Exabyte 120
- 4 Drive Tape
- Jukebox System
- 115 8mmTapes
- 1 Robot

- ZENO OSF/1 4.2
- WWW Hot Mirror

- Parallel Search &
-  ListServ Engine
-  14 DEC5000’s

- FDDI Concentrator

- CISCO 7000

- NIVEN OSF/1 2.0
- News/Listserv

- 18G Raid 5

- TITAN04
- OSF/1 4.2
- 640MB RAM
- (WWW/FTP)

- 24G Raid 5

- 0

- 1

- 2

- 3

## WWW Page creation

- 70,000+ HTML pages on Server - most produced and hypertexed automatically thru a series of PERL scripts
- Interfaces to external systems for dynamic content thru Common Gateway Interface (CGI) Scripts
- Daily content and automatic backups done thru Unix Crontabs

## Automatic Hypertexing

*Automatic Hypertexing*

- Treat HTML as a binary Language
- Keep original material in text files
- Run all text thru Hypertext Perl Program
- Program searches for Regular expressions in context and replaces with Hypertexed URL’s from dictionary

## Regular Expression Example

*Regular Expression Example*

- The Regular Expression:
- ([\s,\.\(\)])
-      (T-[minus ]*([\d]+)[hour]*[s]*[and counting]*)
- ([\s,\.\(\)])
- Matches:
- (T-minus 1 hour), T-1 hour, T-10 hours,
- T-43 hours and counting

## Flow of Hypertext Program

- WWW Page
- .html

*Flow of Hypertext Program*

- Status Archive
-      .txt files

- WWW Disk Farm Information Archive
-     (HTTP/FTP/Gopher/NFS/Samba)

- RE to URL

- WAIS - Full
-  Text Index

- Listserv

- E-Mail

- USENET

- INN Overchan

- mailtonews.py

- .txt

- .html

- to archive

## Image Creation

*Image Creation*

- Input is a Captions Text file and a series of  High Resolution Photos (digitally transferred or manually scanned)
- Output products:
- Contact Sheet Page and Clickable Map
- Photo Index HTML Page
- Image converted and stored in multiple formats (Tiny, Low, Medium, High)
- Captions Hypertext File

## Flow of Image Creation

*Flow of Image Creation*

- Contact Sheet

- Photo Index

- Captions

- Tiny

- Low

- Med

- High

- PhotoID  (L,M,H)  title

- Tiny

- Titan04

- Titan02

- NT

- Photo Lab

- NT

- Scanner

- Scanner

- Writers
- Group

- Titan03

- STS #

- Image
- Converter

- High

- build_contact.pl

- samba

- build_captions.pl

- captions.txt

- E-mail and List Server

- scsi

- build_images.pl

- NFS

- PBM toolkit

- PhotoID  (L,M,H)  title

- Digital

- Print

## Movie/Video Capture Process

*Movie/Video Capture Process*

- Input comes from NASA TV, VCRs, RF-System or via one of over 900 Cameras on KSC’s  OTV System.
- Have multi-input video capture cards in PC’s (Creative Labs RT-300, SE-100, RealMajic Encoder)
- Process is pipelined thru multiple CPU’s and stages
- RT-300 or SE-100 saves BMP or AVI file via Samba
- PBMtoolkit converts .BMP or .AVI to .GIF or JPEG.
- AVI files are edited as small as possible.
- If MPEG is needed, AVI is riped into individual Targa frames then Encoded into an MPEG

## Movie Creation

*Movie Creation*

- 1

- 2

- 3

- 4

- RT-300

- 486PCs

- SE-100

- 486PCs

- Grass Valley Video Switch

- OTV

- NASA
- Select

- VCR

- Titan02

- Titan04 / WWW.KSC.NASA.GOV

- Convert
-    BMP to GIF
-    BMP to JPG
- AVI to TARGA
-    AVIRIP

- Pentium

- PentiumPC

- RealMagic
- MPEG Encoder
- with Sound

- Samba

- AVI
- to MPEG
- Editor
- (Adobe)

- Transcode

- Encode

- SE-100 Video
- Grabber

- Dual Pentium

- CMPEG

- Live Video
- Pages

- MPEG
- Movies

- Samba

- Samba

- Samba

- NFS
-  via
- FDDI

- 1

- 2

- 3

- 1

- 2

- 3

## Video Capture Devices

- Creative Labs RT-300 -
- PC ISA Card, no longer in production
- 4 Video Inputs (3 RCA/1 S-VIDEO)
- Creative Labs SE-100 -
- PC ISA Card, Better quality than RT-300
- 3 Video Inputs (2 RCA/1 S-video)
- Sigma Designs Real Magic Producer
- Direct MPEG production but cannot produce MPEGS at slow frame rates
- Expensive

## Summary

*Summary*

- The KSC Home Server
- uses Regular Expressions to help maintainability
- uses RAID to help Availability
- offloads processing to handle exponential growth
- doesn’t worry about marketing since NASA data belongs to the tax payers