# Presentation: 698355

## ASDC LATIS Archive StatusCurrently +38 million files and 782 TB 

| 2007 LATIS Archive Metrics
Jan. 1 – May 28 |  |
| --- | --- |
| Daily Avg. by # Files | 19,771 |
| Daily Avg. by Volume | 416 GB |
| Single Day Max. # Files | 57,452 |
| Single Day Max. Volume | 1.2 TB |
| Total # Files  | 2,926,092 |
| Total Volume | 61,692 TB |

- CERES DMT Meeting – May 30, 2007

## StorNext ArchiveJan. 18 – May 28, 2007

| # StorNext Writes | 4,995,331 |
| --- | --- |
| # StorNext Reads | 7,926,309 |
| StorNext TB Written | 261.6 |
| StorNext TB Read | 73.1 |
| # AMASS tapes | 3823 |
| # StorNext tapes | 822 |
| Current Volume (TB) | 782 |
| Current # Files (millions) | 38 |

## File retrievals via daacgetMay 1-28, 2007

| Top 10 daacget Users |  |
| --- | --- |
| Host system / userid | # Files retrieved |
| lightning / user1 | 54,590 |
| lanina / user2 | 10,012 |
| thunder / user3 | 8,799 |
| thunder / user1 | 7,394 |
| lightning / user3 | 6,805 |
| thunder / user4 | 5,935 |
| lightning / user5 | 3,168 |
| thunder / user6 | 2,875 |
| thunder / user7 | 1,226 |
| thunder / user8 | 1,185 |

## Why the transition from AMASS to StorNext?

- StorNext is the next generation product that replaces AMASS.
- ASDC implemented AMASS in LATIS 10 years ago along with the ECS to leverage compatibility and utilize lessons learned.
- AMASS supported by vendor for bug fixes only; no future enhancements.
- ESDIS/EMD contractor has funded the move to StorNext to save on AMASS maintenance costs.
- Moving away from expensive SGI server and RAID to Linux server and commodity disk storage
- StorNext reads AMASS written tapes; avoids Petabytes of data migration
- EMD/Raytheon implemented StorNext in ECS at NSIDC last month and is planning to install in ECS at LP DAAC and ASDC over next several months.

## Why the transition from AMASS to StorNext?

- Other StorNext benefits to ASDC:
- Takes advantage of high speed Storage Area Network (SAN) infrastructure to move data more efficiently throughout the enterprise
- Provides automated data integrity checking on tape I/O operations
- Automatically creates multiple tape copies and provides automated fail over to the backup copy when read to the primary tape fails.
- Can utilize a large disk cache (100s TB)  to minimize reads from tapes.
- Facilitates the management of data across multiple storage tiers (disks, tapes, off-line) based on data access needs over time.

## LATIS StorNext Archive Status

- Accessing files from the LATIS archive via daacget has been problematic for users since the transition to StorNext in Jan. 2007.
- Access times can be lengthy (minutes instead of seconds)
- File retrieval are sometimes unsuccessful
- ASDC staff is working intensely with Quantum/ADIC and other vendors to improve the situation.

## LATIS StorNext Archive Status

- Primary technical challenges:
- StorNext is less forgiving of STK tape drive errors than AMASS
- Tape drive errors will cause StorNext to take the entire library to go off-line
- StorNext is not utilizing tape drives efficiently to handle read requests
- Over 38 million files to manage (and growing)

## Actions taken or plannedto improve the situation

- ASDC staff fully trained on StorNext
- LATIS Archive management support provided 24x7
- ASDC implemented work-around solutions for some problems
- Utilizing Quantum 24x7 support to resolve issues as quickly as possible
- Having ongoing technical discussions with Quantum to resolve issues
- Weekly teleconferences
- Visit to Denver office to discuss product stability and support.
- Two Quantum Engineers on-site this week to observe problems first-hand and propose and help implement solutions.
- Will expand StorNext disk cache from 11 TB to 80 TB to reduce reads from tapes. (late summer/early fall)
- Continue to work with Quantum to tune and optimize StorNext for LATIS data flows.