**Aura DSWG Fall 2007**

**Attendees:**

via phone:

H.K. (Rama) Ramapriyan - ESDIS

Brian Krupp

Marghi Hopkins - OMI SIPS

Peter Leonard - OMI

at location:

Cheryl Craig - NCAR

Alfreda Hall - ESDIS

Brian Knosp - JPL

James Johnson - GES DISC

Jacques Claas - KNMI

Joe Purcell - Lockheed Martin

Dominick Miller - JPL

David Cuddy - JPL

Doug Shepard - JPL

Paul Wagner - JPL

Christina Vuu - Raytheon

Pepijn Veefkind - KNMI

Phillip Durbin - OMI SIPS

Ryan Fuller - JPL

William Daffer - JPL

*Many thanks to Alfreda Hall for taking these minutes and typing them up
in time for my overview presentation preparation*

**Meteorological Group: GMAO summary from morning**

-   Retro -- 2 streams finish in Apr 08; one month overlap; 5.01 stop at
    end of one month.

-   Start 5.1.0 next Mon 8^th^ -- April 2008; 1 forward stream and 2
    retro streams running

**HIRDLS Report : Vince**

-   V2.02.07 to DISC; process 2 recent data

-   Doing a lot more algorithm development due to obstruction

-   Processed the whole mission V2.04.08; processing now with V2.02.09
    and will next full scale release in October

-   Next year will incorporate GEOS v5.1.0

Naming convention -- 1st digit - major, 2^nd^ - minor, 3^rd^ - small
changes/bug fixes.

GEOS 5 -- uses for retrievals

ESDIS Evolution - Significant impact on SIPS operations -- I/F changes
on both sides (DISC and HIRDLS); DISC was very responsive; MRI using it
a lot and the dot charts.

Forces -- multiple processing versions

Resolutions - production system does a very good job keeping track of
everything; provides a good audit trail;

HIRDLS data pool -- web server -- filter files; with hierarchy directory
system; run script daily; password protected.

s/w tool -- if you are using web server; database server; ftp servers;
etc. -- would like to know what's up and down --Nagios is a good tool.

Question - Rama -- you mentioned that you have multi versions; Is ATDB
caught up? Answer: ATDB is not caught up; How would user know what's
done to generate standard product?

AI #1- Rama is to send email to John, John and JoAnn to ask about the
handling of documentation (ATDB); keeping it in synch with the product;
Vince mentioned that QA document delivered when product is released; may
not at ATDB level (*Rama sent email 10/1/07*)

Question - James asked for GEOS V5.1.0 -- do you know how the versions
\# will be changed? Vince said that he doesn't know which digit; but
something will have to change. It really depends on what else is going
on with HIRDLS at that time;

Question - Paul -- do have single or multiple processes. Vince -- L1 has
4-5 processes; L2 has 2 streams

HIRDLS don't have standard production stream now.

**MLS -- David**

-   Since start of science operations on 13 Aug 04 - 4% of data is not
    useful for science due to routine maintenance, calibration 
    activities, HIRDLS pitch maneuvers, Aura activities, and instrument
    anomalies

-   SIPS OPS -- don't operate multi versions

-   Hardware/software problems with new file system

-   Science team inspects all products; meet with science team weekly

-   Only use GMAO data for L2 processing

-   L3 only run monthly

-   No changes -- L1; L2; L3 since last time presented

-   Future -- v2.22 ; improve throughput performance without changing
    data quality; lot of papers uses this version

-   Near real-time proc -- started this year; developed special purpose
    algorithm to produce temperature and ozone quickly

    -   DISC is processing L0 and att/ephm for MLS

-   File system re-design -- so that there will be one copy at SCF and
    one at SIPS; official copy is archived at DISC

James -- inquired about v.2.22 schedule. David stated don't know
schedule yet -- run Aug 2; Aug 14 -- nothing to be concern about;
products are essentially the same

**OMI -- Jacques**

-   Started new collection 3 L2 production in forward stream-- last week

-   Public release of new L1b will be when they have been once approved
    by OSAB

-   ECS Collection 2 L0  L1B processing will stop -- this month

-   Why reprocessing?? -- old OPF ran monthly; new one is time-dependent
    update daily; fully automated; result in high quality data

-   Overview -- collection 3 -- ready to send to DISC OMTO3 and OMSO2,
    pending PI approval

-   L2 that not updated with new PGEs for collection 3 -- when
    collection 2 stops; there will be no collection 3 version in forward
    stream

Question - James -- inquired about L2 products for Fins -- they now get
TD-OPF from DISC. Jacques did not know how that was being done; but
needs to find out

**TES - Doug**

-   Instrument -- very happy

-   Have Global Survey (GS) -- every other day; Special Observations
    (SO) during off days

-   Instrument -- downtime minimal -- mainly for deicing; done doing off
    days; had one filter wheel; they were back to OPS in 3 days

-   ICS -- if stall; can't take data; looking at options

-   3 processing centers

    -   SIPS -- process normal GS and SO

    -   SPS - @ sips; used for special processing

    -   SCF - development facility

-   R10.1 -- had bug with GEOS 5; fixed in one day; reprocessing expect
    to be completed in Nov. 07

-   TES L3 Browse -- in EDG and can be viewed in Google Earth; Google
    Earth is being made part of TES outreach effort

-   No retro reprocessing; start with 5.1.0

-   R11 -- incremental additions to products; nothing earth shaking;
    schedule for March 07

-   Documentation provided:

    -   Data Product Specification -- how to access the prod

    -   User Guide - from science team

    -   Data Quality Statement

    -   Data Versioning

-   Issues -- GMAO re-order almost daily; not so for the other Data
    Types

Question - Paul -- Number of streams running? -- Have cluster asks at
one system

**Aura Guidelines - Cheryl**

-   Tech Notes (TN) - Passed internal review from Standards Process
    Group; ready for external review -- need reviewers

-   Put TN on website?? -- Answer - yes and on same web site

Question - Rama -- Intent to be use by other projects; instrument team?
Want to have the doc there to use/refer to; also use as demonstration
project; decided to promote it as Tech Notes. Peter answered -- anybody
can use it if they want to; especially the satellite atmospheric
community.

-   Tech Notes -- snap shot of what we adopted.

Question -- Brian Krupp - TES products availability in ECHO? -- Doug
products are available in EDG; not in ECHO; suggested that Mark Solomon
check with ASDC and ECHO.

**GES DISC - James**

-   WHOM -- internal ordering system; Mirador -- new ordering system

-   Archiving 2 versions of L1s and L2s for MLS until they are caught up
    reprocessing

Comment - David -- few granules -- not retrieval; remind MLS to send
file -- this month

Question - Vince -- S4PA has 10 char version name -- For the user
community - what do you think they prefer? -- It was recommended simple
better; S4PA is flexible enough so that it can use the team's file
names.

AI #2-- ESDIS - Toolkit/HDF-EOS support after May 2008 -- EMD end??
(*Cheryl sent email to Dan Marinelli on 10/2/07 - his response is that
they are in the process of approving a one year extension)*

AI #3- Abe -- where's TES request (netCDF) old version get deleted with
TK; have to overwrite it; -- in what's release is it in *(Email from Abe
on 10/18/07 indicates that the conflict when installing both the netCDF
and HDF4 libraries will be resolved with the next Toolkit release)*

AI #4 - Paul to send Abe his attribute bug.

AI #5 - OMI ( request from Pepijn) HDF-EOS 5 -- different swath in files
-- recommend having 2 swaths -- and use links- (1) links to all data;
(2) main data -- click on links with only few links to main data;
Jacques will send email to Abe and ESDIS (Dan Marinelli and Karen).

*(following notes compiled by Cheryl Craig from Alfreda\'s talk)*

**ESDIS - Alfreda**

EOSDIS Evolution testing/completion:

-   GES DISC now using S4PA

-   ASCD DAAC project using ANGe in May 2008

Status of Evolution ICDs:

-   Replacing individual team's ICDs

-   S4PA MLS, HIRDLS and OMI appendices in signature cycle

-   TES original ICD document will retire after ANGe tansition and
    become an appendix

-   Other interfaces in various stages of creation/review

MLS Near Real-Time: Established RBD data flow from EDOS to S4PA,
continue work on conversion software

GMAO Version ID for TES: Permanently change to 1 in metadata, successful
test, final verification during operational flow of v5.1.0

EDG to Warehouse Inventory Search Tool (WIST) Transition: Plan to start
in Spring 2008 and turn off EDG in late 2008