JEM/SMILES
Level 2 Research Data (L2r) Product Guide
for Version 2.1.5
STRUCTURE OF SMILES L2r PRODUCTSJANUARY 11, 2012

JEM/SMILES L2r Products Guide

1

LEVEL 2 RESEARCH PRODUCTS OVERVIEW(1) FILE NAME
The file name is defined as follows.
SMILES_L2r_{product_name}-{l1b_type}{l1b_version}_{band_name}_{l2r_version_name}_{date}.he5(ex. SMILES_L2r_O3-std007_A_2.1.5_20100123.he5)(2) COMBINATION OF PRODUCT_NAME AND BAND_NAME
Combinations of product name and band name are as follows.
No. Product_name
1O3 (18 - 100 km)
H37Cl (18 - 90 km)
BrO (20 - 80 km)
HOCl (20 - 80 km)
Temperature (15 - 100 km)
2O3(18 - 100 km)
H35Cl (18 - 90 km)
HOCl (20 - 80 km)
Temperature (15 - 100 km)
3
ClO (20 - 90 km)
BrO (20 - 90 km)
HO2 (18 - 100 km)
HNO3 (20 - 90 km)

Band_nameA

B

C

Other potential products are:
Band A: HNO3, CH3CN
Band B: HO2
Band C: ―and O3 isotopomers
For details on these products, please contact the L2r developing team.
Email: Yasuko Kasai (ykasai@nict.go.jp)1JEM/SMILES L2r Products Guide(3) LEVEL1B_TYPE
l1b_type is represented as follows.
std/rev:
std: Level 1B Standard
rev: Level 1B Revision(4) LEVEL1B_Version
l1b_version is represented as follows.
xxx:xxx: Level 1B Version(5) LEVEL2r_VERSION_NAME
l2r_version_name is represented as follows.
x.x.x:
x.x.x: Level2r Algorithm version(6) DATE
date is represented as follows.
yyyymmdd: (ex. 20091009)
yyyy: Observation year
mm: Observation month
dd: Observation day2

JEM/SMILES L2r Products Guide2

PRODUCT FORMAT(1) STRUCTURE OF HDF5-EOS DATA FILES

The format structure of the HDF5*-EOS data file is shown below.
No.
Field
Attributes
1
File Attribute
File Level Attributes:
・ Instrument name・ Processing level
・ Version・ Observation day
・ Band name・ Scan number
・ L1B file name
・ AOS unit number
2
Geolocation Field
Geolocation Field Attributes:
・ Observation point
・ Time・ Altitude
・ Solar zenith angle
・ Ascending/descending flag
3
Data Field
Data Field Attributes:
・ Data value
・ Error estimation
・ Status*HTTP://WWW.HDFGROUP.ORG/3JEM/SMILES L2r Products Guide(2) STRUCTURE OF STANDARD SMILES L2 PRODUCTS● Standard processing data (HDF5-EOS)
Structure of standard processing data is as follows.
<File Attributes>
No.
HDF-EOS5 Name
1 L1BID
2 Instrument Name
3 Process Level
4 Start UTCDimension

Data typeL1B file name(n times)long

8*n times

Instrument name (SMILES)-char

6Processing level (L2r)
Start time in this file
(yyyy-mm-ddT00:00:00)
End time in this file
(yyyy-mm-ddT23:59:59)-char-char

319-char

19

Granule MonthMonth (mm)

-

long

8

Granule Day

Day (dd)

-

long

8

Granule Day of Year

Granule day of year

-

long

8Granule Year

Year (yyyy)

-long

8

PGE Version

Processing version (X.X.X)-char

5Start Scan

First scan number in this file

-

long

8End Scan

Last scan number in this file

-

long

8Band NameBand name-char

AOS Unit Num.

Unit number of the AOS(n times)long

1
1*n times

5 End UTC6789101112
13
14Explanation

Total<Swath Attributes>
No.
HDF-EOS5 Name
1 Altitude
2 Vertical Coordinate

Explanation

Dimension

Data typeCalculation altitude
Vertical coordinate
system name(n levels)

double-char

Total

Byte

101 + 9*n times

UnitkmByte
8*n levels
88 + 8*n levels

4JEM/SMILES L2r Products Guide<Geolocation/Data fields Attributes>: Following information is added to each field item.
No.
HDF-EOS5 Name
Explanation
Dimension Data type
Byte
1 Missing Value
Missing value
double82 Title
Filed namechar
73 Units
Unitchar
54 Unique Field
Field definition
char15Definition

5 _FillValue(T.B.D)-843

doubleTotal<Geolocation Fields>No.
HDF-EOS5 Name
1 TimeExplanation
Observation time

Dimension

Data type(n times)

doubleUnitByte＊

1

8*n times(Total seconds since 1/1/1958)

2 TimeUTC

Observation time (UTC)yyyy-mm-dd hh:mm:ss.sss(n times)char-

19*n times

34
5
6
7
8
9

AltitudeRepresentative altitude(n level)

doublekm

8*n level

LatitudeObservation latitude(n times)

doubledegrees

8*n times

Longitude

Observation longitude(n times)

doubledegrees

8*n times

Solar Zenith Angle

Solar zenith angle(n times)

doubledegrees

8*n times

Local Time

Local time (hh:mm:ss)(n times)char-

8*n times

AscendingDescending

Ascending/descending flag(n times)char-

1*n times

Altitude_tp

Altitude grid for auxiliary (n level_tp) double

km

8*n

temperature and pressurelevel_tp

data
Total

60*n times + 8*n level + 8*nlevel_tp*1: seconds since 1/1/1958

5

JEM/SMILES L2r Products Guide<Data Fields>
No.
HDF-EOS5 NameExplanation

Dimension

DataUnitBytetype
8*n times*n level8*n times*n level
8*n times*n level

1 L2 Value

Value(n level, n times)

doublevmr

2 L2 Precision

Calculation error(n level, n times)

doublevmr

3 Vertical Resolution

Vertical resolution(n level, n times)

doublekm

4 Measurement Response

Measurement(n level, n times)

double-8*n times*n level

doublehPa

8*n times*n level_tp(n times)long-

8*n times

Status information(n times)

long-

Auxiliary(n level_tp, n times)

doubleK

8*n times
8*n times*n level_tp

Cloud flag(n times, n cloud flags)

long-informationn cloud flags = 64

8*n times*
64

Chi2(n times)

double-8*n times

response

5 Pressure_tp

Auxiliary pressure (n level_tp, n times)

6 FOV Interference

Flag ofdata
field-of-viewinterference on theL1b data

7 Status
8 Temperature_tp

temperature data

9 cloud_flag
10 chi2

Total<StructMetadata>No.
HDF-EOS5 Name
1 StructMetadata.0

32*n times*n level + 16*n times*n level_tp + 24*n times

Explanation

Dimension

Matrix information of swath data

Byte

132000< coremetadata >No.
HDF-EOS5 Name
1 coremetadata.0

Explanation
HDF-EOS informationDimension

Byte

1About6960

6

JEM/SMILES L2r Products Guide

JEM/SMILES L2r data guide for release version 2.1.5
2.1.5
1. SMILES L2r version 2.1.5
2.1.5
The basis of the retrieval algorithm is kept the same as that of version 2.0.1 anddescribed in the following paper.
Baron,Baron, P. et al. (2011) “The Level 2 research product algorithms for theSuperconducting Submillimeter
Submillimeterbmillimeter-Wave LimbLimb-Emission Sounder (SMILES),”

Atmos. Meas. Tech., 4, pp. 21052105-2124.
doi:10.5194/amtdoi:10.5194/amt-4-21052105-2011
http://www.atmos-meas-tech.net/4/2105/2011/amt-4-2105-2011.html
Updated from version 2.0.1 (i.e., updates from the configuration described in Baron etal., 2011):-

Version of the L1b data was updated to 007 from 005. With this L1b version 007, theprecision of the non-linearity gain calibration was much improved.
Also, a new quality flag (temperature of 4 K stage) on L1b is used to select the data
to be processed in L2r.

-AOS response function was changed to a double-Gaussian model based on theon-orbit comb measurement, instead using a triple-Gaussian with an ad hoc
empirical scaling factor model.

-Deviation on the frequency for each AOS channel was improved by applying a
7-order polynomial correction derived by the SMILES instrumental team.

-Spectroscopic parameter was revised, including the main O3 625.371 GHz line.

-Inversion altitude grid-intervals and a priori error were changed for most of theproducts.

-No full-band (previously called “band-A_w08,” “band-B_w06,” or “band-C_w00”)
configurations were processed. We only plan to release so-called stratosphericproducts. For those who would like access to the full-band configuration products,please contact the L2r team.

For more detail, please contact the SMILES L2r team.

7

JEM/SMILES L2r Products Guide

2. Overview of the retrieval processing (L2r versionversionersion-2)
As described by Baron et al. (2011), we first go through the cloud flagging procedure,
and, at the same time, we correct the LOS elevation angle offset (a constant value forone scan). Then, we extract the limited spectral range around O3 625.371 GHz. andretrieve the LOS elevation angle offset for each tangential point (as well as retrieving
O3 and T(z)). This is one of the major differences from the SMILES L2-operational
processing chain. By using the retrieved elevation angle offset for each tangential point,
we retrieve O3 and temperature. After retrieving O3 and temperature, we then retrieve
other species such as HCl with dedicated spectral regions. Once we process band A or B,
we then move to band C by using the retrieved O3 profile as a priori.
The summarized outlines are attached below.
For any further detail, please contact the SMILES L2r team.

Outline of L2r-v2.X processing chain

L1b calibratedspectra (1 scan)

GEOS-5 Temperature,
O3, H2O andclimatology a priori

Tangential height (Ht) from
“ISS” is used.

With using the cloud flagging channels,
perform…
- Cloud flagging- Correction of the LOS elevation angle
offsetStart sequential retrievals from band-A,→ B, and then → -C.

Forward/Inversion models: AMATERASU (Baron et al. 2008; 2011)- Line-by-line calculation of the molecular lines- Dry and Wet continuum absorption based on Pardo (2001) formularization, withan ad-hoc scaling of 1.2 on the dry continuum.
- Atmospheric refraction.
- SMILES instrumental modeling (SSB (single-side-band) filter module is omitted)- Inversion calculation with employing Optimal Estimation Method (OEM, Rodgers,1976; 1990).
- Levenberg-Marquardt iteration scheme.

8

JEM/SMILES L2r Products Guide

Sequential retrieval for band A and B
CFw02
1.
2.
3.
4.

CF

w00/01

w02

Cloud flagging is done using the spectral range of CF.
The LOS elevation angle offsets for each tangential point ∆θ(∆θ ( z))) are retrieved from w00(O3 and Temperature is also set as retrieval params, but in a rather sparse vertical grid).
By using the retrieved ∆θ(∆θ ( z)) on the previous step, O3 and Temperature are retrieved fromw01 (with additional params of ∆θο and baselines).
By using ∆θ(∆θ ( z)), O3, and T(z) from steps 2–3, then HCl is retrieved from w02.

Sequential retrieval for band CCFw02
1.
2.
3.
4.

w01

Cloud flagging is done using the spectral range of CF.
No ∆θ(∆θ ( z)) is retrieved for band-C. Just ∆θο (a constant offset for all the tangential points) isretrieved from the full-band spectrum (w00). Temperature is fixed to a priori (GEOS5).
By using the retrieved ∆θο;∆θο BrO and HNO3 are retrieved from w01.
From w02, HO2 is retrieved (with several other params).

9

JEM/SMILES L2r Products Guide

3. Some notes on the L2rL2r-hdf contents
SMILES L1b data contains the attitude information from several sources, particularlyfrom the ISS and the Star Tracker (STT) onboard SMILES. The SMILES/ISS attitude
data on L2r processing are based on the “ISS” origin information. Latitude andlongitude of L2r hdf data are derived from the 30th spectrum of each scan (middle of thescan). These configurations cause some differences between the latitude and longitude
information for the same scan on L2 operational data. This discrepancy will be solved ina future L2r product release.
The "FOV Interference" field is prepared with the intention of providing quality flag
information on L1b data. For the current version of the L2r-hdf, this FOV Interference
field includes the quality flag from the level-2 procedure as well. This confusing
situation will be improved in the next version of the L2r product.
For version 2.1.5, FOV Inteference means:
0: Normal L1b data and successful level-2 process
1: Normal L1b data, although the level-2 process had some problems.
>= 2: L1b data contain warning flag on the data quality.
>= 16: Warning in the event that the antenna line of sight (LOS) has an object
in it>= 32: Cold-sky observation has an object within its LOS.
>= 64: Star tracker LOS has an object in it.
For the primary information, we recommend using the measurement response and chi2
for the data selection of the L2r v2.1.5 product.

10JEM/SMILES L2r Products Guide

4. Misc.
Relevant reference papers:-Baron, P. et al. (2011) “The Level 2 research product algorithms for theSuperconducting Submillimeter-Wave Limb-Emission Sounder (SMILES),” Atmos.

Meas. Tech. , 4, pp. 2105 – 2124.
-Baron. P. et al. (2008) “AMATERASU: Model for Atmospheric TeraHertz Radiation
Analysis and Simulation,” Journal of the National Institute of Information andCommunications Technology, 55(1),55(1) pp. 109 – 121.
http://www.nict.go.jp/publication/shuppan/kihou-journal/journal-vol55no1/07-04.pdf-Papers in prep.: Validation of the SMILES O3 product, Error Analysis of SMILES
L2r ClO data, Comparison of SMILES ClO with other instrument measurements,and more ☺.

Future development schedule for SMILES-L2r processing:-Development of a new version that focuses on the UT/LS region.

11