dataesr/scientific-paragraphs-categorization huggingface dataset:
Introduction This article describes the data and software that have been added, modified, or enhanced in the HITRAN ( Hi gh Resolution Tran smission) compilation since the previous edition of 2012  [1]  (hereafter called HITRAN2012 in the text). The line-by-line portion and the absorption cross-sections of the new edition, hereafter called HITRAN2016, have now been cast into an underlying relational database structure as opposed to the long-standing fixedlength ASCII record format. A user-friendly powerful internet tool, HITRAN online (accessible through www. hitran. org ), is provided to the user to query, filter, and plot sections of the data and to retrieve outputs in a host of convenient formats (see Hill et al. [2]  ). The HITRAN compilation is composed of several components that include ( 1 ) line-by-line spectroscopic parameters for high resolution molecular absorption and radiance calculations (from the microwave through the ultraviolet region of the spectrum);  ( 2 )  infrared absorption cross-sections (generally representing absorption by molecules that have very dense spectra or many low-lying vibrational modes); ( 3 ) collision-induced absorption datasets; ( 4 ) tables of aerosol refractive indices; and  ( 5 )  global data that apply in a general manner to the archive.
The updates to these five portions of HITRAN as well as the new underlying system of data structure with accompanying internet user interface will be discussed in the following sections. The new edition of the HITRAN database substantially increases the database's potential to accurately model radiative processes in the atmosphere of the Earth and other planets. Apart from improving the accuracy of the existing parameters, more parameters have been introduced, and new bands and isotopologues added. Two gases (C 2 N 2 and COCl 2 ) are introduced to the database for the first time. Finally, a very dramatic expansion of the cross-sectional part of the database is featured in this new edition. It is necessary to call attention to some specifics of the HITRAN database. The units used throughout HITRAN editions including this one do not strictly adhere to the SI system for both historical and application-specific reasons.
There are also citations to more detailed studies of the modifications. With the recent advances in both laboratory spectrometers and the power of theoretical treatments such as ab initio calculations, the accuracy and the access to weak, yet important, transitions have had a big impact on this edition of HITRAN. Table  3  provides an overview of changes and additions to the database with respect to the HITRAN2012 edition. The line-by-line parameters (as well as the portion of HITRAN devoted to cross-sections) have now been cast into a relational database structure, described in Section 6. 1. This underlying structure has many advantages that were not available in the previous fixed-length format of previous HITRAN editions. The database is now able to add many more parameters (becoming necessary Please cite this article as: I.
E. Gordon   Parameters for broadening by new perturbing species, X c , and line-mixing parameters γ X cm -1 atm -1 gamma_X Lorentzian HWHM coefficient (for Voigt lineshape) for broadening by perturber X n X -n _ X Temperature-dependence exponent for γ X n self -n _ s e l f Temperature-dependence exponent for γ self δ self cm -1 atm -1 delta_self Self-induced pressure line shift δ air cm -1 atm -1 K -1 deltap_air Linear temperature dependence coefficient for δ air δ self cm -1 atm -1 K - 1  deltap_self Linear temperature dependence coefficient for δ self δ H 2 cm -1 atm -1 K -1 deltap_H2 Linear temperature dependence coefficient for δ H 2 δ X cm -1 atm -1 delta_X Pressure-induced line shift due to perturber X Y air cm -1 atm -1 y_air First-order (Rosenkranz) line coupling coefficient within Voigt profile; air-broadened environment Y self cm -1 atm -1 y_self First-order (Rosenkranz) line coupling coefficient within Voigt profile; air-broadened environment a The third column header, identifier, denotes the names of the variables used in the new relational database structure.
b These parameters are given in Table  1  in the way they appear in the ". par" file. However, one should note that they are stored in a flexible and substantially more detailed way in the database. c The names containing X correspond to the foreign broadeners, where X is the name of the perturbing species (CO 2 , H 2 , He). Unless explicitly given, the parameters imply transition between lower and upper states; double primes ( ) and primes ( ) are for lower and upper energy states, respectively. not only for planetary atmosphere applications, but also to satisfy sophisticated remote-sensing requirements), is not limited to constraints of field length, and can accommodate functional forms for parameters. It also allows for a much more robust way for the managers to check for errors, whether they be by transcription, violated selection rules, incorrect quantum assignments, etc.
New line-shape representations Shapes of individual transitions in molecular spectra at atmospheric conditions are mainly determined by collisions and the Doppler effect. In the simplest case these two effects can be handled with the Voigt profile, where the collisions are described just as a single-parameter exponential relaxation. In the previous editions of HITRAN, the line shapes, with a very few exceptions, were represented with the Voigt profile. It turns out, however, that this model is too simple to reproduce atmospheric spectra with accuracy at the sub-percent level (see for instance Refs. [9, 10]  ). For some light molecules, in particular for molecular hydrogen (important for research on dense atmospheres of gas giants), the non-Voigt effects are much more pronounced  [6]. At this point the database provides Voigt (for every transition), and speed-dependent Voigt, Galatry  [11]  and Hartmann-Tran  [7, 8]  profiles parameters where they had been measured and validated.
Ab initio line-shape models, originating from first principles, are far too complex to be simply implemented in a line-by-line spectroscopic database. Therefore, a compromise between simplicity of the model and the fidelity of experimental spectra representation had to be found. In recent decades, a number of phenomenological models that take into account both speeddependent effects and velocity-changing collisions had been advanced. Recently, Tran et al. developed a computationally efficient algorithm  [7, 8]  for calculating one of them, the partially-correlated speed-dependent hard-collision profile  [12]  with quadratic speed dependence  [9]. An IUPAC (International Union of Pure and Applied Chemistry) task group recommended the use of this profile for high-resolution spectra representation  [13]  and call it the Hartmann-Tran (HT) profile.
δ HT 0 (X; T re f ) cm -1 atm -1 delta_HT_0_X_T Speed-averaged line shift of the HTP in temperature range around T = T ref due to perturber X δ HT ( X; T ref ) cm -1 atm -1 K -1 deltap_HT_0_X_T Linear temperature dependence coefficient for δ HT 0 (X; T re f ) in temperature range around T = T ref δ HT  2 (X; T re f ) cm -1 atm -1 delta_HT_2_X_T Speed-dependence of the HTP line shift in temperature range around T = T ref due to perturber X ν HT VC (X ) cm -1 atm -1 nu_HT_X Frequency of velocity changing collisions in the HT profile formalism κ HT ( X ) -kappa_HT_X Temperature dependence of ν HT VC (X ) η HT   e t a _ H T _ X Correlation parameter in HT profile formalism Y HT ( X ; 296) cm -1 atm -1 Y_HT_X_296 First-order (Rosenkranz) line coupling coefficient within HT profile; air-(self-) broadened case a The third column header, identifier, denotes the names of the variables used in the new relational database structure.
H 2 O (molecule 1) The HITRAN2016 edition has undergone a substantial revision and expansion of the database of water vapor. In HITRAN2012  [1]  a very large expansion of the dynamic range of the line intensities for non-deuterated isotopologues of water vapor was implemented, thanks to the ab initio calculations from the BT2 line list  [15]  and, in selected spectral intervals, Lodi et al. [16]  for the principal isotopologue and from Lodi and Tennyson for H 2 18 O and H 2 17 O  [17]. The ab initio results were replaced with high-quality experimental or-semi-empirical data wherever possible. In HITRAN2016, we have done a similar expansion of the dynamic (and spectral) range of the singly-deuterated isotopologues. In addition, the D 2 16 O isotopologue makes its debut in the database. D 2 O has a very low natural abundance on Earth but is measurable in the atmospheres of other planets, notably Venus which has an enhanced deuterium content  [18]  raising the importance of D 2 O.
Also, for fitting d -enriched HDO laboratory spectra, a good D 2 O line list is essential. For this reason, D 2 O transitions have been included using a lower intensity cutoff of 10 -32 cm -1 /(molecule •cm -2 ) once isotopic abundance is accounted for. A dedicated paper detailing the update of the water-vapor dataset in HITRAN2016 along with atmospheric and laboratory validations is planned. Here we summarize only the most important details.
Line positions and intensities This update is informed by the work of an International Union of Pure and Applied Chemistry (IUPAC) task group which produced systematic sets of empirical energy levels (and hence transition frequencies) for all the stable isotopologues of water  [19] [20] [21] [22]. In HITRAN2012 non-deuterated isotopologues already benefited from the availability of the IUPAC dataset of empirically-derived energy levels (and transition wavenumbers derived from them), and we extend this to the deuterated species here. However, some important caveats of that compilation have to be noted. a) The accuracy of some of the transitions generated from the IUPAC set may be inferior to individual high-accuracy experiments. Therefore, just like in HITRAN2012, we have given preference to the experimental line position data from previous HITRAN editions if the uncertainty code was 5 (0.
0 0 0 01-0. 0 0 01 cm -1 ) or higher. Comparisons with atmospheric spectra have shown that this was a correct choice. b) The datasets constructed in Refs. [19] [20] [21] [22]  do not include experimental data from the papers published after them. Quite a few new levels have become available over the years and some reassignments were in order (see for instance Mikhailenko et al. [23]  and Liu et al. [24]  ). We partially updated the IUPAC datasets here. In particular, for the HD 17 O and HD 18 O species, levels from Kyuberis et al. [25]  were used. For H 2 18 O and H 2 17 O, and to a lesser extent for H 2 16 O, levels from Mikhailenko et al. [23, 26]  and Liu et al. [24]  were used. Unfortunately, the IU-PAC and Mikhailenko et al. quantum assignments often differ and complete matching would require a substantial amount of time in the future.
It is also important to note a significant increase in coverage for HD 17 O and HD 18 O which were poorly represented in previous HITRAN releases. The variational (calculated) intensities described above were then replaced with intensities from available high-quality experi-ments, many of which were already in the HITRAN2012 database. The details will be given in a dedicated paper, but some of the experiments that represent a substantial bulk of new experimental intensity data are described below.
MiKaMo16 experimental set. Recently, Mikhailenko et al. [23]  have compiled a database of measurements in 5850-8340 cm -1 region from the Grenoble-Tomsk collaboration reported in Refs. [37] [38] [39] [40] [41]  supplemented with measurements from Sironneau and Hodges  [42]  and for strong lines from Toth  [43]  and for very weak lines from ab initio work of Partridge and Schwenke  [44, 45]. This database is here referred to as MiKaMo16. Unfortunately, due to some differences in assignments with the variational Lodi-Tennyson-like line lists described above, it was hard to take full advantage of this line list. However, tests against TCCON spectra have shown that this line list is superior to any other line list in the region of 70 0 0-8340 cm -1. It was therefore used in HI-TRAN2016 in that region as is almost everywhere in this spectral region.
This, however, creates some consistency issues with assignments of energy levels throughout the database, but substantial improvement of atmospheric retrievals justifies this approach. As examples of the complexity of the update, Figs. 3  and 4  show the flow diagrams of the construction of position-intensity line lists of the principal isotopologue (only up to 8340 cm -1 for simplicity) and for H 2 18 O/H 2 17 O respectively. Note that the line list from Lodi et al. [16]  for the principal isotopologue is limited to 10 -28 cm -1 /(molecule cm -2 ); therefore intensities for weaker lines still originate from HITRAN2012/BT2. Whenever a rotational quantum number could not be determined unambiguously, the index of symmetry (1, 2, 3, and 4 as defined in the BT2 work  [15]  ) accompanied with a negative sign was used.
are questionable (see for instance Armante et al. [48]  ). However, although the removal of this extensive dataset from the updated Gordon et al. [46]  procedure, as was done in the GEISA database  [49]  and the MiKaMo16 linelist, have improved the residuals in some of the lines, some of the residuals became worse than in HITRAN2012. The main problem here is due to the fact that, while there are definite outliers in the values reported in Jenouvrier et al. [47]  , it is the most extensive study of the air-broadened line widths in the 420 0-660 0 cm -1 region. In fact, for many transitions no other measurements exist. Removal of these measurements from the experimental dataset has invoked the use of the approximations of different levels (some are very crude) from the work of Jacquemart et al.
[50]  for many of the transitions. The only solution in this case was to filter the Jenouvrier et al. dataset. This was done through direct comparisons with the TCCON spectra for some of the transitions and cross-comparison with similar rotational transitions but from other bands, accounting for vibrational dependence from Eq. (  1 ) of Jacquemart et al. [50]. After this filtering procedure, about 1400 measurements (out of almost 50 0 0) from Jenouvrier et al. [47]  were retained. It is also important to emphasize that measurements by Birk and Wagner  [51]  in the ν 2 band region were given a priority and were written into the database directly as was done in HI-TRAN2012. Since the modeling of water vapor absorption lines using a Voigt model is no longer sufficient in many applications and the HT profile provides considerably higher accuracy, experimental HT profile parameters of Birk et al.
Line-shape parameters for the deuterated isotopologues The addition of the line-shape parameters for D 2 O follows a similar procedure as the other isotopologues; however, the available data for air-broadening of D 2 O are considerably less complete than for the other isotopologues. There are some measurements for air-broadening of D 2 O  [52] [53] [54] [55]  as well as Complex Robert-Bonamy calculations  [56]. These data amount to several hundred lines from the measured data and just over 550 lines from the theoretical calculations. Using these data, average values as a function of J were determined and extrapolation to J = 50 was done using a thirdorder polynomial fit. Using these data, the half widths and some line shifts have been added to the D 2 O lines in the database using a priority scheme.
First, the measured values were added; if the measurement did not exist for the transition in question, the theoretical value was used. If neither exists, the J -averaged value was used. This algorithm allowed half widths to be added to all D 2 O lines in the HITRAN database. For self-broadening parameters of D 2 O, the work of Gamache et al. [57]  was used. These data are an extensive set of calculations for D 2 O rotational band transitions extended to 6536 lines using the partner transition rule  [58]. Using these data, a set of J -averaged half widths was determined for J = 0-50  [57]. These data have been added to the algorithm that adds line-shape data to the water lines in the HITRAN database.
Precise determination of 13 C/ 12 C and 16 O/ 17 O/ 18 O ratios is also vital, for instance, in understanding processes of formation of radiation fields in the Martian atmosphere, which is 96% rich in carbon dioxide  [77]. A summary of the carbon dioxide line list in the HITRAN2012 database and comparison to HITRAN2016 is given in Table  4. The HITRAN2012 database was considerably improved with respect to its previous 2008 edition. However, several issues related to spectral completeness, inconsistency of multiple data sources, and insufficient accuracy of line intensities, still remained unsolved. The majority of entries in the 2012 version of the HITRAN database were taken from the effective Hamiltonian calculations included in the 2008 edition of the CDSD-296 database  [78]. For less abundant isotopologues, obtaining high-quality experimental data is not trivial.
Although this assessment has been proven to be overly pessimistic in many cases  [82, 83, [85] [86] [87]  , the uncertainty budget, especially for the Effective Hamiltonian calculations, was still too high for precise measurements of atmospheric CO 2 concentration. The most accurate entries in HI-TRAN2012 were taken from NASA JPL measurements by Toth et al. [88] [89] [90]  and covered the 1. 6-μm and 2. 06-μm spectral regions, which are used in remote-sensing measurements. The stated 1-5% accuracy of these experimental line intensities (HITRAN uncertainty index equal to 7 and 6), has been confirmed by a number of comparisons  [82, 83, 91]  ; nonetheless the rigorous requirements for part-per-million resolution in measurements of CO 2 atmospheric concentration were not achieved. Since the 2012 release of the HITRAN database, a large number of experimental and theoretical studies have been devoted to improve the knowledge of line positions, line intensities and line shapes of CO 2 isotopologues.
ARTICLE IN PRESS JID: JQSRT [m5G;  August 21, 2017; 14:18 ]  greater than 80 0 0 cm -1. Recently, several experimental studies of the carbon dioxide spectra in the high-frequency region have been performed  [105] [106] [107] [108]. The measured line intensities allowed determining the absent effective dipole moment parameters for several series of transitions. Using these effective dipole moment parameters and an effective Hamiltonian from Ref. [109]  , the line positions and intensities for the principal isotopologue were generated and included into HITRAN2016 covering the 980 0-10,50 0 cm -1 and 11,60 0-12,40 0 cm -1 wavenumber gaps. Line positions were updated with respect to the previous version of the database. The majority of lines come from the effective Hamiltonian calculations included in UCL-IAO line lists, which are based on the fits to the observed line positions collected from the literature and published in the latest, 2015 release of the CDSD-296 database  [92].
Partition functions in the current release of the database are based on the direct summations taken from the variational calculations of Huang et al. [79]. On average, the new partition functions agree excellently with those of CDSD-296  [83]  ; however they do not agree perfectly with those in HITRAN2012 (from TIPS  [112]  ) and three previous editions of the database and differ at 296 K by about -0. 3%. Although this difference is marginal, it could have an effect in the applications where sub-percent accuracy is required. As stated above, the radioactive isotopologue 14 CO 2 , 646, has been added to the database. This is the first edition of HITRAN where radioactive species have been incorporated (also for CO, see Section 2. 5 ). All lines of the 646 isotopologue were taken from the UCL line lists given in Ref.
Uncertainties of line intensities were informed by theoretical error analysis, which classified lines as reliable, intermediate, or unreliable. Bands with reliable lines stronger than 10 -23 cm -1 /(molecule •cm -2 ) (for unit abundance) were assigned HITRAN uncertainty code 8 (i. e. accuracy of 1% or better). Line intensities of reliable parallel bands weaker than 10 -23 cm -1 /(molecule •cm -2 ) were given an uncertainty code 7 (i. e. accuracy 1-2%). Reliable perpendicular bands weaker than 10 -23 cm -1 /(molecule •cm -2 ) and intermediate lines were marked with HITRAN uncertainty code 6 (i. e. accuracy 2-5%). So-called un-reliable lines were taken from the effective dipole moment calculations  [92]  and experiments. Typical intensity uncertainties for these entries range between 5 and 20%.
At the moment, HITRAN cannot provide users with tools that can be used to generate cross-sections from the works of Devi et al. [84]  and Benner et al. [86]. The usable products of the ABSCO effort are absorption coefficients (available upon request from the ABSCO group) rather than spectral parameters, which are available in the publications. Moreover, these absorption coefficients are empirically scaled by the factors of 0. 6% and 1. 4% for the 1. 6-μm and 2. 06-μm bands respectively, due to lingering data and/or model biases (the use of partition function HITRAN 2012/TIPS is up to 0. 3% of this factor). After these studies, an update of the multi spectrum fitting code with CDSD partition functions was done. Additional methods to adjust the intensity distribution closer to the UCL list by scaling experimental conditions within the uncertainties are under evaluation.
The intensities of the band at 2. 06 μm are already within 0. 7% of Zak et al. [82]  , indicating that the additional 0. 7% scaling of ABSCO cross-sections may be unrelated to intensities. These issues will be considered for future editions of the database. For wavenumbers greater than 80 0 0 cm -1 , two sources of the line intensities are used: CDSD-296  [92]  and the newly-generated line list in the 980 0-10,50 0 cm -1 and 11,60 0-12,40 0 cm -1 regions based on the new measurements  [105] [106] [107] [108]. The uncertainty codes of the CDSD-296 line intensities were transferred to HITRAN2016. Based on the uncertainties of the line intensity measurements in the 10,700-10,860 cm -1 region  [106]  , we use uncertainty code 5 (5% -10%) for the line intensities of the 30 03i-0 0 0 01 (i = 1,2,3,4) series of bands and based on the uncertainties of the line intensity measurements in the 10,0 0 0-10,30 0 cm -1 and 11,600-12,400 cm -1  [107]  wavenumber regions we use uncertainty code 3 ( > 20%) for the line intensities of the 40 03i-0 0 0 01 (i = 1,2,3,4,5) and of the 60 01i-0 0 0 01 (i = 1,2,3,4,5,6,7) series of bands.
The Voigt line-shape parameters throughout the entire database were calculated using the predictive routine of Gamache and Lamouroux explained in Refs. [114] [115] [116]. For the line mixing, we now provide a code from Lamouroux et al. [117]  which has been updated to operate with HITRAN2016. We note that Lamouroux et al. [117]  line mixing coupled with the HITRAN2012 data has worked really well and in fact produced residuals hardly exceeding 1% when applied to the TCCON data in Ref. [113]  , although slightly inferior to the ABSCO cross-sections in the 2. 06-μm region.
O 3 (molecule 3) The spectroscopic database for ozone is important for atmospheric and environmental applications due to its critical roles in UV shielding, radiative transfer and health. It is also considered a possible bio-marker for future observations of exoplanets  [118]. In order to understand the impacts of ozone on the atmosphere and Please cite this article as: I. E. Gordon    to monitor ozone a precise, knowledge of its line parameters at all wavelengths is required. The ozone parameters for this edition of HITRAN have been updated in two steps. First, the parameters of spectroscopic models, line positions, intensities, and lower-state energy levels resulting from analyses of experimental spectra have been introduced into the S&MPO (Spectroscopy and Molecular Properties of Ozone) information system  [119].