abstract: The report of an IUPAC Task Group, formed in 2011 on "Intensities and line shapes in high-resolution spectra of water isotopologues from experiment and theory" (Project No. 2011-022-2-100), on line profiles of isolated high-resolution rotational-vibrational transitions perturbed by neutral gas-phase molecules is presented. The well-documented inadequacies of the Voigt profile (VP), used almost universally by databases and radiative-transfer codes, to represent pressure effects and Doppler broadening in isolated vibrational-rotational and pure rotational transitions of the water molecule have resulted in the development of a variety of alternative line-profile models. These models capture more of the physics of the influence of pressure on line shapes but, in general, at the price of greater complexity. The Task Group recommends that the partially Correlated quadratic-Speed-Dependent Hard-Collision profile should be adopted as the appropriate model for high-resolution spectroscopy. For simplicity this should be called the Hartmann–Tran profile (HTP). The HTP is sophisticated enough to capture the various collisional contributions to the isolated line shape, can be computed in a straightforward and rapid manner, and reduces to simpler profiles, including the Voigt profile, under certain simplifying assumptions.
author: Jonathan Tennyson; Peter F. Bernath; Alain Campargue; Attila G. Császár; Ludovic Daumont; Robert R. Gamache; Joseph T. Hodges; Daniel Lisak; Olga V. Naumenko; Laurence S. Rothman; Ha Tran; Nikolai F. Zobov; Jeanna Buldyreva; Chris D. Boone; Maria Domenica De Vizia and Livio Gianfrani; Jean-Michel Hartmann; Robert McPheat; Jonathan Murray; Ngoc Hoa Ngo; Oleg L. Polyansky; Damien Weidmann
date: 2024-09-30
title: Recommended isolated-line profile for representing high-resolution spectroscopic transitions (IUPAC Technical Report)

# Introduction

Characterization of an isolated spectral line measured under high resolution requires three pieces of information: the transition frequency, the transition integrated intensity, and the parameters that describe the line profile. A previous IUPAC Task Group (hereafter called TG1), comprising several of the current authors, has critically evaluated the line frequency data available for all the major isotopologues of water . A summary of this work along with recommendations of TG1 were recently presented in this journal .

The full characterization of the high-resolution spectrum of water vapour from the microwave to the ultraviolet is a prerequisite for modelling and understanding of various processes in many fields in chemistry, physics, earth sciences and engineering. The diverse areas of interest include:

1.  Atmospheric modelling, with emphasis on the definitive understanding of global warming as water vapour is responsible for about 70 % of the known absorption of sunlight and the majority of the greenhouse effect;

2.  Atmospheric remote sensing and environmental monitoring, since it is generally necessary to remove the spectral signature of water in order to interpret correctly the signatures from trace species;

3.  Satellite communication, as the performance of satellites in the Earth's atmosphere is sensitive to water absorption between about 3 and 400 GHz;

4.  Active remote sensing such as radar and lidar that is affected by water vapour attenuation;

5.  Studies of planetary and exoplanetary atmospheres;

6.  Astronomy, for example, that of cool stars, where hot water is a major constituent; water lasers and masers, which are widespread in outer space, and the study of comets based on fluorescence spectroscopy;

7.  Combustion research, such as rocket exhausts, forest fires, and turbine engines, as hot steam is a major product of most combustion processes.

One of the recommendations of TG1 was the urgent need to identify and adopt a reference line profile for high-resolution spectroscopic studies which improved upon the current standard, the so-called Voigt profile (VP). The present paper reports the related recommendation of another IUPAC Task Group (hereafter called TG2) on "Intensities and line shapes in high-resolution spectra of water isotopologues from experiment and theory" (Project No. 2011-022-2-100). TG2 limited itself to considering gas-phase transitions which occur in neutral environments as the pressure effects in plasmas need a somewhat different treatment.

The line profile of an isolated spectroscopic transition is usually defined as being normalized to unit area and can be attributed to the following three physical factors:

1.  The Heisenberg time-energy uncertainty principle, or, equivalently, the spontaneous emission of radiation, is responsible for the natural lifetime broadening or *intrinsic line width*. This component of the overall line shape is described by a Lorentzian profile which is, however, sufficiently narrow to be safely neglected in favour of the next two contributions in all but the most specialized situations and ultra-low temperatures;

2.  The thermal translational motion of the spectroscopically active molecule at velocity $v_a$ gives the incident radiation, of frequency $\nu_0$, a frequency shift of $\Delta\nu$ = $\pm(v_a/c)\nu_0$ in the molecular frame of reference: the well-known *Doppler effect*. The corresponding Doppler profile (DP) is expressed in terms of the Doppler half-width, $\mathit{\Gamma}_{\rm D}$, by a Gaussian function: $$F_{\rm D}(\nu - \nu_0) = \sqrt{{\ln(2) \over \pi}}{1 \over \mathit{\Gamma}_{\rm D}}\exp{(-\ln(2)({{\nu - \nu_0}\over {\mathit{\Gamma}_{\rm D}}}})^2).$$ For temperature $T$, in K, and molecular mass $m$, in kg, the Doppler half-width, in Hz, is $$\mathit{\Gamma}_{\rm D} =\sqrt{2\ln(2)kT \over {mc^2}}\nu_0=1.459 313 6 (7)\times10^{-20}\sqrt{\rm {(kg/K)}}\sqrt{(T/m)}\nu_0,$$ or equivalently in terms of the molar mass, $m_\textrm{m}$ in g mol$^{-1}$, $\mathit{\Gamma}_{\rm D}=3.581 163  (2)\times10^{-7}\sqrt{\rm {g\over mol} {1\over K}} \sqrt{(T/m_{\textrm{m}})}\nu_0$.

3.  Individual collisions of molecules lead to energy exchanges between radiators and perturbers. These exchanges shorten the lifetime of the initial and final states of the optical transition and yield what is called pressure or *collisional broadening*. These collisions also induce pressure-dependent shifts in the central frequency of the transition. Assuming the independence of the pressure-broadened line half-width at half-maximum, $\mathit{\Gamma}$, and of the pressure-induced line shift, $\mathit{\Delta}$, from the molecular speeds (mean thermal velocity approximation), one obtains, for the associated profile, a homogeneous Lorentzian function: $$%\label{eqn_LP}
    F_{\rm L}(\nu-\nu_0)=\frac{1}{\pi} \frac{\mathit{\Gamma}}{(\nu-\nu_0-\mathit{\Delta})^2+\mathit{\Gamma}^2}.$$

At low pressures the Doppler effect dominates, and as the pressure increases the effects of collisions become increasingly important. As a first approximation to get the resulting line shape, the convolution of an inhomogeneous Doppler profile with a homogeneous Lorentzian profile is commonly used. It defines the so-called VP, which contains Doppler and Lorentzian shapes as limiting cases. The three parameters, $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}$ and $\mathit{\Delta}$, characterizing the Voigt profile are routinely employed in standard spectroscopic information systems . $\mathit{\Gamma}_{\rm D}$ is independent of the gas mixture composition and has a known temperature dependence, see eq. 2. For $\mathit{\Gamma}$ and $\mathit{\Delta}$, their values in a mixture are simply obtained, assuming binary collisions, through model fraction-weighted average of the individual values for each collision partner. The temperature dependence of $\mathit{\Gamma}$ and $\mathit{\Delta}$ is commonly assumed to be a power law for the broadening but remains to be found for the pressure shift. Although the Voigt profile involves an integral that cannot be evaluated analytically, there are readily available, fast computational procedures for doing this, see, *e.g.*, , which make this function suitable for use in complex radiative-transfer codes.

There is now a widespread recognition that the VP does not give a fully accurate representation of the spectral line shape and its use can lead, for example, to a systematic underestimation of experimental line intensities . Use of the VP for modelling spectra of water vapour recorded in both the laboratory and the atmosphere under high resolution leads to characteristic W-shaped residuals in any high-precision fit to the line absorption coefficient. See, for example, Refs.  for laboratory work and Refs.  for atmospheric studies. In particular, large W-shaped residuals were observed in the analysis of H$_2$O lines from the Atmospheric Chemistry Experiment , an effect that appears to occur only for H$_2$O and not for other molecules in the spectra. Deviations from the Voigt line shape contribute to the large residuals for H$_2$O lines, although there are likely other contributions relating to the high variability of the H$_2$O column in the Earth's atmosphere and the rapid change of H$_2$O volume mixing ratio as a function of altitude in the troposphere, particularly in the tropics.

The W-shaped residuals arise, and their amplitude may reach 10 % of the peak absorption , as the observed lines are typically higher and narrower than predicted by the VP. Deviations from the VP are generally ascribed to the effect of velocity changes (VCs) due to collisions, which reduce $\mathit{\Gamma}_{\rm D}$, and/or to the speed dependence (SD) of the relaxation rates, which corrects the simple Lorentzian shape for different velocity-classes of active molecules. Inclusion of these velocity effects in line-profile models has led to the development of a variety of possible line shape functions which can be characterized by their increasingly sophisticated representation of the underlying physics and an increasing number of parameters. Several of these models are briefly considered in Section III.

# Objectives of the Task Group

There are many suggested models for the line profile which move beyond the VP ; see chapter III of the book by Hartmann *et al.*  for a more general discussion. These profiles are more sophisticated in that they include more physical effects than are accounted for by the VP and, as a consequence, require additional model parameters. At present, databases and most major radiative-transfer codes use Voigt profiles, despite their well-documented deficiencies. The implementation of profiles beyond the Voigt approximation in databases and codes represents a major task and will only be undertaken once there is some reasonable consensus as to which line profile to use. This has become particularly timely as increased sensitivity of remote sounding instruments and better knowledge of geophysical parameters has increased the relative significance of line-profile issues for observing systems. The aim of TG2 and of this article is therefore to recommend the use of a single functional form suitable for line profiles representing high-resolution spectroscopic transitions.

To achieve this goal the following points need to be considered:

1.  What single functional form from those available is most appropriate to replace the VP? The chosen function should have a sound theoretical basis and behave in an appropriate manner as a function of pressure and temperature.

2.  Is the chosen functional form computationally tractable? Radiative-transfer models which perform line-by-line calculations for large numbers of lines demand a functional form that can be evaluated reliably and efficiently.

3.  What are the consequences of replacing Voigt functions in databases and models? There should be a straightforward path from the current situation which relies on Voigt functions to the newly recommended function.

To answer these questions, the water molecule serves as a suitable benchmark. As detailed in the Introduction, water line profiles are of great importance for a number of applications. Furthermore, water has a large permanent dipole moment which leads to strong long-range interactions, making the line shape of its transitions particularly challenging to model from the purely theoretical point of view. TG2 therefore aimed to make a recommendation for water which would also be appropriate and adopted for other molecules.

Finally, we note that collision-induced mixing of nearby lines also alters line profiles, see chapter IV of Ref.  for a general discussion of this process. This effect has been observed in water transitions but was not explicitly considered by TG2. Nevertheless, the significance of the TG recommendations for the inclusion of line mixing and for the water continuum is discussed below.

| Acronym | Profile name | Parameters |  |  | Mechanism |  |  |
|:---|:---|:--:|:---|:--:|:---|:---|:---|
| 3-4 |  | $N$ |  |  | SD$^a$ | VC$^a$ | Correlation |
| DP | Doppler | 1 | $\mathit{\Gamma}_{\rm D}$ |  | No | No | No |
| LP | Lorentz | 2 | $\mathit{\Gamma}$, $\mathit{\Delta}$ |  | No | No | No |
| VP | Voigt | 3 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}$, $\mathit{\Delta}$ |  | No | No | No |
| GP | Galatry | 4 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}$, $\mathit{\Delta}$, $\nu_{\rm VC}$ |  | No | Soft | No |
| RP | Rautian | 4 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}$, $\mathit{\Delta}$, $\nu_{\rm VC}$ |  | No | Hard | No |
| NGP | Nelkin–Ghatak | 4 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}$, $\mathit{\Delta}$, $\nu_{\rm VC}$ |  | No | Hard | No |
| SDVP$^b$ | speed-dependent Voigt | 5 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$ |  | Yes | No | No |
| SDGP$^b$ | speed-dependent Galatry | 6 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$ |  | Yes | Soft | No |
| SDNGP$^b$ | speed-dependent Nelkin–Ghatak | 6 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$ |  | Yes | Hard | No |
| SDRP$^b$ | speed-dependent Rautian | 6 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$ |  | Yes | Hard | No |
| HTP | Hartmann–Tran | 7 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$, $\eta$ |  | Yes | Hard | Yes |
| CSDaRSP$^b$ | correlated SD asymmetric Rautian–Sobelman | 8 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$, $\chi$, $\eta$ |  | Yes | Combination | Yes |
| pCSDKS$^b$ | partially correlated SD Keilson-Storer | 8 | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$, $\gamma_{\rm KS}$, $\eta$ |  | Yes | Combination | Yes |

Summary of line-profile models considered. $N$ is the number of parameters required to characterize the line shape for a single isolated transition at a given temperature for a given pair of molecules. See text for further details and citations. All profiles except the simple Lorentz profile include the Doppler broadening effect.

$^a$ SD = speed–dependent; VC = velocity changes due to collisions.
$^b$ Parameters for these profiles are all given in the quadratic (q) form of the speed dependence; for hypergeometric models the expansion parameters $\mathit{\Gamma}_0$ and $\mathit{\Gamma}_2$ (or $\mathit{\Delta}_0$ and $\mathit{\Delta}_2$) are replaced by an amplitude factor and a parameter that is either $p$, the power-law exponent giving the dependence of the broadening on the relative speed, or $q$, which describes the power-law dependence of the intermolecular potential on the intermolecular distance.

# Line-profile models: a brief review

The theory of molecular line shapes is rather complicated and has been studied over many years . It is not possible to review it all here, and instead the reader is pointed to two recent books on the topic .

Atoms and molecules obey the laws of quantum mechanics and *ab initio* quantum mechanical treatments of water line broadening are available for low-temperature collisions , but more approximate treatments are required at higher temperatures . This is because at atmospheric temperatures a molecule such as water has too many relaxation channels for a fully quantal treatment of the problem to be practicable. The discussion below will therefore be limited to semi-classical studies.

When considering the various models, it is also important to remember that as the models become more sophisticated they have more free parameters which almost automatically results in better fits of measured spectra. However, a high-quality fit to a set of spectral lines is not a guarantee of the validity of the line-shape model used; in particular, in the binary-collision regime the fitted parameters have to be linear functions of the pressure . At the same time, multispectral fits of lines recorded at several pressures of the perturbing gas are particularly useful for testing and characterizing complicated line-profile functions. Compared to spectrum-by-spectrum adjustments, multispectrum fits have the great advantage that they reduce correlations between model parameters, decrease their uncertainties and make convergence easier. Table  lists some of the key line-profile models developed and orders them in terms of the number of parameters required to characterize a single spectral transition at a given temperature for a given absorber and a given perturbing gas. The standard three-parameter VP, as already mentioned above, is the simplest line shape accounting for the pressure and Doppler effects.

The effect of collision-induced velocity changes on spectral line shape is usually known as Dicke narrowing . In this case the strength of the collisions, *i.e.*, their efficiency at changing the velocity, becomes important. Hard-collision models assume that molecular velocities before and after each collision are completely decorrelated, *i.e.*, each collision is so violent that the molecule loses completely the memory of its previous velocity and its new velocity simply follows a Maxwell distribution. The corresponding line profile is referred to as a Rautian profile (RP) or equivalently the Nelkin–Ghatak profile (NGP) . The hypothesis of soft collisions, in which many collisions are necessary to change the molecular velocity significantly, leads to the Galatry profile (GP) . Both hard- and soft-collision models introduce one extra parameter, $\nu_{\rm VC}$, to quantify the frequency of VC-collisions.

The speed-dependence of the relaxation rates, considered as the single source of line narrowing, leads to the speed-dependent Voigt profile (SDVP) . It should be noted that this speed-dependence can be introduced in more than one way. The most popular choice considers a simplified $r^{-q}$ long-range interaction potential, $r$ being the intermolecular distance and $q=3, 4, 5$, etc., for leading dipole–dipole, dipole–quadrupole, quadrupole–quadrupole, etc., interactions, respectively. This approximation results in an absolute speed-dependence expressed analytically using a confluent hypergeometric function (often denoted by ''h" in the model acronym) . However, the cost associated with this model is too high for routine computations, and thus it is common practice to use a much simpler, quadratic form (given by a ''q" in the acronym) . In this case the pressure-broadening width and shift are given by $$%\label{eqn_qSD}
\mathit{\Gamma}(v_{\rm a})=\mathit{\Gamma}_0+\mathit{\Gamma}_2 \lbrack (v_{\rm a}/v_{\rm a0})^2-3/2 \rbrack ,$$ $$\label{eqn_qSD}
\mathit{\Delta}(v_{\rm a})=\mathit{\Delta}_0+\mathit{\Delta}_2 \lbrack (v_{\rm a}/v_{\rm a0})^2-3/2 \rbrack ,$$ where $\mathit{\Gamma}_0$ and $\mathit{\Delta}_0$ are, respectively, the collisional width and shift averaged over all speeds, and the phenomenological rate parameters $\mathit{\Gamma}_2$ and $\mathit{\Delta}_2$ characterize the dependence on the active-molecule speed $v_{\rm a}$ ($v_{\rm a0}$ is its most probable value). The Boone–Walker–Bernath algorithm allows the calculation of a SDVP from two VPs.

Ascribing the line narrowing solely to the VC-collisions frequently leads to aberrant values of the $\nu_{\rm VC}$ parameter which can show unrealistic non-linearities as a function of pressure . For example, when just the linear part of this pressure-dependence is used with a GP to deduce the narrowing coefficient (the slope), the latter demonstrates higher values than those allowed by the kinetic diffusion ; conversely, a similar analysis using a RP leads to smaller values of $\nu_{\rm VC}$ . This behavior means that other treatments of narrowing are needed; in particular, SD should be accounted for. To this end, speed-dependence has been introduced in the soft-collision model, leading to the SDGP . The SDGP reduces to the GP in the absence of the speed-dependence ($\mathit{\Gamma}_2=0$ for qSD) and to the SDVP in the absence of velocity-changing collisions ($\nu_{\rm VC}=0$). Similarly, the SD introduced in the RP provides the speed-dependent Rautian profile (SDRP) . For both the SDGP and SDRP there are functional advantages if the quadratic SD, see eq. , is assumed .

Both the SDGP and SDRP models assume that the velocity-changing and the rotational-state-changing aspects of a collision are independent. In practice this is not true: a change of the velocities is balanced by a change of the internal states of the colliders, according to the energy conservation law. Therefore, VC and SD mechanisms can operate simultaneously and their respective model parameters are correlated. The profile models accounting for the correlation of these two collisional effects are described by functions involving supplementary fitting parameters. To achieve this correlation requires the introduction of further parameters. An example is the speed-dependent dispersive Rautian–Galatry profile (SDDRGP) , which is used to explain the line-shape asymmetries due to correlation, hardness and collision duration. The SDDRGP is a non-analytic line-shape model with many parameters, which have to be adjusted simultaneously, and therefore this treatment requires multispectrum fits.

An alternative method of introducing correlation is via the partially correlated hard-collision model for velocity- and state-changing collisions . Such a model, based on the use of hypergeometric SD, was recently employed for a spectroscopic determination of the Boltzmann constant . However, this hypergeometric form is difficult to use. A related, but easier-to-apply model considers the speed-dependence only quadratically, yielding the partially Correlated quadratic-Speed-Dependent Hard-Collision Profile (pCqSDHCP) . This model is flexible and has the major advantage that it can be represented using a relatively simple form, which allows rapid computational evaluation , an essential prerequisite for the adoption of a model by databases and modellers. This model is discussed in detail in the following section.

There are more sophisticated profiles which allow for intermediate strength collisions, of which the Keilson–Storer (KS) and the Rautian–Sobelman (RS) profiles are the most widely used. These more sophisticated profiles have an additional parameter $\eta$, the correlation parameter. In the KS model there is also a memory parameter, $\gamma_{\rm KS}$, which goes to zero for no memory (a hard collision) and unity for full memory (a soft collision) . The RS model instead uses the hardness parameter $\chi$ .

Of course, the choice of an appropriate line shape function is not a purely theoretical excercise and must be guided by fits to high accuracy measurements, which also need to consider the appropriate instrumental line shape function.

# The line-profile model

The line profile recommended by the TG is variously described as the partially Correlated quadratic-Speed-Dependent Hard-Collision Profile (pCqSDHCP) or the partially Correlated quadratic-Speed-Dependent Nelkin–Ghatak Profile (pCqSDNGP). This line-shape model has been considered by a number of authors , and has been used successfully for the analysis of ultra-high accuracy experimental water line shapes , although not all of these studies considered the speed dependence in quadratic form. The quoted acronyms represent an attempt to capture the physics behind the profile but they are hard to remember and convey little meaning to the non-specialist. The TG therefore recommends that this profile, and its computational implementation which we describe below, be called the Hartmann–Tran profile (HTP) after the authors of Refs. .

In terms of the 7 parameters $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$ and $\eta$, the HTP functional form can be expressed as : $$%\label{eqn_LP}
F_{\rm HTP}(\nu)=\frac{1}{\pi} {\rm Re}\left\{\frac{A(\nu)}{1-[\nu_{\rm VC}-
\eta (C_0-3C_2/2)]A(\nu) + (\frac{\eta C_2}{v_{\rm a0}^2})B(\nu)}\right\} .$$ The terms $A(\nu)$ and $B(\nu)$ can be expressed as combinations of the complex probability function $$w(z) = \frac{i}{\pi} \int_{-\infty}^{+\infty} \frac{e^{-t^2}}{z-t} dt =
e^{-z^2} {\rm erfc}(-iz),
\label{eq:w}$$ where erfc is the Gauss error function, while $$A(\nu) = \frac{\sqrt{\pi}c}{\nu_0 v_{\rm a0}} [w(iZ_-) - w(iZ_+)],$$ $$B(\nu) = \frac{v_{\rm a0}^2}{\tilde{C}_2}\left[-1 + \frac{\sqrt{\pi}}{2\sqrt{Y}}(1-Z_-^2)w(iZ_-)
- \frac{\sqrt{\pi}}{2\sqrt{Y}}(1-Z_+^2)w(iZ_+)\right].$$ In these expressions $$Z_\pm = \sqrt{X+Y} \pm \sqrt{Y},$$ $$X = \frac{-i(\nu_0-\nu)+\tilde{C}_0}{\tilde{C}_2},\ \ \ Y = \left(\frac{\nu_0v_{\rm a0}}{2c\tilde{C}_2}\right)^2,$$ where $$\tilde{C}_0 = (1 - \eta)(C_0 - \frac{3C_2}{2}) + \nu_{\rm VC},$$ $$\tilde{C}_2 = (1 - \eta)C_2,$$ with $C_n = \mathit{\Gamma}_n + i \mathit{\Delta}_n$ with $n=0$ and 2 within the quadratic approximation, see eq. . Finally, the most probable speed can be expressed in terms of the Doppler half-width as $v_{\rm a0}= \frac{c}{\sqrt{\ln 2}\nu_0}\mathit{\Gamma}_{\rm D}$, where $c$ is the speed of light in vacuum. Note that the HTP is normalized to unit area and is generally asymmetric, even if only slightly, due to the correlation and the speed dependence of the line shift. Furthermore, in the far wing, when $|\nu - \nu_0|$ is much larger than all other terms, the HTP reduces to a Lorentzian of half-width $\mathit{\Gamma}_0$.

|  |  |  |  |
|:---|:---|:---|:---|
| Acronym | Profile | Parameters | Limit of HTP |
|  |  |  |  |
| DP | Gaussian | $\mathit{\Gamma}_{\rm D}$ | $\mathit{\Gamma}_0=\mathit{\Gamma}_2=\mathit{\Delta}_0=
\mathit{\Delta}_2 = \nu_{\rm VC}=\eta =0$ |
| VP | Voigt | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$ | $\mathit{\Gamma}_2=
\mathit{\Delta}_2 = \nu_{\rm VC}=\eta =0$ |
| RP | Rautian | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$ $\nu_{\rm VC}$ | $\mathit{\Gamma}_2=\mathit{\Delta}_2 =\eta =0$ |
| qSDVP | speed-dependent Voigt$^a$ | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$ | $\nu_{\rm VC}=\eta =0$ |
| qSDRP | speed-dependent Rautian$^a$ | $\mathit{\Gamma}_{\rm D}$, $\mathit{\Gamma}_0$, $\mathit{\Delta}_0$, $\mathit{\Gamma}_2$, $\mathit{\Delta}_2$, $\nu_{\rm VC}$ | $\eta =0$ |

Correspondence between various lower-order models and the limits of the Hartmann–Tran profile (HTP) .

$^a$ Using the quadratic approximation of eq.  for the speed dependence.

The physics underlying the 7-parameter HTP profile is as follows. The speed-dependences of the relaxation rates are represented by four parameters: two, ($\mathit{\Gamma}_0$,$\mathit{\Gamma}_2$), to represent the line broadening and two, ($\mathit{\Delta}_0$, $\mathit{\Delta}_2$), to represent the line shift. $\mathit{\Gamma}_0$ and $\mathit{\Delta}_0$ are the mean relaxation rates, while $\mathit{\Gamma}_2$ and $\mathit{\Delta}_2$ are the quadratic terms describing the speed dependence of relaxation , see eq. . Velocity changes are represented within the Nelkin–Ghatak hard collision model, which requires a single parameter, $\nu_{\rm VC}$. Finally, parameter $\eta$ represents the partial correlation between velocity and rotational state changes due to collisions. The assumptions of quadratic speed dependences and hard collisions are approximations but, as illustrated below, some of the errors introduced by these approximations are actually compensated for by the inherent flexibility of the parameter fits. This model has been extensively tested both for water transitions and for those of other molecules using accurate calculated spectral shapes .

As discussed in the literature , there are a number of advantages the HTP model offers.

The first is that $F_{\rm HTP}$ can be expressed in terms of two (complex) Voigt (or complex probability) functions, see $w(z)$ as given in eq. . Tran *et al.* provide a routine for evaluating the HTP built on the Voigt routine of Humlicek . Numerical tests have shown that the relative accuracy of this routine is always better than $10^{-4}$ and that the computer time requirement is at most only five times that required for the computation of a VP.

Secondly, in the case where not all the parameters have been or can be determined, HTP reduces in a very straightforward fashion to a number of simpler, standard profiles. These limiting cases are listed in Table . In particular, given that the present databases are largely populated with parameters for the VP, it is advantageous that the HTP reduces to the VP if all the high-order correction terms are set to zero. This is an extremely useful property, but one note of caution is in order. The parameters used to determine these profiles are not independent; this means that once beyond-Voigt parameters are introduced into the fit it is no longer possible to use the parameters to give a correct VP.

Third, we should mention the Van Vleck–Weisskopf (VVW) line shape function , see page 184 of Bernath for a short discussion. This simple form includes an anti-resonant Lorentzian function. It is used for low frequency microwave work and in all models of mm-submm radiation propagation . By analogy with the VVW profile, the anti-resonant contribution, which is only significant at very long wavelengths, could be taken into account using an HTP after changing the signs of the transition frequency and the pressure shift.

Finally, line-mixing can be easily included in the model provided that two approximations are made . The first is the use of the so-called (Rosenkranz) first-order approximation . The second is the neglect of the speed-dependence of the line-mixing. These approximations are routinely used in practical treatment of line-mixing, for example the implementation in the HITRAN database .

# Discussion

The recommendation by the TG of the HTP as the new standard for representing the profile of high-resolution spectroscopic transitions raises a number of issues which should be considered.

First, use of this more complex parameterization to characterize the pressure line shape has a consequence not mentioned so far: collisional parameters for gas mixtures are no longer simple linear combinations of the parameters for the various active molecule-perturber pairs . This means that, for example, in the terrestrial atmosphere, it will be necessary for databases to separately specify collisional parameters for perturbations by N$_2$ and O$_2$ rather than just for "air" so that separate profiles can be computed and then added. As a result of this it will become necessary for all significant perturbers to be added individually to the databases.

Second, the discussion above has not addressed the temperature dependence of parameters in the line-profile models considered. Even for studies of the Earth's atmosphere it is necessary to consider line profiles in the temperature range of approximately $200$ to $300$ K. Much larger temperature ranges are required for other modelling studies. For example, water line profiles are required for the atmosphere of hot Jupiter exoplanets ($T =$ 1000 – 1500 K) and probably also for brown dwarfs ($T \leq 3000$ K). Available experimental studies usually span ranges of about 100 K to about room temperature, see Refs. for example. Obviously, it would be desirable to have experimental studies over more extended temperature ranges, but these are unlikely to be forthcoming in the immediate future. Conversely, *ab initio* spectral shapes calculated by molecular dynamics simulations should be reliable at temperatures above the quantum limit and can easily be repeated for many temperatures. So far such studies on water seem to have focused heavily on the room temperature regime . Extending molecular dynamics simulations to probe the effects of temperature would clearly be very useful. In the absence of experimental determinations, this would allow predictions of the temperature dependence of the narrowing and correlation parameters. We expect the latter to be reliable, in view of the quality of calculations at room temperature. Furthermore, the temperature dependences of $\mathit{\Gamma}_2$ and $\mathit{\Delta}_2$, like $\mathit{\Gamma}$ and $\mathit{\Delta}$, can be investigated by using semi-classical calculations .

Third, other tests, both experimental and numerical, would also be useful. Issues that should be probed include: (a) signal-to-noise limits that the HTP (and other profiles) are reliable for; (b) tests of extreme heavy – light collisions such as water perturbed by He (or H$_2$), such collisions are normally considered to be "soft"; (c) tests of extreme light — heavy collisions such as water with Xe or SF$_6$; and (d) tests of whether collisions with open-shell systems, such as O$_2$, introduce any new features.

Finally, the HTP is based on an approximate quadratic treatment of the speed dependence and of velocity changes. The approximate treatment of SD can be tested against the more physically-based and more complicated pChSDNGP, which uses the hypergeometric SD, albeit still with an approximate treatment of the potential. Such tests have recently been completed by De Vizia *et al.* , see Fig. 1. They found that the HTP and pChSDNGP fitted their benchmark, measured, high-precision water line profiles almost equally well. Furthermore, they found that the retrieved broadening and shifting parameters were unchanged in the two fits, something not completely found, for example, when using the SDGP (speed-dependent Galatry profile) to fit the same data . However, values for the parameter $\nu_{\rm VC}$, which can be related to the diffusion coefficient of the molecule in the perturbing medium, were found to be physically meaningful for the pChSDNGP fits but not the HTP ones . Under these circumstances $\nu_{\rm VC}$ must just be regarded as a useful fit parameter, and nothing more. From Fig. 1, one can see that the residual of the fit with the VP varies between about $\pm 0.5$ % of the peak absorption. These data are for a specific line and pressure, but much larger effects are observed for other transitions and gas densities.

# Final recommendations and conclusions

The IUPAC Task Group formed by the first 12 authors of this paper makes the recommendation that the partially Correlated quadratic-Speed-Dependent Hard-Collision profile should be adopted as the appropriate line-profile model of high-resolution spectroscopy moving beyond the VP. For simplicity we propose calling this the Hartmann–Tran profile (HTP).

The proposed line shape is based on six temperature-dependent, collisional parameters for each line and perturber plus the Doppler width, $\mathit{\Gamma}_{\rm D}$, fixed to its theoretical value. These parameters give the model the flexibility to include all the major "non-Voigt" effects. HTP involves parameters with known pressure dependences that can be stored in databases. HTP has been demonstrated to lead to an accurate description (0.1 % or better) of the line shapes for a number of combinations of absorbers and perturbers , with the exception of H$_2$, which is a known difficult case. Furthermore, HTP can be computed accurately using only moderate computer time requirement , it is compatible with current implementations of line mixing, and it can be initially parameterized using the Voigt parameters already available in standard data compilations.

Considering the relatively large number of parameters required for the full HTP model and the correlations between them, fitting measured individual spectra is unlikely to yield a well-constrained parameter set. This means that a multispectrum procedure must be used. Furthermore, to remove the partial correlations between the various parameters, it is essential to use spectra recorded in a broad pressure range and with a high signal-to-noise ratio.

There are some open questions about the use of the HTP. The most pressing of these concerns the temperature dependence of the model parameters. These have not been the subject of serious testing over extended temperature ranges with temperature-dependent data from either laboratory measurements or numerical (molecular dynamics and semi-classical) simulations. Furthermore, very high signal-to-noise ratio measurements, combined with multispectrum fits of data recorded at a number of pressures, would help to better define the underlying accuracy of the model. Finally, tests need to be performed with a variety of collision partners to determine, for example, the effects of different mass ratios and collisions with open-shell species such as O$_2$.

One issue not discussed so far is that of the so-called water continuum . The water vapour continuum is characterised by absorption that varies smoothly with wavelength, from the visible to the microwave. It is present within the rotational and vibrational-rotational bands of water vapour, and in the many '' windows" between these bands. The precise relationship between the water continuum with the far wings of the line profile for individual transitions and with dimer contributions remains a matter for discussion. It is clear that changing the model for the line profile about the line center has possible consequences on the determination of the continuum. However, these should be small as local line contributions are only calculated in a narrow interval before subtraction from the measured absorption. Changing the line shape thus has only a local effect with minor consequences on the broad and slowly varying continuum. Furthermore, the main uncertainties in the continuum determination remain more to do with uncertainties in the line intensity and broadening coefficients than the line profile. Nevertheless, for consistency, a continuum should be used in radiative transfer calculations which has the same local line shape as the one used in its experimental determination.

Finally, we note that adoption of the HTP will require significant alteration to the data structures used in databases. Work in this direction has already started . Although TG2 was set up explicitly to consider water, our recommendations and the modernizations should apply to the line shape used for all molecular species.

# MEMBERSHIP OF SPONSORING BODY

Membership of the IUPAC Physical and Biophysical Chemistry Division Committee for the period 2014–2015 is as follows:
**President:** R. Marquardt (France); **Vice President:** A. K. Wilson (USA); **Secretary:** A. Friedler (Israel); **Past President:** K. Yamanouchi (Japan); **Titular Members:** K. Bartik (Belgium); A. Goodwin (USA); A. E. Russell (UK); J. Stohner (Switzerland); Y. H. Taufiq-Yap (Malaysia); F. van Veggel (Canada); **Associate Members:** K. Battacharyya (India); A. G. Császár (Hungary); J. de Faria (Portugal); V. Kukushkin (Russia); Á. W. Mombrú (Uruguay); X. S. Zhao (China/Beijing); **National Representatives:** Md. Abu bin Hassan Susan (Bangladesh); H. R. Corti (Argentina); J. Cejka (Czech Republic); S. Hannongbua (Thailand); S. J. Kim (Korea); E. Klein (Bulgaria); M. Koper (Netherlands); M. Korenko (Slovakia); K. E. Laasonen (Sweden); J. E. G. Mdoe (Tanzania); V. Tomišić (Croatia).

# ACKNOWLEDGMENTS

We thank Dr Linda Brown and Prof Keith Shine for their inputs in the writing of this manuscript. This work was supported by the International Union of Pure and Applied Chemistry for funding under project 2011-022-2-100 (Intensities and line shapes in high-resolution spectra of water isotoplogues from Experiment and Theory). We thank the Royal Society's Kavli Centre for their hospitality during the completion of this work. In addition, this work has received partial support from the UK Natural Environment Research Council, the Royal Society, the European Research Council under Advanced Investigator Project 267219, the Scientific Research Fund of Hungary (grant OTKA NK83583), the Greenhouse Gas and Climate Sciences Measurements Program of the National Institute of Science and Technology, the National Science Foundation of the U.S.A. through Grant No. AGS-1156862, the Polish National Science Centre, Project no. DEC-2011/01/B/ST2/00491, the Foundation for Polish Science TEAM Project co-financed by the EU European Regional Development Fund, the Russian Foundation for Basic Research, NASA Earth Observing System grant NNX11AF91G and NASA Planetary Atmosphere grant NNX10AB94G, the NASA laboratory astrophysics program, the Programme National LEFE (CHAT) of CNRS (INSU), and the Laboratoire International Associé SAMIA between CNRS (France) and RAS (Russia).


abstract: The always increasing mobile connectivity affects every aspect of our daily lives, including how and when we keep ourselves informed and consult news media. By studying a DPI (*deep packet inspection*) dataset, provided by one of the major Chilean telecommunication companies, we investigate how different cohorts of the population of Santiago De Chile consume news media content through their smartphones. We find that some socio-demographic attributes are highly associated to specific news media consumption patterns. In particular, education and age play a significant role in shaping the consumers behaviour even in the digital context, in agreement with a large body of literature on off-line media distribution channels.
  .
  This paper has been accepted for publication on the SpringerOpen journal EPJ Data Science, and is available at <https://doi.org/10.1140/epjds/s13688-020-00228-9>.
author: Salvatore Vilella
ISI Foundation
&
Department of Computer Science
University of Turin
Turin, Italy
`firstname.lastname@example.com`
Daniela Paolotti
ISI Foundation
Turin, Italy
`firstname.lastname@example.com`
Giancarlo Ruffo
Department of Computer Science
University of Turin
Turin, Italy
`email@example.com`
Leo Ferres
Data Science Institute
Universidad Del Desarrollo
Santiago de Chile, Chile
`firstname.lastname@example.com`
bibliography: bmc_article.bib
title: News and the city: understanding online press consumption patterns through mobile data

# Introduction

Internet, the World Wide Web and, more recently, the pervasiveness of mobile technologies have radically transformed the way individuals consume cultural content. One of the areas that was impacted the most by new forms of digital media is journalism: how newspapers are accessed, how news are consumed. The abundance and diversity of topics have forever been altered . Gaining a better understanding of how different population groups are using and benefiting from on-line news services is now even more important. By leveraging mobile information, it is possible to map the variability of news consumption patterns of the population onto socio-demographic features such as the education level, age, income etc.

In this work, we want to explore the association between social inequality and news consumption in the context of digital news outlets. We focus on Chile, a country that in the past three decades has experienced an incredibly rapid economic growth along with a deep political transformation (from a dictatorship to a democracy). Exactly for these reasons, the case of Chile is particularly interesting. It is currently among the countries with larger social disparity and yet, according to the *Newzoo's Global Mobile Market Report*, the penetration of digital technologies remains the highest in Latin America. The expected effect is that easier access to digital news outlet should "democratize" the news consumption. Indeed, it has been found that newspapers and magazines have lost their elite character, diversifying in order to adapt to popular preferences throughout the 20th century while books remain a marker of 'elite culture', and while status is not an important determinant of magazine and newspaper reading, education and income are .

News consumption patterns have been increasingly studied in the last decade, especially now that digital media have started providing a huge variety of new platforms that facilitate - and, on the other hand, makes more complex - the fruition of news. Access to news outlets from mobile phones, for example, is now more fragmented and shallower with respect to traditional media . Technology also drives the consumption of content in terms of continuity of access ("anywhere, anytime") . Previous literature has also shown how individual choices with respect to news consumption can be influenced by the social status of the users. A strong and systematic association between status and newspaper readership has previously been established . Influence of education, income and age on newspaper consumption and platform preferences has also been explored .

The role of education is particularly critical. Researchers have found education to be a strong predictor of media behavior . It is also positively associated with general news exposure . In some context, news consumption is more unequally distributed than income is, with greater social inequality in online news consumption than in off line news consumption . Within the particular context of Chile, news media have already been studied to outline, for example, their ownership structures or their political bias and to understand the effects of certain press manipulations by owners of the media outlet .

The contribution of this work is two-fold: first, we explore the association between socio-demographic attributes and news consumption in the Chilean context, in line with the literature we just described (that usually based the analyses in single-nation frameworks, like the US or Argentina) and our own previous work . Second, we rely upon a unconventional and unique data source: mobile phone data. Traditionally, this topic has been investigated using surveys among various population groups (, just to mention a few). We believe that mobile technology can provide new insights that complement traditional methods of data collection. Indeed, many diverse research questions have been addressed using mobile communication data: to elaborate indices of the economic development of a region , to study traffic flows, urban human mobility, social mixing phenomena as well as epidemic spreading on fine spatial and temporal scales . We believe that such a data source could add interesting new insights also in the context of this research area, besides the fact that these methods are less expensive, less time consuming, and they scale efficiently.

In the following sections we present the results of a study on users accessing on-line news media in the city of Santiago de Chile (SCL) through mobile devices (using DPI (*deep packet inspection*) data. The focus is on the time window that spans from the of July 2016 to the of August 2016. In order to characterize each area by the socio-demographic information of its residents, we used the 2017 census data (see Sec. ). We find that some socio-demographic attributes are highly associated to specific news media consumption patterns. In particular, education and age play a significant role in shaping the consumers behaviour even in the digital context, in agreement with a large body of literature on off-line media distribution channels.

# Methods

## Datasets and data pre-processing

In this section, we present a description of the data used and of the procedures that we followed for data cleaning and pre-processing.

### Census data

To characterize Chile socio-economically, we used the official 2017 Chilean census[^1], surveying 17,574,003 people (51.1% females). Geo-politically, from largest to smallest, Chile consists of "regions", the largest administrative division, followed by "comunas" (similar to counties in the United States), census districts, census zones, and finally blocks, the finest level of geographical granularity. The public dataset is available at the level of blocks. Here, we focus on the Metropolitan Region of Santiago de Chile (RM, for short). The RM consists of 52 "comunas" for a total of 7,112,808 individuals (51.3% females), accounting for about 40% of the total population of Chile. In this work we correlate census information with data from mobile web traffic records. Since minors (persons whose age is $< 18$) cannot sign mobile phone subscriptions, we decided to be conservative and only work with adults in the census to have a better match between the sample populations of the mobile data and census data sets, ending up with 5,450,592 individuals in the census and 2,455,148 unique users in the general phone dataset.

The 2017 Census contains a great deal of information on several aspects of the socio-economic composition of the Chilean population. It has the issue that it is only an abridged version of the usual census surveys, since a more comprehensive one will be released in 2022. Given the particular structure of the questionnaire, we were able to perform a manual selection of the census features. Indeed, the vast majority of the questions in the survey revolve around a few topics (e.g., on top of the basic question "*Do you consider yourself as a member of a native minority?*" there are other additional questions to distinguish between the different native minorities). We thus decided to select our features only among the following basic socio-demographic information:

-   Age;

-   *Escolaridad* (years of formal education attained);

-   Student status (whether an individual is still studying or not);

-   Membership to a native population.

The census does not report on individuals' income directly. Thus, information about the economic situation had to be inferred. To do so, we chose *escolaridad* as a proxy. In Chile, at least, there is a well-known strong correlation between formal education and income distribution and inequality . Moreover, the variable *escolaridad* weighs heavily in the calculation of the Human Development Index (HDI), which is a widely used indicator of wellness and quality of life, that in turn can be used to get a first, qualitative measure of the soundness of our results (a map of Santiago HDI distribution at the level of municipalities can be seen in Fig. ).

Census data can be aggregated at the different levels already mentioned: region, comuna, districts, zones and blocks. As we go into more granularity, census information becomes less specific in order to avoid identification and preserve privacy of individuals. We have chosen the level of *district* as a good trade-off between granularity, privacy preservation and availability of information, see Fig.. Finally, each value was expressed as a percentage - or a mean, depending on the typology of the quantity - over the population of each district.

Other than the provisos made above, the rest of the census dataset was not modified or preprocessed in any other way.

### Building a mobile web connections data set

We obtained a DPI (Deep Packet Inspection) data set from one of the largest company in terms of mobile subscriptions market share (around $30\%$) in Chile. This data set is a record of internet connections from smartphones or any device that contains a SIM card and is subscribed to the telco network. This dataset consists of almost a month (between the of July 2016 and the of August 2016) of anonymized *events*. An event is defined as a connection of an individual device to an IP address through a cell tower (or antenna). In order to preserve privacy, information was aggregated by antenna and by hour, without any single user information, making it virtually impossible to de-anonymize news consumers.

Our `DPI` data set includes the *number of unique users* that connected from an antenna to an IP address at a certain hour (00, 01, 02... 23), as in the following:

|     |          |          |      |                 |      |
|:----|:---------|:---------|:-----|:----------------|-----:|
|     | antenna  | date     | hour | ip              | usrs |
| 1   | 00000000 | 20160706 | 11   | 22.214.171.124   |    2 |
| 2   | 00000000 | 20160706 | 14   | 188.8.131.52 |    1 |
| 3   | 00000000 | 20160706 | 14   | 18.104.22.168    |    1 |
| 4   | 00000000 | 20160706 | 15   | 220.127.116.11 |    1 |
| ... | ...      | ...      | ...  | ...             |  ... |

The first lines of the DPI dataset.

In the case of the small sample above, the first row of the raw dataset tells us that from antenna `00000000`, on July 6, 2016, there were two unique (i.e. distinct) users visiting `220.127.116.11` at 11 in the morning.

The urban area of Santiago de Chile contains about 15,000 cell phone signal receivers, called *antennas*. Most outdoor antennas are placed on top of poles called cell phone *towers*. There are about 1,700 towers in our area of interest, with an average of 10 antennas per tower. There exist also standalone indoor antennas (sometimes called "small cells"), usually attached to indoor walls of large spaces such as hospitals, malls and public buildings. We have information on the exact latitude and longitude of the different *towers* and indoor antennas, allowing us to geo-reference our analyses. Abusing terminology, we call every unique geo-located cell phone receiver an "antenna'', this may be a tower with dozens of antennas on it, or just one single indoor antenna in a hospital. In high demand areas, such as the financial districts or industrial complexes, there area tens of towers with tens of antennas (plus indoor antennas) within a small area of a few tens of meters. Which antennas a user connects to depends on many factors, including distance, antenna demand (many devices may be connected to that antenna already), power, azimuth, among others. If the user moves a few meters, this could mean triggering the network to assign her a new antenna every few minutes. For that reason, to make the results more stable, in this paper, we group together all the antennas within a 1.1km radius, obtaining a grid of about 700 points. We call these "dummy" antennas (the red dots in Fig. ). "Dummy" towers are the result of clipping the full latitude and longitude to two decimals, so that instead of having the "real" antennas at high-precision (and much finer level of granularity), we now have a "dummy" antenna at the center of the 1.1km2 square cell. These antennas should be taken as our "sensors", the finest level of granularity we have access to, which will also be mapped to the census, as we will see later.

Our dataset is a part of the complete *deep packet inspection* dataset of the telco provider. This subset contains only requests to those IP addresses that belong to some kind of news media outlet. In order to navigate among these outlets, we used a curated list of news organizations analyzed in a previous work . These are around 400 news outlet accounts [^2], twenty six outlets for which we knew their economic and political bias .

The process of identification of each IP address in order to associate the name of a website was not straightforward. There was often a many-to-one relationship between websites and IPs; for example, there are clusters of two or more websites that share the same IP. This is a critical issue, since in the dataset we can only see IP addresses, without any DNS reverse lookup. In any case, most of the websites that share the same IP belong to the same owner. This allows us to label each IP by its owner: this way we lose knowledge about the individual news outlet, that we are often unable to identify, but we still keep a satisfying amount of information by creating a unique matching between each IP and the editorial group (EG) that owns it. Thus, whenever needed, the EG was considered instead of the individual news media. Also, as shown in , the power structure in Chilean news media is strongly biased towards very few groups that share an identifiable editorial line. The only newspaper outside the above list is *The Clinic*, a Chilean satirical newspaper that is usually identified as *leftist*, which we added in order to cover the political spectrum as widely as possible, and use it as a baseline for informational extremes ("El Mercurio" would be right-conservative, and "The Clinic" would be left-liberal). The complete list of news outlets examined is shown in Table .

This selection is useful for various reasons: it allows us to remove some noise caused by the outliers, i.e. not-so-popular news media that display a very low number of connections, and, most importantly, it helps us focusing on a narrow but significant range of news outlets, for which we already have a quantitative knowledge of their political bias and of their popularity. Incidentally, with this filtering we were able to maintain in our analysis BioBioChile, El Mercurio and Cooperativa, that are the top 3 most visited outlets in our dataset, accounting for the vast majority of the volume of web traffic., thus not losing too much information.

| **List of the news outlets examined** | **Number of unique users**  |
|:-------------------------------------:|:---------------------------:|
|              BioBioChile              |           1702768           |
|      El Mercurio editorial group      |           815152            |
|              Cooperativa              |           639120            |
|             AdnRadioChile             |           465149            |
|              The Clinic               |           337048            |
|                Tele 13                |           188409            |
|           Diario Financiero           |           103450            |
|           Publimetro Chile            |            54478            |

List of news outlets (or editorial groups) examined in the `DPI` data set.

After filtering by news outlet and considering only the urban area of Santiago de Chile, we have $4313964$ events.

Finally, since we are crossing mobile data with census, which contains socio-demographic information about the *residents* of a certain area, we need to take into account the phenomenon of the *floating population*, i.e. people moving from one place to another, especially at commuting hours and during working days. This matter has been extensively studied, and there are study cases set up in Santiago that show exactly how the city is affected by the phenomenon (and how mobile data could be used to understand urban mobility, see for example ). To tackle this issue, we examined the temporal patterns of the connections, illustrated in Fig.. By comparing the trends between the weekends (Saturdays and Sundays) and the working days (Mondays to Fridays) we can easily notice the circadian rhythms of the city: the peak in connections starts when people wake up, continues when they commute to work, rises again at lunch time and finally when they go back home at 6 pm. This last peak is what differentiates the working days from the weekends: on Saturdays and Sundays, no afternoon peak can be observed, with a smooth decline of the connections towards night hours instead. The typical effects of the floating population phenomenon seem much attenuated during the weekends, and the volume of connections seems to remain almost constant throughout the whole day. The correlation between the number of unique users and the number of residents in each comuna is rather high, with a Pearson coefficient P=0.75 $(\text{p-value}=
1.85e-07)$. This means that the geographical distribution of users accessing news media websites from mobile is a good proxy for the geographical distribution of the population. There is a clear trade-off in our choice of considering only the connections at the weekends: on the one hand we reduce our data to almost one quarter of the initial volume, i.e. $\sim 1$ M events, but on the other hand we are able to address the issue of the *floating population*, at least partially reducing the noise caused by this phenomenon.

## Ethical considerations

Working with mobile data could raise privacy concerns. Of course, DPI data was handed out by the mobile provider already anonymized and grouped per tower: data appeared as shown in Table , displaying only the number of unique devices connected to a certain antenna, without any knowledge about the identity or the profile of the customer. Therefore, we work with highly aggregated data and, for good measure, the resolution was then made even coarser, as described in Sec. . The same applies to census data: even though they are already anonymized and publicly available, the research was not carried out at the finest possible granularity, in order to have a good balance between available amount of information and privacy preservation. Our concern in relation to privacy stems from the possibility of cross-referencing raw DPI data with census information which could have unforeseen consequences and result in potential de-anonymization.

No attempt was made to infer statistics about individuals: the nature of DPI itself prevents this from happening. All the results are *general* trends of *very large* groups of residents - between hundreds of thousands and millions of people.

## Mapping census data to districts

All the connections to the websites are grouped by hour and by antenna: this provides with a good approximation of the users' position in the city. Our goal is to study the connections based on the census features of the areas from where they are originated. Thus, we want to assign to each census district (CD) a label that helps us distinguishing between different segments of census. To estimate the most appropriate number of groups (and, therefore, labels), we cluster the CDs based on the census features that we selected earlier. We use a k-means algorithm, running the procedure several times for $2 \leq k \leq 30$. Since we need a clear and easily interpretable grouping, we limit our choice to $3 \leq k \leq 8$: having only 2 census groups would not be enough for such an analysis, while more than 8 would be hard to interpret. The values are standardized, and the algorithm was initialized with a random seed. For each $k$ we compute the Gini coefficient of the distribution of the population (Fig. ): a low Gini represents a situation of order, in which the population is almost equally distributed across all the clusters, while a high value is retrieved for an heterogeneous distribution throughout the different groups.

The final value, $k=5$, is chosen as it is the value that maximizes the Gini coefficient and, thus, the heterogeneity of the distribution of the population. This is based on the assumption that a very ordered situation, in which we have almost the same number of people in each cluster, would be non realistic.

By setting $k=5$ and inspecting the average values of the features for each group (see Table ), we observe an almost hierarchical relationship among the different clusters. This is particularly true for the *escolaridad* variable, which correlates very well with the income, as mentioned above. The clusters were simply named *K1-K2-K3-K4-K5*, with K1 being the wealthiest area, and all the others following in an ordinal fashion. In light of this hierarchical relationship, we will denote these groups - or clusters - also as census *levels*.

| **Cluster** | Mean age | Avg years of schooling | % of students | % of people of indigenous ethnicity |
|:--:|:--:|:--:|:--:|:--:|
| **K1** | $46.25\pm0.27$ | $16.91\pm0.11$ | $0.154\pm0.003$ | $0.047\pm0.002$ |
| **K2** | $38.78\pm0.58$ | $16.50\pm0.17$ | $0.179\pm0.006$ | $0.075\pm0.004$ |
| **K3** | $42.05\pm0.21$ | $14.65\pm0.12$ | $0.138\pm0.002$ | $0.096\pm0.002$ |
| **K4** | $46.36\pm0.13$ | $14.30\pm0.09$ | $0.122\pm0.001$ | $0.097\pm0.001$ |
| **K5** | $44.62\pm0.18$ | $12.86\pm0.08$ | $0.106\pm0.001$ | $0.131\pm0.002$ |

Insights of the clusters. In these table are shown the mean values of the features for each cluster.

The resulting map, shown in Fig. , resembles the distribution of the HDI shown in Fig.. In particular, the clustering procedure captures very well the presence of a very rich and highly segregated area (cluster K1) in the north-eastern part of the urban area, while the other census groups are distributed more heterogeneously throughout the city.

### Study of the global spatial autocorrelation

As further evidence of the segregation that emerges from the k-means algorithm, we dig deeper into the spatial distribution of the census features. To do this, we measure Moran's Index on census data and test the global spatial autocorrelation of the features against a random null model. Moran's I for a variable $y$ measured over $n$ spatial units is defined as $$I=\frac{n}{S_{0}}\frac{\sum_{i}\sum_{j}z_{i}w_{ij}z_{j}}{\sum_{i}z_{i}^{2}}$$ where $w_{i,j}$ are the elements of a spatial weight matrix $W$, $S_{0}=\sum_{i}\sum_{j}w_{ij}$ and $z_{i}=y_{i}-\bar{y}$ is the deviation of *y* from its mean value in the spatial unit *i*. The matrix $W$ is essential in spatial autocorrelation analysis, since it provides the model with a measure of spatial contiguity. The definition of spatial contiguity is usually specified as a *neighborhood* relationship between spatial units. Since we are dealing with census districts, namely areas of the city, we decided to use the Queen neighborhood (Fig. ). We believe that using a Rook neighborhood in a context of urban spatial analysis would be too limiting because, for each computation, we would not be considering the influence of the areas in the corners of the spatial unit under examination. Thus, we defined as *contiguous* all those areas that surround the zone we are observing, considering sufficient that they only meet at corner vertexes : all those areas interact, communicate and most likely influence one another.

We measured the global spatial autocorrelation for the census since we need to corroborate any evidence of clustering resulting from the application of the k-means algorithm. The Moran's I is an univariate measure of correlation, hence we measured it for every census feature. All the results were then compared with the Moran's I calculated for the case of a completely random spatial distribution of the features.

In order to have a better understanding of the spatial autocorrelation and have a *more local* view, we examined the Moran scatterplot of the data points for each feature. The analysis of the Moran scatterplot was first introduced by Anselin , and it is based on the interpretation of the Moran's Index as a coefficient of an ordinary least squares (OLS) regression of the *spatially lagged* variable on the variable itself:

$$\sum_{j}w_{ij}z_{j}= a + Iz_{i}$$

where $\sum_{j}w_{ij}z_{j}$ is the *spatial lag* of the variable *z* (which in turn is $y$ expressed as deviation from the mean). Hence the spatial lag is a weighted average of the variable $z$ over the neighbours of $i$. Note that the interpretation of $I$ as a coefficient of an OLS regression is valid for any statistic that can be expressed as a ratio between a quadratic form and the sum of the squares , which is exactly how the Moran's I is defined.

Plotting the spatial lag of $z$ as a function of $z$ allows us to have a local view of the spatial autocorrelation. The plot is divided into four quadrants, going from the 1st quadrant of high values of both $z$ and the spatial lag (*high-high correlation*) to the 4th quadrant of high-low correlation, passing through the so-called low-high and low-low correlation. A point being far up in the first quadrant of the Moran scatterplot of the *average schooling year* feature, represents an area that has a very high mean value of schooling, and is surrounded by neighbours with similarly high values.

As we can see in Fig. , there is strong evidence of segregation for almost all the census features, in particular for the *extreme* census segments K1 and K5 which, depending on the feature, are usually located way up near the bisector of the first and third quadrants. The census segments in between, instead, display a far more mixed situation.

# Results and discussion

## Geo-referenced analysis of the `DPI` dataset

The labeling of the census zones based on socio-demographic features finally enables us to proceed with a geo-referenced analysis of the connections towards the selected news outlets websites. The goal is to find differences in the consumption of news media content by areas of the city that have different socio-demographical attributes.

A list of the news outlets can be found in Table : wherever we encountered the issues described in Sec. , we grouped the news outlets by owner and considered the resulting group as an individual entity. This is the case of what happened with all the outlets belonging to the *El Mercurio* editorial group, which we included in our final list as a single entry.

In Figure we plot, for each News Outlet (NO), the number of unique users in each CD, normalized over the number of residents of the cluster the CD belongs to. Fig. shows the same quantity considering all the NOs together, i.e. the total amount of users connecting to news outlets websites during the examined weekends of July and August 2016.

Before analyzing these plots, it is worth going back to Table . The grouping into 5 clusters portrays a very clear division between the first two census segments and the remaining three. Indeed, groups K1 and K2 display a very high average value of schooling years ($>16$), with group K2 being composed of much younger individuals and a higher percentage of students. Groups K3, K4 and K5 instead are more comparable with each other, displaying a progressively lower value of schooling years and percentage of students, and a higher value of people of indigenous ethnicity. As pointed out in Sec. , these three groups are spatially mixed, while K1 and K2 are segregated in the north-eastern and, to a lower extent, in the central part of the urban area of the *Region Metropolitana de Santiago*.

In light of this grouping, we can inspect the results shown in the plots. From Fig. we can gather the first, clear evidence: group K2 completely dominate the chart. This means that the majority of the connections are originated in those areas that are characterized by a high percentage of young and highly educated residents. As said, for each cluster the connections have been normalized over the number of people in it, meaning that we are looking at a measure of the *activity* of a cluster with respect to its size. This dominance of the group K2 and, in smaller measure, of K1, is confirmed also by computing the Pearson correlation between the number of connections and the number of residents in each cluster. We get P=-0.92 $(\text{p-value}=0.029)$, a very high anti-correlation, meaning that - in proportion to their size - the smallest clusters show the highest activity. Indeed, the smallest clusters are K2 (with only 255699 people) and K1 (682053 inhabitants), while the remaining three all have more than 1M residents each.

We can also analyze the same trends for the individual news media websites. From Fig. we can see that the areas belonging to group K2 are again on top in the majority of the plots. The only exception is for the websites belonging to *El Mercurio*, a right wing editorial group, which is most accessed by those areas belonging to the K1 segment. Similar numbers between K1 and K2 can be found also for the website of *Diario Financiero*, a financial newspaper. As for the other census groups no clear pattern can be identified, but still it seems pretty clear that, both in Fig. and , group K3 is always the least active. In general, segments K3, K4 and K5 display an activity comparable to that of groups K1 and K2 only for those news media, like *Biobio*, *Cooperativa* or *Tele13*, that can be classified as containers of *generic* news and information, unlike *Diario Financiero*, which is highly specialised on financial matters, or *El Mercurio*, which is openly politically oriented.

As expected (), the circadian rhythm of the population can still be seen from these figures, even though to a lower extent than the same analysis performed on the weekdays (Fig. ), as explained in Sec. . The decline in connections towards night hours is smooth, and the trends are very similar across all the census segments.

### Addressing the limitations

This method presents some limitations. First of all, we acknowledge a possible bias in our dataset: while census is representative of the whole population, mobile data accounts only for the customers of the service provider, which can be biased towards a certain segment of the population depending on multiple factors (typologies of the proposed contracts, marketing strategies, etc.). Nonetheless, bearing in mind that this provider alone owns more than the 37% of the marketshare, a correlation check between our dataset and the number of residents in each census zone gave us satisfactory results, as pointed out in Sec. . Another influence on the results could come from the diverse penetration rate of WiFi technologies among the various census groups. One of our basic assumptions is that people, during weekends, access the web mostly from their houses or from nearby locations. This means that, especially in their houses but also in some public places, people could be surfing the web via WiFi instead of using their own mobile data. This, again, strongly depends on the specific country and on its telco market, and it could also be related to the fact that - in general - WiFi is more popular among those individuals that have, for example, a bank account (sometimes needed even just to get a broadband contract in the first place) or at least a certain yearly income. Thus, we acknowledge that these census groups, in particular K1 and K2 segments according to our clustering algorithm, could be slightly under-represented in our dataset. Nonetheless, the positive correlation between the number of unique accesses and the residents in each municipality is a reassuring evidence with respect to this matter. Moreover, for the particular case of Chile, the effects of this issue should be limited: according to official data (Subtel), nearly 80% of all internet access is made from mobile phones .

A further limitation of this study is data availability. We are under strict non-publication policies from the telco, and the data cannot leave the telco's premises. This is to be expected given the novelty of the data sets we are working with, and their yet-to-be-understood privacy implications (this notwithstanding, please see the "Data Availability" section below)

# Conclusions

The main purpose of this work is to understand whether individuals living in different areas of the city of Santiago de Chile display different behaviors in terms of access to digital news media content with respect to socio-demographic attributes. In order to do so, we studied a record of a month (July-August 2016) of anonymized and geo-referenced accesses to several websites of Chilean news media through the cellphone network of a major telco provider. To reduce the effects of the *floating population* phenomenon, we analyzed only a portion of the connections, narrowing the window to the weekends only.

By applying a k-means algorithm on official Chilean census data, in order to group the population into 5 different census levels, we find that the wealthiest areas of the city, K1 and K2, are very similar in terms of *years of schooling*, with K2 members being - on average - much younger than K1. The other three clusters (K3-K4-K5) are indeed pretty far from the first two in terms of average education level, and far more spatially mixed: K1 and K2 are mostly grouped in the north-eastern quadrants of the city.

The news access patterns tell us that segment K2 is overall the most active group. This means that the most highly educated and youngest are also the most informed, with respect to older people with similar education level. If we break down the number of access by individual media outlet, we obtain a more composite picture (Fig. ). K2 remains the most comprehensively informed with respect to the diversity of media outlets; on the other hand the ranking of the other groups can vary depending on the flavour of the news media.

These findings confirm empirically that socio-demographic features have an influence on the consumption of news. Our results suggest that the consumption of news media content does not always necessarily increase with the education level of the user. While it is true that the highly educated are those who access news media websites the most, the opposite cannot be inferred: indeed group K3, which includes all those areas of the city whose residents are averagely educated (see Table ), is the cluster that displays the lowest activity.

The predominance of group K2 also tells us that age plays a key role in this context. Young generations are likely more comfortable in using mobile devices in their daily lives, and this has been also explored in the specific field of news consumption .

In summary, although we found clear correlations between the consumption of online news media content and the socio-demographics of users, this relationship seems to be non-trivial. While the highly educated are the most eager users of mobile news media outlets, there are important clues that a group of well educated people, that we could identify as middle-class, show a lack of interest in accessing news media via mobile. This could have a significant impact on the civic engagement of a relevant share of the population, as well as on the economical and political life of a Country, not mentioning the media market itself.

There are positive correlations between the other two features - *student status* and *percentage of people of native ethnicity*. Therefore, a more detailed analysis of the ties between these features and the consumption patterns of the individual news outlets - namely, the habits and preferences of students and native minorities - could be of much interest in the context of studying inequalities in the accesses between different cohorts of the population, and it is left as future work.

We believe that this work could be useful to shed some light on how digital platforms can contribute to the already complex interplay between socio-demographic characteristics of the population and the news consumption behaviour. Additional studies with more comprehensive datasets in other social contexts are needed, to assess the full impact of digital technologies on this topic, as well as to understand if these findings are highly Country-specific or if there is a shared worldwide-trend.

# Competing interests

The authors declare that they have no competing interests.

# Author's contributions

Conceptualization: LF, DP, GR, SV; Data curation: SV, LF; Formal analysis and Methodology: DP, GR, LF, SV; Writing: SV, LF, DP, GR.

# Acknowledgements

Daniela Paolotti and Salvatore Vilella acknowledge support from the Lagrange Project of the Institute for Scientific Interchange Foundation (ISI Foundation) funded by Fondazione Cassa di Risparmio di Torino (Fondazione CRT). LF acknowledges financial support from Movistar - Telefónica Chile, the Chilean government initiative CORFO 13CEE2-21592 (2013-21592-1-INNOVA\_ PRODUCCION2013-21592-1), Conicyt PAI Networks (REDES170151) "Geo - Temporal factors in disease spreading and prevention in Chile", and Project PLU180009, Tenth "Fondo de Estudios sobre el Pluralismo en el Sistema Informativo Nacional", 2018, " Geo-Temporal Access to Chilean news outlets using digitales traces".

# Data availability

2017 Chilean Census data is available at <https://www.censo2017.cl>. DPI dataset was provided by the mobile telecommunication company, and therefore is not publicly available. However, if any researcher would like to access/work on the data, the telco's offices are open to collaboration through the authors of this paper. Please send an email to `email@example.com`.

[^1]: Released by the *Instituto Naciónal de Estadística (INE) See <https://www.censo2017.cl>*

[^2]: <https://bit.ly/2Ukpbyl>