# Nonparametric Estimation of ATE and QTE: An Application of Fractile Graphical Analysis

Authors: Gabriel V. Montes-Rojas
Journal: Journal of Probability and Statistics
 (2011)

---

## Abstract

Nonparametric estimators for average and quantile treatment effects are constructed using Fractile Graphical Analysis, under the identifying assumption that selection to treatment is based on observable
characteristics. The proposed method has two steps: first, the propensity score is estimated, and, second, a blocking estimation procedure using this estimate is used to compute treatment effects. In both cases, the estimators are proved to be consistent. Monte Carlo results show a better performance than other procedures based on the propensity score. Finally, these estimators are applied to a job training dataset.


---

## Body

## 1. Introduction

Econometric methods for estimating the effects of certain programs (such as job search assistance or classroom teaching programs) has been widely developed since the pioneering work of Ashenfelter [1], LaLonde [2], and others. In this case, a treatment refers to a certain program whose benefits are potentially obtainable by those selected for participation (treated), and it has no effect on a control group (nontreated).Estimating average treatment effects (ATEs), which refers to the mean effect of the program on a given outcome variable in parametric and nonparametric environments (see [3, 4]), has been a central issue in the literature. Lehmann [5] and Doksum [6] introduced the concept of quantile treatment effects (QTEs) as the difference of the quantiles of the treated and control outcome distributions. In this case, it is implicitly assumed that individuals have an intrinsic heterogeneity which cannot be controlled for using observables. Bitler et al. [7] discuss the costs of focusing on average treatment estimation instead of other statistics.Provided that in nonexperimental settings selection into treatment is not random, ordinary least squares (OLSs) and quantile regression techniques are inconsistent. As stated by Heckman and Navarro-Lozano [8], three different approaches were used to overcome this problem. First, the control function approach explicitly models the selection mechanism and its relation to the outcome equation; second, instrumental variables; third, local estimation and aggregation. In the latter, under the unconfoundedness assumption, which states that conditional on a given set of exogenous covariates (observables) treatment occurrence is statistically independent of the potential outcomes, local unbiased estimates can be obtained by conditioning on this set of covariates. The identification strategies that we follow relies on this assumption. Rosenbaum and Rubin [9, 10] show that, adjusting solely for differences between treated and control units in a scalar function of the pretreatment covariates, the propensity score also removes the entire bias associated with differences in pre-treatment variables.Several estimation methods have been proposed for estimating ATE by conditioning on the propensity score.Matching estimators are widely used in empirical settings and in particular propensity score matching. In this case, each treated (nontreated) individual is matched to a nontreated (treated) individual (or aggregate of individuals) by means of their proximity in terms of the propensity score. Only in a few cases matching on more than one dimension has been used (see, e.g., [11]) because of the computational burden that multivariate matching requires. Moreover, Hirano et al.’s [12] method uses a series estimator of the propensity score to obtain efficient (in the sense of Hahn [13]) ATE estimators.Estimation of QTE has been developed using the minimization of convex check functions as in Koenker and Bassett [14]. Abadie et al. [15] and Chernozhukov and Hansen [16, 17] develop this methodology using instrumental variables. On the other hand, Firpo [18] does not require instrumental variables, and his methodology follows a two-step procedure: in the first stage, he estimates the propensity score using a series estimator, while, in the second, he uses a weighted quantile regression method. Bitler et al. [7] compute QTE using the empirical distribution function and derives an equivalent estimator. Diamond [19] uses matching to construct comparable treated and nontreated groups, and, then computes the difference between the matched sample quantiles.An alternative source of heterogeneity comes from the consideration of observables only. Treatment effects may vary depending on the amount of human capital or on the income and job status of their families. Differences in terms of these covariates determines that one may be interested in the conditional treatment effect that is conditional on some value of the observables. For instance, in terms of the propensity score, individuals are more likely to receive a treatment may have a different effect than those are less likely to receive it. As we show in this paper, how observables are treated determines differences in the parameter of interest for QTE but not for ATE. We define theaverage conditional quantile treatment effect as our parameter of interest, which can be described as the average of local QTEs. This parameter is equivalent to the standard unconditional QTE only in the case that the quantile treatment effect is constant.In many cases, one would be more interested in the dependence of the outcome variable on the fractiles (i.e., quantiles) of the covariates rather than the covariates themselves. Mahalanobis’s [20] fractile graphical analysis (FGA) methodology was developed to account for this heterogeneity in observables. This method has awaken recent interest in the literature as a nonparametric regression technique [21, 22].For our purposes, this methodology can be used as an alternative to matching, and it allows not only for estimating average but also quantile treatment effects. The idea is simple: divide the covariates space into fractiles, and obtain the conditional regression (or quantile) by a step function. Provided that the number of fractile groups increases with the number of observations, we obtain consistent estimates of these functions, as the local estimators would satisfy the unconfoundedness assumption (quoting Koenker and Hallock [23, page 147]:  “(...) segmenting the sample into subsets defined according to the conditioning covariates is always a valid option. Indeed, such local fitting underlies all nonparametric quantile regression approaches. In the most extreme cases, we have p distinct cells corresponding to different settings of the covariate vector, x, and quantile regression reduces simply to computing univariate quantiles for each of these cells.”)FGA can be viewed as a histogram-type smoother, and it shares the convergence rate of histograms as opposed to kernel-based methods that have a better performance. In the classification of Imbens [4], it can be associated with the “blocking on the propensity score” methods. An advantage of this procedure is that only the number of fractile groups needs to be chosen as a smoothing parameter.In spirit, this method is very similar to matching. The latter matches every treated individual to a control (nontreated) individual whose characteristics are similar. Then, using the unconfoundedness assumption, it integrates over the covariates as the matched sample is similar to the treated. FGA decomposes the covariates distribution into fractiles. Then within each fractile, treated and nontreated individuals are compared. Finally, it integrates over the covariates (in this case over the fractile groups) as matching does. However, this nonparametric technique allows us to recover the complete graph for the conditional expectation or quantiles. In the latter, we show that the graph contains more information than the comparison of treated and nontreated separately.The propensity score FGA estimators are compared to other estimators based on the propensity score. In particular we compare it to propensity score matching estimators and Hirano et al.’s [12] estimator for ATE and to Firpo’s [18] for QTE.The paper is organized as follows. Section2 describes the general framework and defines the parameters of interest. Section 3 reviews the literature on FGA. Section 4 derives ATE estimators, and Section 5 does it for QTE. Section 6 presents Monte Carlo evidence on the performance of these estimators, while Section 7 applies them to a well-known job training dataset. Conclusions appear in Section 8.


## 2. A General Setup for Nonrandom Experiments and Main Estimands

### 2.1. Unconditional Treatment Effects

To more formally characterize the model we follow the potential-outcome notation used in Imbens [4], which dates back to Fisher [24], Splawa-Neyman [25], and Rubin [26–28], and it is standard in the literature.ConsiderN individuals indexed by i=1,2,…,N who may receive a certain “treatment” (e.g., receiving job training), indicated by the binary variable Wi=0,1. Each individual has a pair of potential outcomes (Y1i,Y0i) that corresponds to the outcome with and without treatment, respectively. The fundamental problem, of course, is the inability to observe at the same time the same individual both with and without the treatment effect; that is, we only observe Yi=Wi×Y1i+(1-Wi)×Y0i and a set of exogenous variables Xi. We are interested in measuring the “effect” of the W-treatment (e.g., whether job training increases salaries or the chances of being employed).A parameter of interest is the average treatment effect, ATE,(2.1)δ=E[Y1-Y0]
which tells us whether, on average the W-treatment has an effect on the population.The key identification assumption is theunconfoundedness assumption(Rosenbaum and Rubin [9] called this strongly ignorable treatment assignment assumption, Heckman et al. [29] and Lechner [30, 31] conditional independence assumption) [9, 28], which states that conditional on the exogenous variables, the treatment indicator is independent of the potential outcomes. More formally, see the following assumption.Assumption 2.1 (unconfoundedness).
Consider(2.2)W⊥(Y1,Y0)∣X,
where ⊥ denotes statistical independence. Under this assumption we can identify the ATE (see, [4]) if both treated and nontreated have a common support, that is, comparable X-values
(2.3)δ=E[Y1-Y0]=EX[E[Y1-Y0∣X]]=EX[E[Y1∣X,W=1]]-EX[E[Y0∣X,W=0]]=EX[E[Y∣X,W=1]]-EX[E[Y∣X,W=0]].
In some cases, we are interested not only in the average effect but also in the effect on a subgroup of the population. Average treatment effects do not fully describe all the distributional features of theW-treatment. For instance, high-ability individuals may benefit differently from program participation than low-ability ones, even if they have the same value of covariates. This determines that the effect of a certain treatment would vary according to unobservable characteristics. A parameter of interest in the presence of heterogeneous treatment effects is the quantile treatment effect (QTE). As originally defined in the studies byDoksum [6] and Lehmann [5], the QTE corresponds, for any fixed percentile, to the horizontal distance between two cumulative distribution functions. Let F0 and F1 be the control and treated distribution of a certain outcome, and let Δ(y) denote the horizontal distance at y between F0 and F1, that is, F0(y)=F1(y+Δ(y)) or Δ(y)=F1-1(F0(y))-y. We can express this effect not in terms of y but on the quantiles of the same variable, and the QTE is then
(2.4)δτ=Δ(F0-1(τ))=F1-1(τ)-F0-1(τ)≡Qτj-Qτj,
where Qτj, j=0,1 are the quantiles of the treated and nontreated outcome distributions.
The key identification assumption here is therank invariance assumption (which is implied by the unconfoundedness assumption): in both treatment statuses, all individuals would mantain their rank in the distribution (see [29], for a general discussion about this assumption). Therefore, using a similar argument as in the ATE case, Firpo [18] shows that this assumption provides a way of identifying the QTE:
(2.5)τ=E[P[Y1≤Qτ1∣X]]=E[P[Y0≤Qτ0∣X]]=E[P[Y≤Qτ1∣X,W=1]]=E[P[Y≤Qτ0∣X,W=0]],
where the last two expectations can be estimated from the observable data.In both cases, Assumption2.1 suggests that, by constructing cells of homogenous values of X, we would be able to get an unbiased estimate of the treatment effect. However this becomes increasingly difficult and computationally impossible as the dimension of X increases. Rosenbaum and Rubin [9] argue that the unconfoundedness assumption can be restated in terms of the propensity score, p(X)≡P[W=1∣X=x], under the following assumption.Assumption 2.2 (common support).
For allx∈domain(X), we have that
(2.6)0<p̲≤p(x)≤p̅<1.In this case, we have the following lemma.Lemma 2.3.
Assumptions2.1 and 2.2 imply that
(2.7)W⊥(Y1,Y0)∣p(X).Proof.
See the work by Rosenbaum and Rubin [9].Therefore, the problem can be reduced to the dimension ofp(X). Through this paper we consider estimators based only on the propensity score.


### 2.2. Conditional Treatment Effects

LetYj(X)=E[Yi∣X] and Fj(·∣X), j=0,1 be the outcome distribution functions conditional on X, and let H(·) be the distribution function of X. Then the ATE can be defined as(2.8)∫[∫Y1(X)dH(X)]dF1(Y1)-∫[∫Y0(X)dH(X)]dF0(Y0)=∫[∫Y1(X)dF1(Y1∣X)-∫Y0(X)dF0(Y0∣X)]dH(X).Therefore, ATE can be obtained by comparing the unconditional mean outcome for the treated and nontreated or by obtaining first the conditional ATE and then integrating over the covariates space.Now define(2.9)Qτj(x)=Fj-1(τ∣X=x)≡inf⁡⁡{Yj:Fj(Yj∣X=x)≥τ},j=0,1,
as the conditional τth quantile. In general(2.10)EX[Qτj(X)]≠Qτj,j=0,1.In other words, the above equivalence cannot be applied to QTE: comparing the unconditional quantiles of the outcome distributions is not equivalent to computing the conditional quantiles and then aggregating. Chernozhukov and Hansen [16, 17] define the conditional quantile treatment effect (CQTE) as
(2.11)δτ(x)=Qτ1(x)-Qτ0(x).Define theaverage conditional quantile treatment effect (ACQTE) as(2.12)δ̅τ=EX[Qτ1(X)-Qτ0(X)].Strictly speaking, differences inQτ1(X)-Qτ0(X) can either be attributed to differences in the treatment effect or differences in the effect of the X's on the treated and nontreated. For instance, in a linear regression setup, we may have Qτj(X)=α(τ,X)j+β(τ,j)X, j=0,1. In the job training example, we may have that training increases salaries and returns to schooling, where years of schooling are X. However, in general, both parameters cannot be identified separately, and the literature often attributes to the treatment the whole conditional difference, that is, β(τ,j)=β(τ), j=0,1.In order to see these differences consider the following simple example with one outcome variable. LetX be a uniform random variable on (0,1), and let
(2.13)Y(X)={0withprob.0.50.5withprob.0.50.5withprob.0.51withprob.0.5ifX≤0.5,ifX>0.5.Here note thatE[Y]=E[EX[Y]] by the Law of Iterated Expectations. Let Qτ be the quantile of the Y distribution, and let Qτ(X) be the conditional quantile of Y conditional on X. In this case,
(2.14)Qτ={0ifτ<0.25,0.5if0.25≤τ<0.75,1ifτ≥0.75.
But,
(2.15)EX[Qτ(X)]={0.25ifτ<0.5,0.75ifτ≥0.5.This determines that recovering the complete graph{X,Qτj(X)}, j=0,1, provides additional information that cannot be recovered by computing unconditional quantiles. Firpo [18], Bitler et al. [7], and Diamond’s [19] estimators obtain unconditional quantiles because their estimators compute the difference between the treated and nontreated quantiles.If we addX to the model and the treatment effect is constant across X, then we have the following expression:(2.16)Qτ(X)=α(τ)+β(τ)1[X>0.5]=0.5+0.5×1[X>0.5],∀τ.However, in this case, we would be attributing no difference across quantiles. If we consider differences in the treatment effect acrossX(2.17)Qτ(X)=α(τ,X)={0ifτ<0.50.5ifτ≥0.50.5ifτ<0.51ifτ≥0.5ifX≤0.5,ifX>0.5.We assume thatYj(·), Qτj(·), j=0,1, can be expressed as a function of p. In particular, for QTE, we assume that the CQTE is of the form Qτ1(p)-Qτ0(p)=α(τ,p), and therefore the ACQTE becomes
(2.18)δ̅τ=Ep[Qτ1(p)-Qτ0(p)]=Ep[δτ(p)],
which is our parameter of interest.


## 2.1. Unconditional Treatment Effects

To more formally characterize the model we follow the potential-outcome notation used in Imbens [4], which dates back to Fisher [24], Splawa-Neyman [25], and Rubin [26–28], and it is standard in the literature.ConsiderN individuals indexed by i=1,2,…,N who may receive a certain “treatment” (e.g., receiving job training), indicated by the binary variable Wi=0,1. Each individual has a pair of potential outcomes (Y1i,Y0i) that corresponds to the outcome with and without treatment, respectively. The fundamental problem, of course, is the inability to observe at the same time the same individual both with and without the treatment effect; that is, we only observe Yi=Wi×Y1i+(1-Wi)×Y0i and a set of exogenous variables Xi. We are interested in measuring the “effect” of the W-treatment (e.g., whether job training increases salaries or the chances of being employed).A parameter of interest is the average treatment effect, ATE,(2.1)δ=E[Y1-Y0]
which tells us whether, on average the W-treatment has an effect on the population.The key identification assumption is theunconfoundedness assumption(Rosenbaum and Rubin [9] called this strongly ignorable treatment assignment assumption, Heckman et al. [29] and Lechner [30, 31] conditional independence assumption) [9, 28], which states that conditional on the exogenous variables, the treatment indicator is independent of the potential outcomes. More formally, see the following assumption.Assumption 2.1 (unconfoundedness).
Consider(2.2)W⊥(Y1,Y0)∣X,
where ⊥ denotes statistical independence. Under this assumption we can identify the ATE (see, [4]) if both treated and nontreated have a common support, that is, comparable X-values
(2.3)δ=E[Y1-Y0]=EX[E[Y1-Y0∣X]]=EX[E[Y1∣X,W=1]]-EX[E[Y0∣X,W=0]]=EX[E[Y∣X,W=1]]-EX[E[Y∣X,W=0]].
In some cases, we are interested not only in the average effect but also in the effect on a subgroup of the population. Average treatment effects do not fully describe all the distributional features of theW-treatment. For instance, high-ability individuals may benefit differently from program participation than low-ability ones, even if they have the same value of covariates. This determines that the effect of a certain treatment would vary according to unobservable characteristics. A parameter of interest in the presence of heterogeneous treatment effects is the quantile treatment effect (QTE). As originally defined in the studies byDoksum [6] and Lehmann [5], the QTE corresponds, for any fixed percentile, to the horizontal distance between two cumulative distribution functions. Let F0 and F1 be the control and treated distribution of a certain outcome, and let Δ(y) denote the horizontal distance at y between F0 and F1, that is, F0(y)=F1(y+Δ(y)) or Δ(y)=F1-1(F0(y))-y. We can express this effect not in terms of y but on the quantiles of the same variable, and the QTE is then
(2.4)δτ=Δ(F0-1(τ))=F1-1(τ)-F0-1(τ)≡Qτj-Qτj,
where Qτj, j=0,1 are the quantiles of the treated and nontreated outcome distributions.
The key identification assumption here is therank invariance assumption (which is implied by the unconfoundedness assumption): in both treatment statuses, all individuals would mantain their rank in the distribution (see [29], for a general discussion about this assumption). Therefore, using a similar argument as in the ATE case, Firpo [18] shows that this assumption provides a way of identifying the QTE:
(2.5)τ=E[P[Y1≤Qτ1∣X]]=E[P[Y0≤Qτ0∣X]]=E[P[Y≤Qτ1∣X,W=1]]=E[P[Y≤Qτ0∣X,W=0]],
where the last two expectations can be estimated from the observable data.In both cases, Assumption2.1 suggests that, by constructing cells of homogenous values of X, we would be able to get an unbiased estimate of the treatment effect. However this becomes increasingly difficult and computationally impossible as the dimension of X increases. Rosenbaum and Rubin [9] argue that the unconfoundedness assumption can be restated in terms of the propensity score, p(X)≡P[W=1∣X=x], under the following assumption.Assumption 2.2 (common support).
For allx∈domain(X), we have that
(2.6)0<p̲≤p(x)≤p̅<1.In this case, we have the following lemma.Lemma 2.3.
Assumptions2.1 and 2.2 imply that
(2.7)W⊥(Y1,Y0)∣p(X).Proof.
See the work by Rosenbaum and Rubin [9].Therefore, the problem can be reduced to the dimension ofp(X). Through this paper we consider estimators based only on the propensity score.


## 2.2. Conditional Treatment Effects

LetYj(X)=E[Yi∣X] and Fj(·∣X), j=0,1 be the outcome distribution functions conditional on X, and let H(·) be the distribution function of X. Then the ATE can be defined as(2.8)∫[∫Y1(X)dH(X)]dF1(Y1)-∫[∫Y0(X)dH(X)]dF0(Y0)=∫[∫Y1(X)dF1(Y1∣X)-∫Y0(X)dF0(Y0∣X)]dH(X).Therefore, ATE can be obtained by comparing the unconditional mean outcome for the treated and nontreated or by obtaining first the conditional ATE and then integrating over the covariates space.Now define(2.9)Qτj(x)=Fj-1(τ∣X=x)≡inf⁡⁡{Yj:Fj(Yj∣X=x)≥τ},j=0,1,
as the conditional τth quantile. In general(2.10)EX[Qτj(X)]≠Qτj,j=0,1.In other words, the above equivalence cannot be applied to QTE: comparing the unconditional quantiles of the outcome distributions is not equivalent to computing the conditional quantiles and then aggregating. Chernozhukov and Hansen [16, 17] define the conditional quantile treatment effect (CQTE) as
(2.11)δτ(x)=Qτ1(x)-Qτ0(x).Define theaverage conditional quantile treatment effect (ACQTE) as(2.12)δ̅τ=EX[Qτ1(X)-Qτ0(X)].Strictly speaking, differences inQτ1(X)-Qτ0(X) can either be attributed to differences in the treatment effect or differences in the effect of the X's on the treated and nontreated. For instance, in a linear regression setup, we may have Qτj(X)=α(τ,X)j+β(τ,j)X, j=0,1. In the job training example, we may have that training increases salaries and returns to schooling, where years of schooling are X. However, in general, both parameters cannot be identified separately, and the literature often attributes to the treatment the whole conditional difference, that is, β(τ,j)=β(τ), j=0,1.In order to see these differences consider the following simple example with one outcome variable. LetX be a uniform random variable on (0,1), and let
(2.13)Y(X)={0withprob.0.50.5withprob.0.50.5withprob.0.51withprob.0.5ifX≤0.5,ifX>0.5.Here note thatE[Y]=E[EX[Y]] by the Law of Iterated Expectations. Let Qτ be the quantile of the Y distribution, and let Qτ(X) be the conditional quantile of Y conditional on X. In this case,
(2.14)Qτ={0ifτ<0.25,0.5if0.25≤τ<0.75,1ifτ≥0.75.
But,
(2.15)EX[Qτ(X)]={0.25ifτ<0.5,0.75ifτ≥0.5.This determines that recovering the complete graph{X,Qτj(X)}, j=0,1, provides additional information that cannot be recovered by computing unconditional quantiles. Firpo [18], Bitler et al. [7], and Diamond’s [19] estimators obtain unconditional quantiles because their estimators compute the difference between the treated and nontreated quantiles.If we addX to the model and the treatment effect is constant across X, then we have the following expression:(2.16)Qτ(X)=α(τ)+β(τ)1[X>0.5]=0.5+0.5×1[X>0.5],∀τ.However, in this case, we would be attributing no difference across quantiles. If we consider differences in the treatment effect acrossX(2.17)Qτ(X)=α(τ,X)={0ifτ<0.50.5ifτ≥0.50.5ifτ<0.51ifτ≥0.5ifX≤0.5,ifX>0.5.We assume thatYj(·), Qτj(·), j=0,1, can be expressed as a function of p. In particular, for QTE, we assume that the CQTE is of the form Qτ1(p)-Qτ0(p)=α(τ,p), and therefore the ACQTE becomes
(2.18)δ̅τ=Ep[Qτ1(p)-Qτ0(p)]=Ep[δτ(p)],
which is our parameter of interest.


## 3. Fractile Graphical Analysis

Fractile graphical analysis (FGA) is a nonparametric estimation method developed first by Mahalanobis [20] based on conditioning on the fractiles of the X's. It was specifically designed to compare two populations, where the X variable was influenced by inflation and therefore not directly comparable. It has the same properties as other histogram-type estimators [32]. Moreover, Bhattacharya [33] developed a conditional quantile estimation method based on FGA. Our proposal is to use FGA to develop estimators for both ATE and QTE. FGA produces a histogram-type smoother by blocking on the fractiles (i.e., quantiles) of the propensity score.FGA was originally developed for one covariate (i.e.,dim(X)=1), but Bhattacharya [33] and others showed that it can be extended to more covariates. However, we will only consider FGA based on a single covariate, the propensity score. One-dimensional FGA allows us to recover the graphs {p,γ(p)}, where γ is any function of the propensity score.Assume first that the propensity score is known and it has a distribution functionH(p). Further, assume that H(·) is continuous and strictly increasing, and p satisfies Assumption 2.2. Construct R fractile groups (indexed by r) on the propensity score:
(3.1)Ipr={p∈[p̲,p̅]:ξ(r-1)/R<p≤ξr/R,ξ(r-1)/R=H-1(r-1R),ξr/R=H-1(rR)},r=1,2,…,R,
where H-1(τ)=inf{p:H(p)≥τ}.Each fractile group contains a similar number of observations (i.e., aboutN/R), and it has an associated interval on the domain of p defined by the order statistics (ξ(r-1)/R,ξr/R], such that P[p∈(ξ(r-1)/R,ξr/R]]≃1/R. As the number of fractiles increases, the divergence in terms of p for all observations within the same fractile group becomes smaller, and therefore we would be gradually constructing groups with the same p-characteristics. In that case, estimates within each fractile group asymptotically satisfy the unconfoundedness assumption, provided that the conditioning set converges to a single propensity score value.The following lines provide a short review of the asymptotic properties of FGA, which can be found in the studies by Bhattacharya and Müller [32] and Bera and Gosh [21]. Let g(p)=E[Y∣P=p] and σ2(p)=VAR[Y∣P=p] be the conditional expectation and variance in terms of the propensity score, and consider the following notation: h(t)=g∘H-1(t) and k(t)=σ2∘H-1(t) for t=(r-1+α)/R with 0≤α≤1. Suppose that h(·) has bounded second derivative and k(·) has bounded first derivative. Then, as N→∞ and R→∞ so that R/N→0 for fixed t, the bias and the variance of an FGA estimator of h(t), ĥ(t) become
(3.2)BIAS:E[ĥ(t)-h(t)]=-(2R)-1h′(t)[1+o(1)]=O(1R),VARIANCE:VAR[ĥ(t)]=(RN)[(1-α)2+α2]k(t)[1+o(1)]=O(RN),
so that the mean-squared error of ĥ is
(3.3)MSE:MSE[ĥ(t)]=[(4R2)2(h′(t))+(RN){(1-α)2+α2}k(t)][1+o(1)],
where 0≤α=Rt-[Rt]<1. Therefore, the best rate of convergence of fractile graphs is obtained by letting R=O(N1/3), which yields a rate of O(N-2/3) for the Integrated MSE.Ifp is not known, then it has to be estimated. In practice any estimate p̂=p+op(1) removes the bias. However, they will differ in the variance of the estimator, provided that the first stage (i.e., the estimation of the propensity score) needs to be taken into account. Hahn [13] shows that, by using the estimated propensity score, instead of the true propensity score, efficiency is achieved. Hirano et al. [12] and Firpo [18] use a semiparametric series estimator of the propensity score which produces this result.We impose the following assumption regarding the use of the estimated propensity score.Assumption 3.1 (convergence of propensity score fractile groups).
Letp̂ be an estimator of the propensity score. Then, for fixed R and for all r,
(3.4)lim⁡N→∞P[Ipr=Ip̂r]=1.


## 4. ATE Estimators

FGA ATE estimators are based on imputing the unobserved outcome in each fractile group. Let(4.1)Ŷ1i={YiifWi=1,Y̌1iifWi=0,
where Y̌1i=∑k=1NWkYk1[p̂k∈ℑp̂ri]/∑k=1NWk1[p̂k∈ℑp̂ri],(4.2)Ŷ0i={YiifWi=0,Y̌0iifWi=1,
where Y̌0i=∑k=1N(1-Wk)Yk1[p̂k∈ℑp̂ri]/∑k=1N(1-Wk)1[p̂k∈ℑp̂ri].Therefore, the FGA ATE estimator is(4.3)δ̂=1N∑i=1NŶ1i-Ŷ0i=1N∑i=1NY̌1i-Y̌0i.Similarly, it can be expressed as(4.4)δ̂=1R∑r=1Rδ̂(r),
where
(4.5)δ̂(r)=∑i=1NWiYi1[p̂i∈Ip̂r]∑i=1NWi1[p̂i∈Ip̂r]-∑i=1N(1-Wi)Yi1[p̂i∈Ip̂r]∑i=1N(1-Wi)1[p̂i∈Ip̂r].The logic of this estimator is based on that of Hahn [13] “nonparametric imputation.” In this case, within each fractile group, E[WY∣ℑpr], E[(1-W)Y∣ℑpr], and E[W∣ℑpr] are estimated nonparametrically using the previously estimated propensity score (p̂).Alternatively we construct a similar estimator using the weighting technique described in the study by Hirano et al. [12]. Let
(4.6)Ỹ1i={YiifWi=1,Y̆1iifWi=0,
where Y̆1i=∑k=1N(WkYk/p̂k)1[p̂k∈ℑp̂ri],(4.7)Ỹ0i={YiifWi=0,Y̆0iifWi=1,
where Y̆0i=∑k=1N((1-Wk)Yk/(1-p̂k))1[p̂k∈ℑp̂ri].Then(4.8)δ̃=1R∑r=1Rδ̃(r),
where
(4.9)δ̃(r)=RN∑i=1NWip̂iYi1[p̂i∈Ip̂r]-RN∑i=1N1-Wi1-p̂iYi1[p̂i∈Ip̂r].This estimator suffers from the same problems of Hirano et al.’s [12] estimator; that is, the presence of occasional high/low values of the propensity score produces a very bad empirical performance.The following theorem shows that the FGA ATE estimators are consistent. The intuition behind the proof is that, asN increases, and R does it but at a smaller rate, each fractile group will have individuals with similar propensity score values. In the limit, the differences among them is negligible, and therefore the unconfoundedness assumption can be applied. In this case, the local (i.e., for a given propensity score value) ATE can be obtained by constructing the difference of the average treated and control individuals with that propensity score value.Theorem 4.1 (consistency of ATE estimator).
Consider Assumptions2.1, 2.2, and 3.1, and assume that  (1)
the distribution functions ofp and (Y1,Y0)∣p are continuous and strictly increasing.(2)
E[Y12]<∞, E[Y02]<∞.
Then,δ̂→Pδ and δ̃→Pδ as N,R→∞, R/N→0.Proof.
See AppendixA.1.


## 5. QTE Estimators

Define the within fractile conditional quantiles:(5.1)Q̂τ1(r)=argminq∑i=1N1[p̂i∈Ip̂r]Wi(Yi-q)(τ-1[Yi≤q])∑i=1N1[p̂i∈Ip̂r]Wi,Q̂τ0(r)=argminq∑i=1N1[p̂i∈Ip̂r](1-Wi)(Yi-q)(τ-1[Yi≤q])∑i=1N1[p̂i∈Ip̂r](1-Wi).Therefore, the QTE estimator is(5.2)δ̂τ=1R∑r=1Rδ̂τ(r)=1R∑r=1RQ̂τ1(r)-Q̂τ0(r).Similarly we define(5.3)Q̃τ1(r)=argminq∑i=1N1p̂i1[p̂i∈Ip̂r]Wi(Yi-q)(τ-1[Yi≤q]),Q̃τ0(r)=argminq∑i=1N11-p̂i1[p̂i∈Ip̂r](1-Wi)(Yi-q)(τ-1[Yi≤q]),δ̃τ=1R∑r=1Rδ̃τ(r)=1R∑r=1RQ̃τ1(r)-Q̃τ0(r).The following theorem proves the consistency of both QTE estimators.Theorem 5.1 (consistency of QTE estimator).
Consider Assumptions2.1, 2.2, and 3.1, and assume that, the distribution function of p is continuous and strictly increasing. The distribution function of (Y1,Y0)∣p is continuous, strictly increasing, and continuously differentiable.
Then, forτ∈(0,1), δ̂τ→Pδτ, and δ̃τ→Pδτ as N,R→∞, R/N→0.Proof.
See AppendixA.2.


## 6. Monte Carlo Experiments

We evaluate the performance of the proposed estimators with respect to other estimators based on the propensity score. We compute propensity score matching estimators using nearest-neighbor procedures (with 1, 2, and 4 matches per observation), kernel and spline estimates. These estimators were designed by Barbara Sianesi for STATA 9.1, and they are available in the psmatch2 package. Additionally we compute Hirano et al. [12] semiparametric efficient estimator. In the case of QTE we compute Firpo [18] and Bitler et al. [7] estimators. We also compute QTE matching estimators following Diamond [19]. In this case, for each observation, the matching procedure constructs the corresponding matched pair (i.e., imputes the “closest” observation with the opposite treatment status). Then, we compute the unconditional quantiles of the imputed treated and nontreated distributions. A succinct description of some estimators appears in Appendix B.Our baseline model is(6.1)X1,X2,X3,u,e~N(0,1),W=1[X1-X2+X3+e>0],Y1=δ+X1+X2+u,Y0=X1+X2+X3+u.In this simple model QTEs are equal to ATE for all quantiles. We setδ=2. We generate 1000 replications of the baseline models for sample sizes in {100,200,500,1000,2000}, and we compute mean square error (MSE) and mean absolute error (MAE). Table 1 reports ATE estimators, while Table 2 shows QTE estimators for τ in {.10,.25,.50,.75,.90}. For FGA the number of fractile groups is R=[N1/3] which minimizes the integrated MSE (see, [32]), and we also consider doubling the number of fractile groups (i.e., R×2). We consider the two FGA estimators discussed above, that is, δ̂ and δ̃.Table 1
ATE Monte Carlo simulations.
MSEMAEEstimator1002005001000200010020050010002000FGA ATE(a)0.2210.1570.0790.0570.0360.3720.3080.2210.1870.147FGA ATE (R×2)(a)0.1900.1090.0530.0370.0230.3460.2610.1850.1550.121FGA ATE(b)0.6860.6570.6300.6071.6990.4640.4560.3690.3430.336FGA ATE (R×2)(b)0.6460.6150.6120.5971.6830.4620.4500.3680.3410.335Hirano et al. [12]0.7320.6790.6440.6181.7100.4720.4600.3710.3440.337PS matchingNearest neighbor (1)0.4670.3310.2020.1450.0990.5400.4430.3580.2980.251Nearest neighbor (2)0.2900.1920.1260.0910.0630.4290.3470.2850.2380.198Nearest neighbor (4)0.1700.1240.0740.0570.0390.3290.2810.2170.1880.157Kernel0.2850.2260.1270.0740.0330.4180.3690.2830.2170.146Spline0.2330.1390.0580.0340.0210.3840.2970.1920.1490.117(a)δ̂τ, (b)δ̃τ. MSE: mean squared error. MAE: mean absolute error. Monte Carlo simulations based on 1000 replications of the baseline model.Table 2
QTE Monte Carlo simulations.
MSEMAEEstimator1002005001000200010020050010002000τ=0.10FGA QTE(a)0.9640.5850.3280.2470.1550.7910.6110.4610.4040.317FGA QTE (R×2)(a)0.8250.4330.2240.1780.1170.7130.5250.3790.3390.279FGA QTE(b)0.8630.4910.2430.1460.0900.8020.5930.4090.3120.241FGA QTE (R×2)(b)1.3340.8490.3910.2410.1461.0740.8470.5610.4330.339Firpo [18]0.8790.6330.4380.3320.3320.7330.6390.5250.4670.453Bitler et al. [7]0.8350.6280.4320.3320.3320.7330.6380.5240.4670.453PS MatchingNearest neighbor (1)0.7750.6490.4550.3410.3830.6970.6360.5320.4860.478Nearest neighbor (2)0.5510.4420.3150.2690.2360.6030.5550.4840.4620.444Nearest neighbor (4)0.5620.4290.3090.2850.2590.5910.5570.4920.4940.484Kernel0.7480.5660.4670.4010.3610.6910.6170.5800.5870.581Spline0.6260.5190.4000.3890.3670.6460.6220.5750.5930.591τ=0.25FGA QTE(a)0.5230.3330.1840.1330.0830.5850.4590.3360.2920.230FGA QTE (R×2)(a)0.4090.2460.1310.0880.0580.5070.3970.2910.2360.194FGA QTE(b)0.8660.5190.2700.1690.1160.8230.6310.4500.3520.290FGA QTE (R×2)(b)1.4000.8670.4620.2920.1951.1260.8740.6340.5030.410Firpo [18]0.7210.5270.3600.2680.2260.6410.5430.4360.3770.338Bitler et al. [7]0.6870.5270.3600.2680.2260.6350.5430.4360.3770.338PS MatchingNearest neighbor (1)0.9520.7570.4710.3090.2090.7310.6210.5170.4200.364Nearest neighbor (2)0.5630.3810.2870.1950.1470.5790.4720.4030.3390.306Nearest neighbor (4)0.3120.2040.1530.1100.0890.4380.3520.2960.2550.231Kernel0.5190.3900.2990.1750.1010.5530.4690.4000.3130.246Spline0.4910.2740.1540.1040.0950.5330.4060.3120.2760.278τ=0.50FGA QTE(a)0.3050.1910.1050.0720.0460.4410.3440.2590.2110.168FGA QTE (R×2)(a)0.2520.1430.0700.0490.0290.3940.3010.2120.1750.138FGA QTE(b)0.9410.6160.3490.2420.1690.8710.7030.5290.4350.367FGA QTE (R×2)(b)1.5410.9770.5670.3700.2701.1870.9400.7160.5760.496Firpo [18]0.6580.5400.3580.2490.2060.6060.5210.4010.3320.285Bitler et al. [7]0.6290.5400.3580.2490.2060.6030.5210.4010.3320.285PS MatchingNearest neighbor (1)1.2880.7480.4430.2710.1840.9210.6970.5340.4230.350Nearest neighbor (2)0.9930.6080.3590.2290.1520.8090.6240.4890.3900.317Nearest neighbor (4)0.6560.4650.2920.1940.1370.6540.5470.4420.3600.298Kernel0.3670.2500.1300.0840.0600.4760.3960.2920.2340.200Spline0.6480.3490.1810.1210.0930.6420.4760.3430.2850.235τ=0.75FGA QTE(a)0.3910.2560.1380.0920.0690.4970.4110.2950.2420.205FGA QTE (R×2)(a)0.3520.2180.1120.0710.0510.4660.3760.2670.2150.180FGA QTE(b)1.0430.7210.4520.3200.2500.9190.7680.6100.5150.461FGA QTE (R×2)(b)1.6351.0940.6750.4860.3681.2291.0010.7870.6700.585Firpo [18]0.6520.5610.3560.3460.2500.6150.5480.4200.3900.322Bitler et al. [7]0.6520.5610.3560.3460.2500.6150.5480.4200.3900.322PS MatchingNearest neighbor (1)1.4391.1380.7100.4920.3170.8880.8010.6240.5320.440Nearest neighbor (2)0.7680.6470.5090.3960.2570.6680.5990.5270.4640.387Nearest neighbor (4)0.4290.3740.3260.2930.2300.5070.4660.4160.3890.349Kernel0.4860.5760.4070.3280.2550.5340.5560.4840.4450.400Spline0.7130.5960.3420.2840.2580.6310.5780.4380.4120.408τ=0.90FGA QTE(a)0.7110.3980.2290.1670.1250.6660.5050.3850.3280.287FGA QTE (R×2)(a)0.7070.3330.1850.1420.1000.6710.4570.3450.3040.257FGA QTE(b)1.2180.8370.5600.4170.3450.9790.8240.6780.5880.544FGA QTE (R×2)(b)1.7711.1760.8090.5890.4731.2691.0290.8600.7360.664Firpo [18]0.7540.7170.4440.4620.3400.6510.6250.4790.4610.401Bitler et al. [7]0.7540.7170.4440.4620.3400.6510.6250.4790.4610.401PS MatchingNearest neighbor (1)0.8980.9300.6740.7890.6310.6990.6900.5660.5620.510Nearest neighbor (2)0.4240.3700.2310.2870.2410.5060.4490.3520.3380.310Nearest neighbor (4)0.3370.2040.1120.1220.1130.4560.3560.2490.2280.217Kernel0.6970.7080.5810.3940.1310.6130.5910.5040.3950.267Spline0.4320.2870.1050.0780.0580.5010.4110.2560.2280.209(a)δ̂τ, (b)δ̃τ. MSE: mean squared error. MAE: mean absolute error. Monte Carlo simulations based on 1000 replications of the baseline model.The FGA ATE estimator has reasonable good performance in terms of both MSE and MAE. In almost every case, doubling the number of fractile groups results in a better performance of theδ̂ estimator. However, the contrary occurs to the δ̃ estimator. FGA ATE δ̂(R×2) achieves the same values of the best matching estimators (using 4 neighbors and splines). Increasing the sample size reduces both MSE and MAE at similar rates in all estimators. Overall the Hirano et al. [12] and FGA ATE δ̃ estimators show extremely high values, mainly because a random draw may contain occasional values of the propensity score very close to the boundary (i.e., 0 or 1).FGA QTEδ̂ estimators outperform that of Firpo [18] for all sample sizes and quantiles. All the estimators show consistency, although FGA QTE reduces both MSE and MAE at higher rates than Firpo's estimator. As in the last paragraph, doubling the number of fractile groups improves the estimator performance, and FGA QTE δ̂ outperform δ̃. As expected, better estimates are found in the median case than in the extreme quantiles. Matching estimators show a relatively good performance. However, only in a few cases they outperform the FGA QTE estimator. In particular the spline matching estimator shows an outstanding performance for τ=0.9.Overall nonparametric FGA estimators, where the propensity score is reestimated nonparametrically (i.e.,δ̂), show the best performance.


## 7. Empirical Application

We apply the estimators proposed in the paper to a widely used job training dataset first analyzed by LaLonde [2], the “National Supported Work Program” (NSW). The same database was used in other applications such as those of Heckman and Hotz [34], Dehejia and Wahba [35, 36], Abadie and Imbens [11], and Firpo [18], among others.The program was designated as a random experiment for applicants who if selected would had received work experience (treatment) in a wide range of possible activities, like learning to operate a restaurant, a child care, or a construction work, for a period not exceeding twelve months. Eligible participants were targeted from recipients of AFDC, former addicts, former offenders, and young school dropouts. Candidates eligible for the NSW were randomized into the program between March 1975 and July 1977. The NSW data set consists of information on earnings and employment in 1978 (outcome variables), whether treated or not, information on earnings and employment in 1974 and 1975, and background characteristics such as education, ethnicity, marital status, and age. We use the database provided by Guido Imbens (http://www.economics.harvard.edu/faculty/imbens/software_imbens/), which consists of 455 individuals, 185 treated, and 260 control observations. This particular subset is the one constructed by Dehejia and Wahba [35] and described there in more detail.We will focus on the possible effect on participants' earnings in 1978 (if any); that is, we answer the following question: what is the effect of this particular training program on future earnings? Provided that earnings is a continuous variable, we would be able to apply quantile analysis. A main drawback of this variable is that those unemployed in 1978 report earnings of zero. In 1978, 92 control and 45 treated individuals were unemployed. The average (standard deviation) of earnings in 1978 is $5300 ($6631), which breaks into $6349 ($578) for treated and $4554 ($340) for control individuals. Without considering covariates, the difference between treated and nontreated is $1794 ($671), which in a two-samplet-test rejects the null hypothesis of equal values (t-stat 2.67, P value 0.0079). We also observe differences in terms of the percentiles in the earnings distribution. The 10th percentile for the treated (control) is $0 ($0); the 25th percentile $485 ($0); the median is $4232 ($3139); the 75th percentile $9643 ($7292); and the 90th percentile is $14582 ($11551). Therefore, assuming the rank invariance property discussed above, higher quantiles of the earnings distribution seems to be associated with larger treatment effects.The propensity score is estimated by a probit model, where the dependent variable is participation and the covariates used are the individual characteristics and employment and earnings in 1974 and 1975. Note that the propensity score is of no particular interest by itself, provided that participants were randomly selected in the experiment. In this case, no particular covariate is individually significant, and a likelihood ratio test of joint significance gets chi-squared(8)=8.30, P value = 0.4050.As we mention above, a common support in the propensity score domain is necessary to make meaningful comparisons among treated and nontreated individuals. The empirical relevance of this assumption was pointed out by Heckman et al. [37], and it was identified as one of the major sources of bias. In our case, this has special importance since consistent estimates of treatment effect requires that both the number of treated and control is eventually large enough to apply large sample theory. Moreover, if there are no treated (controls) in a given fractile group, no within fractile estimate can be obtained. We use two different trimming procedures. First, provided that we may assume that F1(p)≤F0(p), we only consider propensity score values in the range
(7.1)p̲*=min⁡p(pi,Wi=1)≤p≤max⁡p(pi,Wi=0)=p̅*.By doing this we drop 8 observations, and we refer to this sample as Trim 1. We also trim 2.5% in each tail of the propensity score distribution (Trim 2) dropping 23 observations.Table3 reports the propensity score estimates used in the Monte Carlo simulation, applied to LaLonde's data set. The first column contains the ATE estimate, while the second and third contain the average and standard deviation of a bootstrapping experiment with 1000 random samples with replacement of the original database. The last column calculates the ATE estimator for the two different trimming procedures discussed above. Table 4 estimates the QTE for the same quantiles analyzed in Table 2. The results confirm a positive average impact of training on earnings. FGA ATE estimators get $1572 and $1537, which are of the same magnitude as the kernel and spline propensity score matching estimates and the Hirano et al. [12] estimates. However, nearest-neighbor estimates are below these estimates by $100.Table 3
ATE estimators of the effect of training on earnings.
NontrimmedTrim 1Trim 2EstimatorCoef.AverageStd.errorCoef.AverageStd. errorCoef.AverageStd. errorFGA ATE(a)1572.21589.0634.01608.61620.2645.31480.91565.2665.8FGA ATE (R×2)(a)1537.11606.4659.01520.21634.4659.81208.61572.4682.3FGA ATE(b)1584.11561.9616.71672.51625.7637.01676.11536.1655.5FGA ATE (R×2)(b)1563.21511.4606.61604.51576.1627.31530.21483.4644.5Hirano et al. [12]1598.21612.2631.31731.31691.9661.01862.01589.1682.6PS matchingNearest neighbor (1)997.21393.8736.41101.61389.2721.3869.81334.4744.8Nearest neighbor (2)156.21471.6710.61262.01477.8702.8984.21424.2729.9Nearest neighbor (4)1471.81559.0670.01552.71571.7671.61346.51525.1700.4Kernel1629.01639.6631.11638.91636.3634.31482.41590.8657.3Spline1587.01616.6641.41614.41613.8638.81380.31565.6660.9(a)δ̂τ, (b)δ̃τ. Averages and standard errors are obtained using 1000 bootstrapping random samples with replacement of the original database.Table 4
QTE estimators of the effect of training on earnings.
NontrimmedTrim 1Trim 2EstimatorCoef.AverageStd. errorCoef.AverageStd. errorCoef.AverageStd. errorτ=0.10FGA QTE(a)0.0149.4188.20.0146.8190.90.0145.5183.0FGA QTE (R×2)(a)95.7382.5325.278.0371.3311.2101.9392.4340.2FGA QTE(b)0.0150.9190.50.0148.6190.90.0145.0185.2FGA QTE (R×2)(b)95.7369.7317.778.0364.6312.0240.1385.1335.9Firpo [18]0.00.00.00.00.00.00.00.00.0Bitler et al. [7]0.00.00.00.00.00.00.00.00.0PS matchingNearest neighbor (1)0.00.00.00.00.00.00.00.00.0Nearest neighbor (2)0.00.715.20.00.715.20.01.121.0Nearest neighbor (4)0.073.8184.50.069.7179.30.074.5188.7Kernel0.0292.5356.30.0281.0351.00.0298.9365.8Spline0.0295.3355.70.0278.5349.50.0291.2361.0τ=0.25FGA QTE409.6653.5480.2376.4686.1475.9623.2701.7502.8FGA QTE (R×2)628.8853.5546.4487.4864.3540.9836.9880.2547.8FGA QTE(b)414.2649.8488.0361.9685.8484.2500.9705.8511.8FGA QTE (R×2)(b)694.5843.3546.3363.1853.3554.6856.6872.1561.9Firpo [18]0.0295.8341.30.0291.3340.4289.8276.8343.2Bitler et al. [7]0.0295.8341.30.0291.3340.4289.8276.8343.2PS matchingNearest neighbor (1)0.0159.1290.80.0145.5278.60.0134.9273.8Nearest neighbor (2)1067.5804.7523.11254.6783.1527.81152.1763.5763.5Nearest neighbor (4)1568.01455.8738.61682.11454.2733.0803.41440.0748.0Kernel3068.72808.3986.13180.72864.5992.43074.42892.71036.1Spline2628.72363.81019.72708.22486.61023.52715.12470.71053.1τ=0.50FGA QTE1131.01379.9851.01321.21404.8870.51026.01376.2869.2FGA QTE (R×2)914.21466.4887.3965.51501.7866.6385.51488.7873.5FGA QTE(b)1193.91403.5871.61306.01432.7891.81066.31384.7883.4FGA QTE (R×2)(b)1078.81476.8939.7981.71509.1919.9262.51492.6916.5Firpo [18]1063.01178.5901.61254.91260.9938.1763.81257.8973.9Bitler et al. [7]1063.01178.5901.61254.91260.9938.1763.81257.8973.9PS matchingNearest neighbor (1)5.2910.51034.6368.5984.41042.577.5990.41066.2Nearest neighbor (2)388.11050.9859.9563.41093.0877.5284.41088.4898.4Nearest neighbor (4)695.51171.6810.5801.81210.6814.5616.71201.0842.8Kernel1567.11351.2752.21643.11365.3759.61587.81357.7783.7Spline846.61261.7776.91843.31259.1783.41578.11272.3811.9τ=0.75FGA QTE2110.91948.91180.71960.51986.91190.81710.11950.11233.8FGA QTE (R×2)1614.62162.81376.11640.02215.21369.5742.62131.11424.7FGA QTE(b)2240.91968.01191.91815.52010.41221.51706.41954.11264.7FGA QTE (R×2)(b)1351.32222.81447.21549.02253.01440.5789.22159.81449.7Firpo [18]2274.12060.9919.62258.02071.3942.12214.52034.2979.1Bitler et al. [7]2274.12060.9919.62258.02071.3942.12214.52034.2979.1PS matchingNearest neighbor (1)1537.01663.91111.71921.11699.61081.81263.01637.51116.7Nearest neighbor (2)585.51598.81106.4877.61640.81097.4393.71589.51115.2Nearest neighbor (4)1280.11634.11046.51243.81653.21047.71239.61595.41084.2Kernel1399.31735.3972.31399.51754.3971.51180.61710.6984.8Spline1381.61963.11088.71320.61954.41087.31108.51870.91101.3τ=0.90FGA QTE3093.83345.72315.23426.53401.92364.02789.13233.72459.3FGA QTE (R×2)3170.83301.22157.94126.53317.02174.24161.93118.02096.5FGA QTE(b)3093.83493.22421.23518.03512.32454.93189.53189.92442.7FGA QTE (R×2)(b)3142.13343.02221.14819.43351.22213.43998.63154.92133.0Firpo [18]2713.42854.31890.42150.62797.81889.22126.22715.51895.0Bitler et al. [7]2713.42854.31890.42150.62797.81889.22126.22715.51895.0PS matchingNearest neighbor (1)1861.22425.72150.11392.32372.72111.8444.72249.42130.0Nearest neighbor (2)1279.42388.41915.61278.02336.61900.445.42172.01892.5Nearest neighbor (4)2047.92180.91716.82153.72181.31743.92153.72030.91758.1Kernel175.0691.51389.5208.0770.61431.7327.6566.21415.4Spline571.5881.21520.4261.8899.41477.9327.6755.21458.8(a)δ̂τ, (b)δ̃τ. Averages and standard errors are obtained using 1000 bootstrapping random samples with replacement of the original database.QTE estimates show considerable variability across quantiles (see Table4). For the 10th quantile, estimates are not statistically different from zero. The median quantile is almost two-thirds of the ATE estimates, reflecting the presence of outliers in the sample or different distributional properties. Finally for the 90th quantile, the estimates produce up to a $3000 impact, twice the ATE. In other words, those who benefit more are those with a high level of unobservables. Unfortunately, all the estimators show high bootstrap standard errors.


## 8. Conclusion

FGA provides a simple methodology for constructing nonparametric estimators of average and quantile treatment effects, under the assumption of selection on observables. In this paper we develop estimators using the estimated propensity score and we prove its consistency. Moreover, FGA QTE estimators show a better performance than that of Firpo’s [18] QTE estimator, which constitutes the most relevant estimator in the literature using the propensity score.Similar estimators can be derived for FGA in more than one dimension (see for instance the discussion in [33]), although its computational burden is unknown. Moreover, more efficient estimators may be obtained by applying smoothing techniques within or between fractiles [22].



---

*Source: 874251-2011-10-16.xml*