Density Estimation Through Convex Combinations of Densities: Approximation and Estimation Bounds
We consider the problem of estimating a density function from a sequence identically distributed observationsxitaking value in X ? d. The estimation procedure constructs a convex mixture of basis densities and estimates the parameters using the maximum likelihood method. Viewing the error as a combination of two terms, the approximation error measuring the adequacy of the model, and the estimation error resulting from the finiteness of the sample size, we derive upper bounds to the expected total error, thus obtaining bounds for the rate of convergence. These results then allow us to derive explicit expressions relating the sample complexity and model complexity. Copyright  1996 Elsevier Science Ltd.
density estimation maximum likelihood approximation error convergence rates mixture models