bayesian extension to the language model for ad hoc information retrieval
We propose a Bayesian extension to the ad-hoc Language Model. Many smoothed estimators used for the multinomial query model in ad-hoc Language Models (including Laplace and Bayes-smoothing) are approximations to the Bayesian predictive distribution. In this paper we derive the full predictive distribution in a form amenable to implementation by classical IR models, and then compare it to other currently used estimators. In our experiments the proposed model outperforms Bayes-smoothing, and its combination with linear interpolation smoothing outperforms all other estimators.
extensibility language model model information retrieval ad-hoc smooth query predict distributed paper implementation experience combinational interpolation bayesian language model ad hoc retrieval ad hoc language model