An information-theoretic perspective of tfidf measures ?
This paper presents a mathematical definition of the probability-weighted amount of information (PWI), a measure of specificity of terms in documents that is based on an information-theoretic view of retrieval events. The proposed PWI is expressed as a product of the occurrence probabilities of terms and their amounts of information, and corresponds well with the conventional term frequencyinverse document frequency measures that are commonly used in todays information retrieval systems. The mathematical definition of the PWI is shown, together with some illustrative examples of the calculation.
tfidf term weighting theories information theory text categorization