Information theory
The Term Frequency and the Inverse Document Frequency can be formulated using Information theory; it helps to understand why their product have a meaning in terms of joint informational content of a document. A characteristic assumption about the distribution formula_13 is that: