Information theory
Information theory can be a basis for metrics.