This paper uses an information theoretic framework to analyze probability extremization