信息论
In the field of Information theory Shannon entropy is defined to quantify the complexity of a distribution "p" as formula_1. Therefore, higher entropy means "p" is more complex hence more unpredictable.