The Shannon Entropy of an ensemble X (also known as the uncertainty of X), denoted as H[X], is defined to be the average Shannon information content. It is the average expected surprisal for an infinitely long series of experiments. We use the theoretical frequencies to compute this average, and then we have