ベルヌーイ試行
Consider the Bernoulli trial of tossing a fair coin formula_4. The probabilities of the events of the coin landing as heads formula_36 and tails formula_37 (see fair coin and obverse and reverse) are one half each, formula_38. Upon measuring the variable as heads, the associated information gain isformula_39so the information gain of a fair coin landing as heads is 1 shannon. Likewise, the information gain of measuring formula_37 tails isformula_41