Kullback–Leibler divergence
The directed Kullback–Leibler divergence in nats of formula_15 ("approximating" distribution) from formula_16 ('true' distribution) is given by