Question: why kl divergence is positive?
Answer: The KL divergence is non-negative if P≠Q, the KL divergence is positive because the entropy is the minimum average lossless encoding size.