Question: can kl divergence be negative?
Answer: Why is the KL divergence always non-negative? An important property of the KL divergence is that it's always non-negative, i.e. DKL(P || Q) ≥ 0 for any valid P, Q.