Gibbs' Inequality
The relative entropy or kl divergence between two probability
distributions
Gibbs Inequality states that:
for any
The relative entropy or kl divergence between two probability
distributions
Gibbs Inequality states that:
for any