Chapter 12.05: Cross-Entropy, KL and Source Coding

In this section, we introduce the cross-entropy and discuss the connection between entropy, cross-entropy, and Kullback-Leibler-divergence.

1Video Lecture

2Slides