OurBigBook.comSite Source code

Mutual information

The mutual information between discrete random variables is

I (X; Y) = H (Y) - H (Y ∣ X) = H (X) + H (Y) - H (X, Y) .

Table of contents 61 2
- Chain rule for mutual information Mutual information 10
- Incremental information in a twofold binary repetition code Mutual information 40

 Ancestors (5)

 Incoming links (1)

Solution