OurBigBook.comSite Source code

Information entropy ( $H (X)$ )

For a discrete random variable with probabilities

p_{i}

, its Shannon information entropy is

H = - \sum_{i} p_{i} lo g p_{i} .

Table of contents 23 1
- Binary entropy Information entropy 6

 Ancestors (5)

 Incoming links (4)

 Synonyms (1)

Shannon entropy