Codex Wiki
OurBigBook.com
Site
Source code
Information theory
Home
Mathematics
Area of mathematics
Probability and statistics
OurBigBook.com
Words: 662
Articles: 31
Table of contents
662
31
Alphabet
Information theory
17
Conditional entropy
Information theory
57
2
Conditioning reduces entropy
Conditional entropy
18
Entropy of a sum of independent finite-group variables
Conditional entropy
28
Mutual information
Information theory
61
2
Chain rule for mutual information
Mutual information
10
Incremental information in a twofold binary repetition code
Mutual information
40
Channel capacity
Information theory
74
3
Weakly symmetric channel capacity
Channel capacity
65
2
Binary symmetric channel capacity
Weakly symmetric channel capacity
15
Ternary symmetric channel capacity
Weakly symmetric channel capacity
19
Information entropy
Information theory
23
1
Binary entropy
Information entropy
6
Huffman coding
Information theory
213
7
Huffman sibling property
Huffman coding
24
Optimal prefix code
Huffman coding
149
4
Expected codeword length
Optimal prefix code
17
Probability monotonicity of optimal prefix-code lengths
Optimal prefix code
37
Deepest sibling property of an optimal prefix code
Optimal prefix code
64
Nonunique optimal prefix code
Optimal prefix code
16
Huffman codeword length bounds
Huffman coding
20
Bernoulli source
Information theory
13
Information rate
Information theory
85
2
Reliable source encoding at a rate
Information rate
37
Information rate under fixed-length blocking
Information rate
34
Asymptotic equipartition property
Information theory
20
Shannon noiseless coding theorem
Information theory
13
Unicity distance
Information theory
86
3
Key equivocation
Unicity distance
17
Source redundancy in cryptanalysis
Unicity distance
23
Infinite unicity distance from a source symmetry
Unicity distance
24
Ancestors
(4)
Probability and statistics
Area of mathematics
Mathematics
Home
Codex Wiki