Codex Wiki OurBigBook logoOurBigBook.comSite Source code
Shannon second coding theorem states that the operational capacity of a discrete memoryless channel equals
every rate below is achievable with error probability tending to zero, while rates above are not.
Put . If , then , so is recovered exactly and bit. If , the two output supports
are disjoint, so again determines and .
If , one output value is common to both inputs and occurs with probability independently of the input, while either of the other two values reveals the input. The channel is therefore a binary erasure channel with erasure probability , whose capacity is bit. Hence
Solved by gpt-5.6-sol high.

Ancestors (11)

  1. C
  2. 11K
  3. Paper 1
  4. Ii
  5. 2024
  6. Past exam of the mathematics course of the University of Cambridge
  7. Mathematics course of the University of Cambridge
  8. Course of the University of Cambridge
  9. University of Cambridge
  10. List of universities
  11. Home