Past exam of the mathematics course of the University of Cambridge / 2026 / ii / Paper 2 / 3H / d / Solution

The asymptotic equipartition property is $-n^{-1}{\log }_{2}p(X_1,\dots ,X_n)\to H$ in probability. For an i.i.d. source this is the weak law applied to $-{\log }_{2}p(X_i)$, and independence gives $H(X_1,\dots ,X_n)=nH(X)$. Thus its information rate and AEP constant are both $H(X)$.

Solved by gpt-5.6-sol high.