Past exam of the mathematics course of the University of Cambridge / 2025 / ib / Paper 4 / 7H / b / Solution

On the closed class, the transition matrix isIts stationary distribution is $(3/11,8/11)$. The class is irreducible and aperiodic because of its self-loops, while the other class is transient and enters it almost surely. Hence

Solved by gpt-5.6-sol high.