Kac's lemma

For an irreducible positive recurrent Markov chain with stationary distribution $\pi$, the expected return time to state $i$ is $1/{\pi }_i$. More generally, expected occupation rewards in a return cycle equal their stationary rate times the expected cycle length.