Explore Books on
markov chains (discrete-time markov processes on discrete state spaces)