J. Laurie Snell - Böcker

Denumerable Markov Chains

with a chapter of Markov Random Fields by David Griffeath

Finite Markov Chains

With a New Appendix "Generalization of a Fundamental Matrix"

Probability Tales

Introduction to Probability

Denumerable Markov Chains

with a chapter of Markov Random Fields by David Griffeath

Grinstead and Snell's Introduction to Probability