Explore Books on
markov chains

Hidden Markov models for time series

By W. Zucchini,Iain L. MacDonald,Walter Zucchini

Gaussian Markov random fields

By Havard Rue,Leonhard Held

Markov Decision Processes

By Martin L. Puterman

Constrained Markov decision processes

By Eitan Altman

Bioinformatics

By Pierre Baldi

Stochastic Relations

By Ernst-Erich Doberkat

Hidden Markov Models

By João Paulo Coelho,Tatiana M. Pinho,José Boaventura-Cunha

Markov Processes

By James R. Kirkwood

Diskretnye t︠s︡epi Markova

By Vsevolod Ivanovich Romanovskiĭ

Economic Growth and Convergence

By Michał Bernardelli,Mariusz Próchniak,Bartosz Witkowski

Analytical Methods for Kolmogorov Equations

By Luca Lorenzi

Denumerable Markov chains

By John G. Kemeny

Formal Phonology

By András Kornai

Likelihood, Bayesian and MCMC methods in quantitative genetics

By Daniel Sorensen

On the multilevel solution algorithm for Markov chains

By Graham Horton

Discrete-time Markovian stochastic Petri nets

By Gianfranco Ciardo

Analytical methods for Markov semigroups

By Luca Lorenzi

Martingales and Markov chains

By Paolo Baldi,Laurent Mazliak,Pierre Priouret

Bioinformatics

By Kal Renganathan Sharma

Automated parallelization of discrete state-space generation

By David M. Nicol

Reliability modeling of structured systems

By Arun K. Somani

Semi-Markov chains and hidden semi-Markov models toward applications

By Vlad Stefan Barbu

Markov chains with stationary transition probabilities

By Kai Lai Chung

The passage problem for a stationary Markov chain

By Johannes Henricus Bernardus Kemperman