Explore Books on
markov chains

Hidden Markov models for time series

By W. Zucchini,Iain L. MacDonald,Walter Zucchini

Gaussian Markov random fields

By Havard Rue,Leonhard Held

Markov Decision Processes

By Martin L. Puterman

Constrained Markov decision processes

By Eitan Altman

Hidden Markov Models

By João Paulo Coelho,Tatiana M. Pinho,José Boaventura-Cunha

Bioinformatics

By Pierre Baldi

Markov Processes

By James R. Kirkwood

Stochastic Relations

By Ernst-Erich Doberkat

Economic Growth and Convergence

By Michał Bernardelli,Mariusz Próchniak,Bartosz Witkowski

Analytical Methods for Kolmogorov Equations

By Luca Lorenzi

Diskretnye t︠s︡epi Markova

By Vsevolod Ivanovich Romanovskiĭ

Formal Phonology

By András Kornai

Denumerable Markov chains

By John G. Kemeny

Martingales and Markov chains

By Paolo Baldi,Laurent Mazliak,Pierre Priouret

Analytical methods for Markov semigroups

By Luca Lorenzi

Discrete-time Markovian stochastic Petri nets

By Gianfranco Ciardo

Likelihood, Bayesian and MCMC methods in quantitative genetics

By Daniel Sorensen

On the multilevel solution algorithm for Markov chains

By Graham Horton

Semi-Markov chains and hidden semi-Markov models toward applications

By Vlad Stefan Barbu

Reliability modeling of structured systems

By Arun K. Somani

Bioinformatics

By Kal Renganathan Sharma

Markov chains with stationary transition probabilities

By Kai Lai Chung

Automated parallelization of discrete state-space generation

By David M. Nicol

Processus stochastiques, leurs graphes, leurs usages

By Philippe Chrétienne