Explore Books on
markov processes

Hidden Markov models for time series

By W. Zucchini,Iain L. MacDonald,Walter Zucchini

The theory of stochastic processes

By David R. Cox,H.D. Miller

Machiavelli and Renaissance Italy

By J. R. Hale

Markov Decision Processes

By Martin L. Puterman

Approximate Iterative Algorithms

By Anthony Louis Almudevar

Markov decision processes in artificial intelligence

By Olivier Sigaud

Continuous semi-Markov processes

By Boris Harlamov

Handbook of hidden Markov models in bioinformatics

By Martin Gollery

Finite Markov chains

By John G. Kemeny

Constrained Markov decision processes

By Eitan Altman

Hidden Markov Models

By João Paulo Coelho,Tatiana M. Pinho,José Boaventura-Cunha

Bioinformatics

By Pierre Baldi

Self-Learning Control of Finite Markov Chains

By A. S. Poznyak,Kaddour Najim,E. Gomez-Ramirez

Queueing networks and Markov chains

By Gunter Bolch,Stefan Greiner,Hermann de Meer,Kishor Shridharbhai Trivedi,Kishor S. Trivedi

Elements of Random Walk and Diffusion Processes

By Oliver C. Ibe

Entropy of hidden Markov processes and connections to dynamical systems

By Brian Marcus,Karl Endel Petersen,Tsachy Weissman

Topics in symbolic dynamics and applications

By A. Nogueira

Markov Processes

By James R. Kirkwood

Stochastic Relations

By Ernst-Erich Doberkat

Bayesian Models for Categorical Data

By Peter Congdon

Markov Chains and Decision Processes for Engineers and Managers

By Theodore J. Sheskin

Economic Growth and Convergence

By Michał Bernardelli,Mariusz Próchniak,Bartosz Witkowski

Analytical Methods for Kolmogorov Equations

By Luca Lorenzi

Markov Random Flights

By Alexander D. Kolesnik