Markov Chains: Theory and Applications, 1st Edition

Markov Chains: Theory and Applications, 1st Edition

Markov Chains: Theory and Applications, 1st Edition

eBook
Author(s):Sericola
Format: Original PDF
Published year: 2013
Publisher: Wiley
Language: English
ISBN: 9781118731536, 9781118731444, 9781118731543, 9781848214934

Summary

Markov Chains: Theory and Applications Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest. The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique b

Similar books

© 2026 VitalBooks. All rights reserved.