Markov Chains: Models, Algorithms and Applications [electronic resource] /
Ching, Wai-Ki.author.
Ng, Michael K.author.
Markov chains are a particularly powerful and widely used tool for analyzing a variety of stochastic (probabilistic) systems over time. This monograph will present a series of Markov models, starting from the basic models and then building up to higher-order models. Included in the higher-order discussions are multivariate models, higher-order multivariate models, and higher-order hidden models. In each case, the focus is on the important kinds of applications that can be made with the class of models being considered in the current chapter. Special attention is given to numerical algorithms that can efficiently solve the models. Therefore, Markov Chains: Models, Algorithms and Applications outlines recent developments of Markov chain models for modeling queueing sequences, Internet, re-manufacturing systems, reverse logistics, inventory systems, bio-informatics, DNA sequences, genetic networks, data mining, and many other practical systems.
Description based upon print version of record.
Includes bibliographical references and index.
Queueing Systems and the Web -- Re-manufacturing Systems -- Hidden Markov Model for Customers Classification -- Markov Decision Process for Customer Lifetime Value -- Higher-order Markov Chains -- Multivariate Markov Chains -- Hidden Markov Chains.
Markov chains are a particularly powerful and widely used tool for analyzing a variety of stochastic (probabilistic) systems over time. This monograph will present a series of Markov models, starting from the basic models and then building up to higher-order models. Included in the higher-order discussions are multivariate models, higher-order multivariate models, and higher-order hidden models. In each case, the focus is on the important kinds of applications that can be made with the class of models being considered in the current chapter. Special attention is given to numerical algorithms that can efficiently solve the models. Therefore, Markov Chains: Models, Algorithms and Applications outlines recent developments of Markov chain models for modeling queueing sequences, Internet, re-manufacturing systems, reverse logistics, inventory systems, bio-informatics, DNA sequences, genetic networks, data mining, and many other practical systems.
Probabilities.
Operations research.
Decision making.
Mathematical models.
Production management.
Mathematical statistics.
Computer science—Mathematics.
Probability Theory and Stochastic Processes.
Operations Research/Decision Theory.
Mathematical Modeling and Industrial Mathematics.
Operations Management.
Probability and Statistics in Computer Science.
Math Applications in Computer Science.
International series in management science/operations research