scholarly journals Randomized Difference Two-Timescale Simultaneous Perturbation Stochastic Approximation Algorithms for Simulation Optimization of Hidden Markov Models

2000 ◽  
Author(s):  
Shalabh Bhatnagar ◽  
Michael C. Fu ◽  
Steven I. Marcus ◽  
Shashank Bhatnagar
Keyword(s):  
Approximation Algorithms ◽  
Hidden Markov Models ◽  
Stochastic Approximation ◽  
Markov Models ◽  
Hidden Markov ◽  
Simulation Optimization ◽  
Simultaneous Perturbation Stochastic Approximation

Multiscale Stochastic Approximation for Parametric Optimization of Hidden Markov Models

1997 ◽  
Vol 11 (4) ◽  
pp. 509-522 ◽  
Author(s):  
Shalabh Bhatnagar ◽  
Vivek S. Borkar
Keyword(s):  
Approximation Algorithm ◽  
Hidden Markov Models ◽  
Stochastic Approximation ◽  
Parametric Optimization ◽  
Markov Models ◽  
Hidden Markov ◽  
Infinitesimal Perturbation Analysis ◽  
Simulation Based ◽  
Infinitesimal Perturbation ◽  
Traditional Approaches

A two–time scale stochastic approximation algorithm is proposed for simulation-based parametric optimization of hidden Markov models, as an alternative to the traditional approaches to “infinitesimal perturbation analysis.” Its convergence is analyzed, and a queueing example is presented.

Two-timescale algorithms for simulation optimization of hidden Markov models

2001 ◽  
Vol 33 (3) ◽  
pp. 245-258 ◽  
Author(s):  
SHALABH BHATNAGAR ◽  
MICHAEL C. FU ◽  
STEVEN I. MARCUS ◽  
SHASHANK BHATNAGAR
Keyword(s):  
Hidden Markov Models ◽  
Markov Models ◽  
Hidden Markov ◽  
Simulation Optimization

Estimating Personality Impression from Speech Record Using Hidden Markov Models

2015 ◽  
Vol 135 (12) ◽  
pp. 1517-1523 ◽  
Author(s):  
Yicheng Jin ◽  
Takuto Sakuma ◽  
Shohei Kato ◽  
Tsutomu Kunitachi
Keyword(s):  
Hidden Markov Models ◽  
Markov Models ◽  
Hidden Markov

Hidden Markov Processes

2014 ◽  
Author(s):  
M. Vidyasagar
Keyword(s):  
Hidden Markov Models ◽  
Markov Processes ◽  
Viterbi Algorithm ◽  
Markov Models ◽  
Hidden Markov ◽  
Local Alignment ◽  
Biological Applications ◽  
Standard Material ◽  
Hidden Markov Processes ◽  
Genomics And Proteomics

This book explores important aspects of Markov and hidden Markov processes and the applications of these ideas to various problems in computational biology. It starts from first principles, so that no previous knowledge of probability is necessary. However, the work is rigorous and mathematical, making it useful to engineers and mathematicians, even those not interested in biological applications. A range of exercises is provided, including drills to familiarize the reader with concepts and more advanced problems that require deep thinking about the theory. Biological applications are taken from post-genomic biology, especially genomics and proteomics. The topics examined include standard material such as the Perron–Frobenius theorem, transient and recurrent states, hitting probabilities and hitting times, maximum likelihood estimation, the Viterbi algorithm, and the Baum–Welch algorithm. The book contains discussions of extremely useful topics not usually seen at the basic level, such as ergodicity of Markov processes, Markov Chain Monte Carlo (MCMC), information theory, and large deviation theory for both i.i.d and Markov processes. It also presents state-of-the-art realization theory for hidden Markov models. Among biological applications, it offers an in-depth look at the BLAST (Basic Local Alignment Search Technique) algorithm, including a comprehensive explanation of the underlying theory. Other applications such as profile hidden Markov models are also explored.

Sign in / Sign up

Export Citation Format

Share Document