Markov Models for Count Time Series

2016 ◽  
pp. 49-70
Keyword(s):  
Time Series ◽  
Markov Models ◽  
Count Time Series

Measuring absolute nanoparticle number concentrations from particle count time series

2013 ◽  
Vol 251 (1) ◽  
pp. 19-26 ◽  
Author(s):  
M. RÖDING ◽  
H. DESCHOUT ◽  
K. BRAECKMANS ◽  
M. RUDEMO
Keyword(s):  
Time Series ◽  
Count Time Series ◽  
Particle Count

Forecasting discrete valued low count time series

2004 ◽  
Vol 20 (3) ◽  
pp. 427-434 ◽  
Author(s):  
R.K. Freeland ◽  
B.P.M. McCabe
Keyword(s):  
Time Series ◽  
Count Time Series

NONLINEAR GATED EXPERTS FOR TIME SERIES: DISCOVERING REGIMES AND AVOIDING OVERFITTING

1995 ◽  
Vol 06 (04) ◽  
pp. 373-399 ◽  
Author(s):  
ANDREAS S. WEIGEND ◽  
MORGAN MANGEAS ◽  
ASHOK N. SRIVASTAVA
Keyword(s):  
Time Series ◽  
Real World ◽  
Markov Models ◽  
Multilayer Perceptrons ◽  
Time Step ◽  
Local Complexity ◽  
Previous State ◽  
Segmentation Task ◽  
Gating Network ◽  
Update Rules

In the analysis and prediction of real-world systems, two of the key problems are nonstationarity (often in the form of switching between regimes), and overfitting (particularly serious for noisy processes). This article addresses these problems using gated experts, consisting of a (nonlinear) gating network, and several (also nonlinear) competing experts. Each expert learns to predict the conditional mean, and each expert adapts its width to match the noise level in its regime. The gating network learns to predict the probability of each expert, given the input. This article focuses on the case where the gating network bases its decision on information from the inputs. This can be contrasted to hidden Markov models where the decision is based on the previous state(s) (i.e. on the output of the gating network at the previous time step), as well as to averaging over several predictors. In contrast, gated experts soft-partition the input space, only learning to model their region. This article discusses the underlying statistical assumptions, derives the weight update rules, and compares the performance of gated experts to standard methods on three time series: (1) a computer-generated series, obtained by randomly switching between two nonlinear processes; (2) a time series from the Santa Fe Time Series Competition (the light intensity of a laser in chaotic state); and (3) the daily electricity demand of France, a real-world multivariate problem with structure on several time scales. The main results are: (1) the gating network correctly discovers the different regimes of the process; (2) the widths associated with each expert are important for the segmentation task (and they can be used to characterize the sub-processes); and (3) there is less overfitting compared to single networks (homogeneous multilayer perceptrons), since the experts learn to match their variances to the (local) noise levels. This can be viewed as matching the local complexity of the model to the local complexity of the data.

Sign in / Sign up

Export Citation Format

Share Document