scholarly journals Economic Nowcasting with Long Short-term Memory Artificial Neural Networks (LSTM)

2021 ◽  
Author(s):  
Daniel Hopp
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Short Term Memory ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Artificial Neural

scholarly journals Classifying muscle parameters with artificial neural networks and simulated lateral pinch data

PLoS ONE ◽  
2021 ◽  
Vol 16 (9) ◽  
pp. e0255103
Author(s):  
Kalyn M. Kearney ◽  
Joel B. Harley ◽  
Jennifer A. Nichols
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Short Term Memory ◽  
Isometric Force ◽  
Short Term ◽  
Term Memory ◽  
Pinch Force ◽  
Maximum Isometric Force ◽  
Long Short Term Memory ◽  
Artificial Neural

Objective Hill-type muscle models are widely employed in simulations of human movement. Yet, the parameters underlying these models are difficult or impossible to measure in vivo. Prior studies demonstrate that Hill-type muscle parameters are encoded within dynamometric data. But, a generalizable approach for estimating these parameters from dynamometric data has not been realized. We aimed to leverage musculoskeletal models and artificial neural networks to classify one Hill-type muscle parameter (maximum isometric force) from easily measurable dynamometric data (simulated lateral pinch force). We tested two neural networks (feedforward and long short-term memory) to identify if accounting for dynamic behavior improved accuracy. Methods We generated four datasets via forward dynamics, each with increasing complexity from adjustments to more muscles. Simulations were grouped and evaluated to show how varying the maximum isometric force of thumb muscles affects lateral pinch force. Both neural networks classified these groups from lateral pinch force alone. Results Both neural networks achieved accuracies above 80% for datasets which varied only the flexor pollicis longus and/or the abductor pollicis longus. The inclusion of muscles with redundant functions dropped model accuracies to below 30%. While both neural networks were consistently more accurate than random guess, the long short-term memory model was not consistently more accurate than the feedforward model. Conclusion Our investigations demonstrate that artificial neural networks provide an inexpensive, data-driven approach for approximating Hill-type muscle-tendon parameters from easily measurable data. However, muscles of redundant function or of little impact to force production make parameter classification more challenging.

scholarly journals Groundwater level forecasting with artificial neural networks: a comparison of long short-term memory (LSTM), convolutional neural networks (CNNs), and non-linear autoregressive networks with exogenous input (NARX)

2021 ◽  
Vol 25 (3) ◽  
pp. 1671-1687
Author(s):  
Andreas Wunsch ◽  
Tanja Liesch ◽  
Stefan Broda
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Convolutional Neural Networks ◽  
Groundwater Level ◽  
Short Term Memory ◽  
State Of The Art ◽  
Short Term ◽  
Term Memory ◽  
Non Linear ◽  
Long Short Term Memory

Abstract. It is now well established to use shallow artificial neural networks (ANNs) to obtain accurate and reliable groundwater level forecasts, which are an important tool for sustainable groundwater management. However, we observe an increasing shift from conventional shallow ANNs to state-of-the-art deep-learning (DL) techniques, but a direct comparison of the performance is often lacking. Although they have already clearly proven their suitability, shallow recurrent networks frequently seem to be excluded from the study design due to the euphoria about new DL techniques and its successes in various disciplines. Therefore, we aim to provide an overview on the predictive ability in terms of groundwater levels of shallow conventional recurrent ANNs, namely non-linear autoregressive networks with exogenous input (NARX) and popular state-of-the-art DL techniques such as long short-term memory (LSTM) and convolutional neural networks (CNNs). We compare the performance on both sequence-to-value (seq2val) and sequence-to-sequence (seq2seq) forecasting on a 4-year period while using only few, widely available and easy to measure meteorological input parameters, which makes our approach widely applicable. Further, we also investigate the data dependency in terms of time series length of the different ANN architectures. For seq2val forecasts, NARX models on average perform best; however, CNNs are much faster and only slightly worse in terms of accuracy. For seq2seq forecasts, mostly NARX outperform both DL models and even almost reach the speed of CNNs. However, NARX are the least robust against initialization effects, which nevertheless can be handled easily using ensemble forecasting. We showed that shallow neural networks, such as NARX, should not be neglected in comparison to DL techniques especially when only small amounts of training data are available, where they can clearly outperform LSTMs and CNNs; however, LSTMs and CNNs might perform substantially better with a larger dataset, where DL really can demonstrate its strengths, which is rarely available in the groundwater domain though.

Sign in / Sign up

Export Citation Format

Share Document