Phonological constraint induction in a connectionist network: learning OCP-Place constraints from data

2013 ◽  
Vol 37 ◽  
pp. 52-69 ◽  
Author(s):  
John Alderete ◽  
Paul Tupper ◽  
Stefan A. Frisch
Keyword(s):  
Connectionist Network ◽  
Network Learning

Speed up Neural Network Learning by GPGPU

2011 ◽  
Vol 131 (11) ◽  
pp. 1889-1894
Author(s):  
Yuta Tsuchida ◽  
Michifumi Yoshioka
Keyword(s):  
Neural Network ◽  
Neural Network Learning ◽  
Network Learning ◽  
Speed Up

Network learning forum posts topic discovery

2014 ◽  
Author(s):  
Changri Luo ◽  
Tingting He ◽  
Xinhua Zhang
Keyword(s):  
Network Learning ◽  
Topic Discovery

scholarly journals A Geometric Perspective on Information Plane Analysis

Entropy ◽  
2021 ◽  
Vol 23 (6) ◽  
pp. 711
Author(s):  
Mina Basirat ◽  
Bernhard C. Geiger ◽  
Peter M. Roth
Keyword(s):  
Neural Network ◽  
Mutual Information ◽  
Geometric Interpretation ◽  
Neural Network Training ◽  
Neural Network Learning ◽  
Network Learning ◽  
Plane Analysis ◽  
Network Training ◽  
Hidden Layer ◽  
The Impact

Information plane analysis, describing the mutual information between the input and a hidden layer and between a hidden layer and the target over time, has recently been proposed to analyze the training of neural networks. Since the activations of a hidden layer are typically continuous-valued, this mutual information cannot be computed analytically and must thus be estimated, resulting in apparently inconsistent or even contradicting results in the literature. The goal of this paper is to demonstrate how information plane analysis can still be a valuable tool for analyzing neural network training. To this end, we complement the prevailing binning estimator for mutual information with a geometric interpretation. With this geometric interpretation in mind, we evaluate the impact of regularization and interpret phenomena such as underfitting and overfitting. In addition, we investigate neural network learning in the presence of noisy data and noisy labels.

Sign in / Sign up

Export Citation Format

Share Document