scholarly journals Mini-batch stochastic approaches for accelerated multiplicative updates in nonnegative matrix factorisation with beta-divergence

2016 ◽  
Author(s):  
Romain Serizel ◽  
Slim Essid ◽  
Gael Richard
Keyword(s):  
Nonnegative Matrix ◽  
Multiplicative Updates ◽  
Nonnegative Matrix Factorisation ◽  
Matrix Factorisation

P3-144: Cognitive Subtypes Identified Using Nonnegative Matrix Factorisation in Four Large Alzheimer's Disease Dementia Cohorts

2016 ◽  
Vol 12 ◽  
pp. P873-P874
Author(s):  
Nienke M.E. Scheltens ◽  
Betty M. Tijms ◽  
Teddy Koene ◽  
Frederik Barkhof ◽  
Charlotte E. Teunissen ◽  
...  
Keyword(s):  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Nonnegative Matrix ◽  
Nonnegative Matrix Factorisation ◽  
Alzheimer’S Disease Dementia ◽  
Matrix Factorisation

scholarly journals Unsupervised Learning of Overlapping Image Components Using Divisive Input Modulation

2009 ◽  
Vol 2009 ◽  
pp. 1-19 ◽  
Author(s):  
M. W. Spratling ◽  
K. De Meyer ◽  
R. Kompass
Keyword(s):  
Unsupervised Learning ◽  
Learning Algorithm ◽  
State Of The Art ◽  
Nonnegative Matrix ◽  
Computationally Efficient ◽  
Training Images ◽  
Correct Representation ◽  
Nonnegative Matrix Factorisation ◽  
The Individual ◽  
Matrix Factorisation

This paper demonstrates that nonnegative matrix factorisation is mathematically related to a class of neural networks that employ negative feedback as a mechanism of competition. This observation inspires a novel learning algorithm which we call Divisive Input Modulation (DIM). The proposed algorithm provides a mathematically simple and computationally efficient method for the unsupervised learning of image components, even in conditions where these elementary features overlap considerably. To test the proposed algorithm, a novel artificial task is introduced which is similar to the frequently-used bars problem but employs squares rather than bars to increase the degree of overlap between components. Using this task, we investigate how the proposed method performs on the parsing of artificial images composed of overlapping features, given the correct representation of the individual components; and secondly, we investigate how well it can learn the elementary components from artificial training images. We compare the performance of the proposed algorithm with its predecessors including variations on these algorithms that have produced state-of-the-art performance on the bars problem. The proposed algorithm is more successful than its predecessors in dealing with overlap and occlusion in the artificial task that has been used to assess performance.

scholarly journals Bayesian Inference for Nonnegative Matrix Factorisation Models

2009 ◽  
Vol 2009 ◽  
pp. 1-17 ◽  
Author(s):  
Ali Taylan Cemgil
Keyword(s):  
Bayesian Inference ◽  
Nonnegative Matrix ◽  
Model Order Selection ◽  
Model Order ◽  
Statistical Framework ◽  
Expectation Maximisation ◽  
Special Cases ◽  
Monotonic Convergence ◽  
Nonnegative Matrix Factorisation ◽  
Matrix Factorisation

We describe nonnegative matrix factorisation (NMF) with a Kullback-Leibler (KL) error measure in a statistical framework, with a hierarchical generative model consisting of an observation and a prior component. Omitting the prior leads to the standard KL-NMF algorithms as special cases, where maximum likelihood parameter estimation is carried out via the Expectation-Maximisation (EM) algorithm. Starting from this view, we develop full Bayesian inference via variational Bayes or Monte Carlo. Our construction retains conjugacy and enables us to develop more powerful models while retaining attractive features of standard NMF such as monotonic convergence and easy implementation. We illustrate our approach on model order selection and image reconstruction.

Sign in / Sign up

Export Citation Format

Share Document