Minimum Probability of Error Image Retrieval: From Visual Features to Image Semantics

2011 ◽  
Vol 5 (4) ◽  
pp. 265-389 ◽  
Author(s):  
Nuno Vasconcelos
Keyword(s):  
Image Retrieval ◽  
Visual Features ◽  
Probability Of Error ◽  
Image Semantics ◽  
Minimum Probability ◽  
Minimum Probability Of Error

Decision-Theoretic Saliency: Computational Principles, Biological Plausibility, and Implications for Neurophysiology and Psychophysics

2009 ◽  
Vol 21 (1) ◽  
pp. 239-271 ◽  
Author(s):  
Dashan Gao ◽  
Nuno Vasconcelos
Keyword(s):  
Visual Saliency ◽  
Visual Features ◽  
Linear Filtering ◽  
Bottom Up ◽  
Probability Of Error ◽  
Information Theoretic ◽  
Inference Problems ◽  
Spatial Pooling ◽  
Optimal Detector ◽  
Minimum Probability

A decision-theoretic formulation of visual saliency, first proposed for top-down processing (object recognition) (Gao & Vasconcelos, 2005a ), is extended to the problem of bottom-up saliency. Under this formulation, optimality is defined in the minimum probability of error sense, under a constraint of computational parsimony. The saliency of the visual features at a given location of the visual field is defined as the power of those features to discriminate between the stimulus at the location and a null hypothesis. For bottom-up saliency, this is the set of visual features that surround the location under consideration. Discrimination is defined in an information-theoretic sense and the optimal saliency detector derived for a class of stimuli that complies with known statistical properties of natural images. It is shown that under the assumption that saliency is driven by linear filtering, the optimal detector consists of what is usually referred to as the standard architecture of V1: a cascade of linear filtering, divisive normalization, rectification, and spatial pooling. The optimal detector is also shown to replicate the fundamental properties of the psychophysics of saliency: stimulus pop-out, saliency asymmetries for stimulus presence versus absence, disregard of feature conjunctions, and Weber's law. Finally, it is shown that the optimal saliency architecture can be applied to the solution of generic inference problems. In particular, for the class of stimuli studied, it performs the three fundamental operations of statistical inference: assessment of probabilities, implementation of Bayes decision rule, and feature selection.

Sign in / Sign up

Export Citation Format

Share Document