Detecting overlapping luminance-defined and contrast-defined stimuli: Cue combination for better detection?

Abstract For the visual world in which we operate, the core issue is to conceptualize how its three-dimensional structure is encoded through the neural computation of multiple depth cues and their integration to a unitary depth structure. One approach to this issue is the full Bayesian model of scene understanding, but this is shown to require selection from the implausibly large number of possible scenes. An alternative approach is to propagate the implied depth structure solution for the scene through the “belief propagation” algorithm on general probability distributions. However, a more efficient model of local slant propagation is developed as an alternative.The overall depth percept must be derived from the combination of all available depth cues, but a simple linear summation rule across, say, a dozen different depth cues, would massively overestimate the perceived depth in the scene in cases where each cue alone provides a close-to-veridical depth estimate. On the other hand, a Bayesian averaging or “modified weak fusion” model for depth cue combination does not provide for the observed enhancement of perceived depth from weak depth cues. Thus, the current models do not account for the empirical properties of perceived depth from multiple depth cues.The present analysis shows that these problems can be addressed by an asymptotic, or hyperbolic Minkowski, approach to cue combination. With appropriate parameters, this first-order rule gives strong summation for a few depth cues, but the effect of an increasing number of cues beyond that remains too weak to account for the available degree of perceived depth magnitude. Finally, an accelerated asymptotic rule is proposed to match the empirical strength of perceived depth as measured, with appropriate behavior for any number of depth cues.

Download Full-text

Displaying Depth in Computer Systems: Lessons from Two-Dimensional Works of Art

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/154193120504901718 ◽

2005 ◽

Vol 49 (17) ◽

pp. 1583-1587

Author(s):

Skye Lee Pazuchanics ◽

Douglas J. Gillan

Keyword(s):

Visual System ◽

Computer Systems ◽

Cue Integration ◽

Two Dimensional ◽

Cue Combination ◽

Design Decisions ◽

Works Of Art ◽

Pictorial Cues

Virtual depth displays depend on static, monocular cues. Models of integrating monocular cues may be continuous (additive) or discontinuous. Previous research using simple displays and a small number of cues supported continuous cue integration. The present research is designed to expand the understanding of how the visual system integrates information from multiple pictorial cues by investigating combinations of one to ten pictorial cues in visually-rich, two-dimensional displays (paintings and photographs). Participants estimated depth in target paintings and photographs relative to a standard two dimensional display. Certain results suggest that the visual system integrates cues in a largely additive way, but after a number of cues are present there may be an additional boost in perceived depth resulting in a best-fittingdiscontinuous model of cue combination. However, this discontinuous effect may be due to designdecisions made by the painters rather than exclusively to the perceptual processes of the viewers. Analyses of these design decisions provide lessons for the design of two-dimensional displays.

Download Full-text

The Effects of Cue Reliability on Crossmodal Recalibration in Adults and Children

Multisensory Research ◽

10.1163/22134808-bja10053 ◽

2021 ◽

pp. 1-19

Author(s):

Sophie Rohlf ◽

Patrick Bruns ◽

Brigitte Röder

Keyword(s):

Multisensory Integration ◽

Sound Localization ◽

Visual Stimulus ◽

Cue Combination ◽

Single Exposure ◽

Visual Cue ◽

Cue Reliability ◽

Adults And Children ◽

Ventriloquist Effect

Abstract Reliability-based cue combination is a hallmark of multisensory integration, while the role of cue reliability for crossmodal recalibration is less understood. The present study investigated whether visual cue reliability affects audiovisual recalibration in adults and children. Participants had to localize sounds, which were presented either alone or in combination with a spatially discrepant high- or low-reliability visual stimulus. In a previous study we had shown that the ventriloquist effect (indicating multisensory integration) was overall larger in the children groups and that the shift in sound localization toward the spatially discrepant visual stimulus decreased with visual cue reliability in all groups. The present study replicated the onset of the immediate ventriloquist aftereffect (a shift in unimodal sound localization following a single exposure of a spatially discrepant audiovisual stimulus) at the age of 6–7 years. In adults the immediate ventriloquist aftereffect depended on visual cue reliability, whereas the cumulative ventriloquist aftereffect (reflecting the audiovisual spatial discrepancies over the complete experiment) did not. In 6–7-year-olds the immediate ventriloquist aftereffect was independent of visual cue reliability. The present results are compatible with the idea of immediate and cumulative crossmodal recalibrations being dissociable processes and that the immediate ventriloquist aftereffect is more closely related to genuine multisensory integration.

Download Full-text

A linear cue combination framework for understanding selective attention

Journal of Vision ◽

10.1167/3.2.2 ◽

2003 ◽

Vol 3 (2) ◽

pp. 2 ◽

Cited By ~ 13

Author(s):

Richard F. Murray ◽

Allison B. Sekuler ◽

Patrick J. Bennett

Keyword(s):

Selective Attention ◽

Cue Combination

Download Full-text

Normalization models of cue combination in touch

10.1101/283218 ◽

2018 ◽

Author(s):

Md. Shoaibur Rahman ◽

Jeffrey M. Yau

Keyword(s):

Stimulus Feature ◽

Cue Combination ◽

Divisive Normalization

Bimanual touch may require combining what is felt on the hands with where the hands are located in space. The computations supporting bimanual touch are poorly understood. We found that tactile cue combination patterns and their sensitivity to the locations of the hands differed according to the attended stimulus feature. These idiosyncratic perceptual patterns can be explained by distinct cue combination models that each involve divisive normalization, a canonical computation.

Download Full-text

Early temporal dynamics of cue combination for slant from stereo and texture

Journal of Vision ◽

10.1167/5.8.400 ◽

2010 ◽

Vol 5 (8) ◽

pp. 400-400

Author(s):

B. T. Backus ◽

J. M. Hillis ◽

J. Frumkin ◽

J. A. Saunders

Keyword(s):

Temporal Dynamics ◽

Cue Combination

Download Full-text

Audio-Visual Speech Cue Combination

PLoS ONE ◽

10.1371/journal.pone.0010217 ◽

2010 ◽

Vol 5 (4) ◽

pp. e10217 ◽

Cited By ~ 10

Author(s):

Derek H. Arnold ◽

Morgan Tear ◽

Ryan Schindel ◽

Warrick Roseboom

Keyword(s):

Visual Speech ◽

Cue Combination

Download Full-text

On the Use of Checklists in Auditing: A Commentary

Current Issues in Auditing ◽

10.2308/ciia-50741 ◽

2014 ◽

Vol 8 (1) ◽

pp. C1-C25 ◽

Cited By ~ 6

Author(s):

J. Efrim Boritz ◽

Lev M. Timoshenko

Keyword(s):

Risk Assessment ◽

Experimental Studies ◽

Risk Assessments ◽

Cue Combination ◽

Assessment Task ◽

Fraud Risk ◽

Red Flag ◽

Application Methods ◽

Effective Use ◽

Fraud Risk Assessments

SUMMARYExperimental studies concerning fraud (or “red flag”) checklists often are interpreted as providing evidence that checklists are dysfunctional because their use yields results inferior to unaided judgments (Hogan et al. 2008). However, some of the criticisms leveled against checklists are directed at generic checklists applied by individual auditors who combine the cues using their own judgment. Based on a review and synthesis of the literature on the use of checklists in auditing and other fields, we offer a framework for effective use of checklists that incorporates the nature of the audit task, checklist design, checklist application, and contextual factors. Our analysis of checklist research in auditing suggests that improvements to checklist design and to checklist application methods can make checklists more effective. In particular, with regard to fraud risk assessments, customizing checklists to fit both client circumstances and the characteristics of the fraud risk assessment task, along with auditor reliance on formal cue-combination models rather than on judgmental cue combinations, could make fraud checklists more effective than extant research implies.

Download Full-text