scholarly journals The Neural Consequences of Attentional Prioritization of Internal Representations in Visual Working Memory

2019 ◽  
Author(s):  
Muhammet I. Sahan ◽  
Andrew D. Sheldon ◽  
Bradley R. Postle

AbstractAlthough humans can hold multiple items in mind simultaneously, the contents of working memory (WM) can be selectively prioritized to effectively guide behavior in response to rapidly changing exigencies in the environment. Neural evidence for this is seen in studies of dual serial retrocuing of two items held concurrently in visual WM, in which evidence in occipital cortex for the active neural representation of the cued item increases, and evidence for the uncued item decreases, often to levels indistinguishable from empirical baseline. Although this pattern is reminiscent of the effects of selective attention on visual perception, the extent to which more subtle principles of visual attention may also apply to visual working memory remains uncertain. In the present study we explored whether the well-characterized “same-object” benefit in visual target detection, attributed to object-based attention (e.g., Duncan, 1984; Egly, Driver, & Rafal, 1994), may also be observed for information held in visual WM. fMRI data were collected while human subjects (male and female) performed a multi-step serial retrocuing task in which they first viewed two two-dimensional sample stimuli comprised of colored moving dots. After stimulus offset, an initialrelevance cuethen indicated whether both dimensions of only the first or only the second object, or only the color or only the direction-of-motion of both objects, would be relevant for the remainder of the trial, which then proceeded with the standard dual serial retrocuing procedure. Thus, on “object-relevant” trials, the ensuingpriority cuesprompted the selection of one from among two features (“color” or “direction”) bound to the same object, whereas on “feature-relevant” trials thepriority cuesprompted the selection of one from among two features each belonging to a different object. Results of analyses with multivariate inverted encoding models (IEM) revealed a same-object benefit on object-relevant trials: Whereas, on feature-relevant trials, the firstpriority cuetriggered a strengthening of the neural representation of the cued feature and a concomitant weakening-to-baseline of the uncued feature; on object-relevant trials the cued item remained active but did not increase in strength, and the uncued item weakened, but remained significantly elevated throughout the delay period. Of additional interest, on both types of trials the secondpriority cueprompted an active recoding of the uncued item into a different neural representation, perhaps to minimize its ability to interfere with recall of the cued item. Finally, although stimulus-specific representation in parietal and frontal cortex was weak and uneven, these regions closely tracked the higher-order information of which stimulus category was relevant for behavior at all points during the trial, indicating an important role in controlling the prioritization of information in visual working memory.

Author(s):  
Yin-ting Lin ◽  
Garry Kong ◽  
Daryl Fougnie

AbstractAttentional mechanisms in perception can operate over locations, features, or objects. However, people direct attention not only towards information in the external world, but also to information maintained in working memory. To what extent do perception and memory draw on similar selection properties? Here we examined whether principles of object-based attention can also hold true in visual working memory. Experiment 1 examined whether object structure guides selection independently of spatial distance. In a memory updating task, participants encoded two rectangular bars with colored ends before updating two colors during maintenance. Memory updates were faster for two equidistant colors on the same object than on different objects. Experiment 2 examined whether selection of a single object feature spreads to other features within the same object. Participants memorized two sequentially presented Gabors, and a retro-cue indicated which object and feature dimension (color or orientation) would be most relevant to the memory test. We found stronger effects of object selection than feature selection: accuracy was higher for the uncued feature in the same object than the cued feature in the other object. Together these findings demonstrate effects of object-based attention on visual working memory, at least when object-based representations are encouraged, and suggest shared attentional mechanisms across perception and memory.


2020 ◽  
Vol 32 (5) ◽  
pp. 917-944 ◽  
Author(s):  
Muhammet I. Sahan ◽  
Andrew D. Sheldon ◽  
Bradley R. Postle

Although humans can hold multiple items in mind simultaneously, the contents of working memory (WM) can be selectively prioritized to guide future behavior. We explored whether the “same-object” benefits in visual processing may also be observed in visual WM. fMRI data were collected while participants performed a multistep serial retrocuing task in which they first viewed two 2-D objects (coherently moving colored dots). During retention, an initial relevance cue then indicated whether only the first or only the second object (“object-relevant”), or only the color of both objects or only their direction of motion would be relevant for the remainder of the trial (“feature-relevant”). On “object-relevant” trials, the ensuing priority cues selected either one of the features (“color” or “direction”) bound to the relevance-cued object, whereas on “feature-relevant” trials, the priority cues selected one of the two relevance-cued features. Using multivariate inverted encoding models, we found a same-object benefit on object-relevant trials in occipitotemporal regions: On feature-relevant trials, the first priority cue triggered a strengthening of the neural representation of the cued feature and a concomitant weakening to baseline of the uncued feature, whereas on object-relevant trials, the cued item remained active but did not increase in strength and the uncued item weakened but remained significantly elevated throughout the delay period. Although the stimulus-specific representation in frontoparietal regions was weak and uneven, these regions closely tracked the higher order information of which stimulus category was relevant for behavior throughout the trial, suggesting an important role in controlling the prioritization of information in visual WM.


Author(s):  
Christian Merkel ◽  
Mandy Viktoria Bartsch ◽  
Mircea A Schoenfeld ◽  
Anne-Katrin Vellage ◽  
Notger G Müller ◽  
...  

Visual working memory (VWM) is an active representation enabling the manipulation of item information even in the absence of visual input. A common way to investigate VWM is to analyze the performance at later recall. This approach, however, leaves uncertainties about whether the variation of recall performance is attributable to item encoding and maintenance or to the testing of memorized information. Here, we record the contralateral delay activity (CDA) - an established electrophysiological measure of item storage and maintenance - in human subjects performing a delayed orientation precision estimation task. This allows us to link the fluctuation of recall precision directly to the process of item encoding and maintenance. We show that for two sequentially encoded orientation items, the CDA amplitude reflects the precision of orientation recall of both items, with higher precision being associated with a larger amplitude. Furthermore, we show that the CDA amplitude for each item varies independently from each other, suggesting that the precision of memory representations fluctuates independently.


2021 ◽  
pp. 1-16
Author(s):  
Qing Yu ◽  
Bradley R. Postle

Abstract Humans can construct rich subjective experience even when no information is available in the external world. Here, we investigated the neural representation of purely internally generated stimulus-like information during visual working memory. Participants performed delayed recall of oriented gratings embedded in noise with varying contrast during fMRI scanning. Their trialwise behavioral responses provided an estimate of their mental representation of the to-be-reported orientation. We used multivariate inverted encoding models to reconstruct the neural representations of orientation in reference to the response. We found that response orientation could be successfully reconstructed from activity in early visual cortex, even on 0% contrast trials when no orientation information was actually presented, suggesting the existence of a purely internally generated neural code in early visual cortex. In addition, cross-generalization and multidimensional scaling analyses demonstrated that information derived from internal sources was represented differently from typical working memory representations, which receive influences from both external and internal sources. Similar results were also observed in intraparietal sulcus, with slightly different cross-generalization patterns. These results suggest a potential mechanism for how externally driven and internally generated information is maintained in working memory.


2020 ◽  
Vol 7 (8) ◽  
pp. 190228 ◽  
Author(s):  
Quan Wan ◽  
Ying Cai ◽  
Jason Samaha ◽  
Bradley R. Postle

How does the neural representation of visual working memory content vary with behavioural priority? To address this, we recorded electroencephalography (EEG) while subjects performed a continuous-performance 2-back working memory task with oriented-grating stimuli. We tracked the transition of the neural representation of an item ( n ) from its initial encoding, to the status of ‘unprioritized memory item' (UMI), and back to ‘prioritized memory item', with multivariate inverted encoding modelling. Results showed that the representational format was remapped from its initially encoded format into a distinctive ‘opposite' representational format when it became a UMI and then mapped back into its initial format when subsequently prioritized in anticipation of its comparison with item n + 2. Thus, contrary to the default assumption that the activity representing an item in working memory might simply get weaker when it is deprioritized, it may be that a process of priority-based remapping helps to protect remembered information when it is not in the focus of attention.


PLoS Biology ◽  
2020 ◽  
Vol 18 (9) ◽  
pp. e3000854 ◽  
Author(s):  
Qing Yu ◽  
Matthew F. Panichello ◽  
Ying Cai ◽  
Bradley R. Postle ◽  
Timothy J. Buschman

2014 ◽  
Vol 112 (6) ◽  
pp. 1516-1527 ◽  
Author(s):  
Satoshi Nishida ◽  
Tomohiro Tanaka ◽  
Tadashi Ogawa

Neurons in the lateral intraparietal area (LIP) are involved in signaling the location of behaviorally relevant objects during visual discrimination and working memory maintenance. Although previous studies have examined these cognitive processes separately, they often appear as inseparable sequential processes in real-life situations. Little is known about how the neural representation of the target location is altered when both cognitive processes are continuously required for executing a task. We investigated this issue by recording single-unit activity from LIP of monkeys performing a delayed-response visual search task in which they were required to discriminate the target from distractors in the stimulus period, remember the location at which the extinguished target had been presented in the delay period, and make a saccade to that location in the response period. Target-location signaling was assessed using response modulations contingent on whether the target location was inside or opposite the receptive field. Although the population-averaged response modulation was consistent and changed only slightly during a trial, the across-neuron pattern of response modulations showed a marked and abrupt change around 170 ms after stimulus offset due to concurrent changes in the response modulations of a subset of LIP neurons, which manifested heterogeneous patterns of activity changes during the task. Our findings suggest that target-location signaling by the across-neuron pattern of LIP activity discretely changes after the stimulus disappearance under conditions that continuously require visual discrimination and working memory to perform a single behavioral task.


Sign in / Sign up

Export Citation Format

Share Document