scholarly journals Impact of Different Acoustic Components on EEG-based Auditory Attention Decoding in Noisy and Reverberant Conditions

2018 ◽  
Author(s):  
Ali Aroudi ◽  
Bojana Mirkovic ◽  
Maarten De Vos ◽  
Simon Doclo

AbstractRecently, a least-squares-based method has been proposed to decode auditory attention from single-trial EEG recordings for an acoustic scenario with two competing speakers. This method aims at reconstructing the attended speech envelope from the EEG recordings using a trained spatio-temporal filter. While the performance of this method has been mainly studied for noiseless and anechoic acoustic conditions, it is important to fully understand its performance in realistic noisy and reverberant acoustic conditions. In this paper, we investigate auditory attention decoding (AAD) using EEG recordings for different acoustic conditions (anechoic, reverberant, noisy, and reverberant-noisy). In particular, we investigate the impact of different acoustic conditions for AAD filter training and for decoding. In addition, we investigate the influence on the decoding performance of the different acoustic components (i.e. reverberation, background noise and interfering speaker) in the reference signals used for decoding and the training signals used for computing the filters. First, we found that for all considered acoustic conditions it is possible to decode auditory attention with a decoding performance larger than 90%, even when the acoustic conditions for AAD filter training and for decoding are different. Second, when using reference signals affected by reverberation and/or background noise, a comparable decoding performance as when using clean reference signals can be obtained. In contrast, when using reference signals affected by the interfering speaker, the decoding performance significantly decreases. Third, the experimental results indicate that it is even feasible to use training signals affected by reverberation, background noise and/or the interfering speaker for computing the filters.

2018 ◽  
Author(s):  
Neetha Das ◽  
Alexander Bertrand ◽  
Tom Francart

AbstractObjectiveA listener’s neural responses can be decoded to identify the speaker the person is attending to in a cocktail party environment. Such auditory attention detection methods have the potential to provide noise suppression algorithms in hearing devices with information about the listener’s attention. A challenge is the effect of noise and other acoustic conditions that can reduce the attention detection accuracy. Specifically, noise can impact the ability of the person to segregate the sound sources and perform selective attention, as well as the external signal processing necessary to decode the attention effectively. The aim of this work is to systematically analyze the effect of noise level and speaker position on attention decoding accuracy.Approach28 subjects participated in the experiment. Auditory stimuli consisted of stories narrated by different speakers from 2 different locations, along with surrounding multi-talker background babble. EEG signals of the subjects were recorded while they focused on one story and ignored the other. The strength of the babble noise as well as the spatial separation between the two speakers were varied between presentations. Spatio-temporal decoders were trained for each subject, and applied to decode attention of the subjects from every 30s segment of data. Behavioral speech recognition thresholds were obtained for the different speaker separations.Main resultsBoth the background noise level and the angular separation between speakers affected attention decoding accuracy. Remarkably, attention decoding performance was seen to increase with the inclusion of moderate background noise (versus no noise), while across the different noise conditions performance dropped significantly with increasing noise level. We also observed that decoding accuracy improved with increasing speaker separation, exhibiting the advantage of spatial release from masking. Furthermore, the effect of speaker separation on the decoding accuracy became stronger when the background noise level increased. A significant correlation between speech intelligibility and attention decoding accuracy was found across conditions.SignificanceThis work shows how the background noise level and relative positions of competing talkers impact attention decoding accuracy. It indicates in which circumstances a neuro-steered noise suppression system may need to operate, in function of acoustic conditions. It also indicates the boundary conditions for the operation of EEG-based attention detection systems in neuro-steered hearing prostheses.Index TermsAuditory attention detection, EEG processing, neuro-steered auditory prostheses, brain-computer interface, cocktail party, acoustic conditions.The work is funded by KU Leuven Special Research Fund C14/16/057 and OT/14/119, FWO project nrs. 1.5.123.16N and G0A4918N, the ERC (637424) under the European Union’s Horizon 2020 research and innovation programme, and a research gift of Starkey Hearing Technologies. The scientific responsibility is assumed by its authors.


Water ◽  
2021 ◽  
Vol 13 (3) ◽  
pp. 307
Author(s):  
Chi Zhang ◽  
Naixia Mou ◽  
Jiqiang Niu ◽  
Lingxian Zhang ◽  
Feng Liu

Changes in snow cover over the Tibetan Plateau (TP) have a significant impact on agriculture, hydrology, and ecological environment of surrounding areas. This study investigates the spatio-temporal pattern of snow depth (SD) and snow cover days (SCD), as well as the impact of temperature and precipitation on snow cover over TP from 1979 to 2018 by using the ERA5 reanalysis dataset, and uses the Mann–Kendall test for significance. The results indicate that (1) the average annual SD and SCD in the southern and western edge areas of TP are relatively high, reaching 10 cm and 120 d or more, respectively. (2) In the past 40 years, SD (s = 0.04 cm decade−1, p = 0.81) and SCD (s = −2.3 d decade−1, p = 0.10) over TP did not change significantly. (3) The positive feedback effect of precipitation is the main factor affecting SD, while the negative feedback effect of temperature is the main factor affecting SCD. This study improves the understanding of snow cover change and is conducive to the further study of climate change on TP.


2021 ◽  
Vol 10 (14) ◽  
pp. 3078
Author(s):  
Sara Akbarzadeh ◽  
Sungmin Lee ◽  
Chin-Tuan Tan

In multi-speaker environments, cochlear implant (CI) users may attend to a target sound source in a different manner from normal hearing (NH) individuals during a conversation. This study attempted to investigate the effect of conversational sound levels on the mechanisms adopted by CI and NH listeners in selective auditory attention and how it affects their daily conversation. Nine CI users (five bilateral, three unilateral, and one bimodal) and eight NH listeners participated in this study. The behavioral speech recognition scores were collected using a matrix sentences test, and neural tracking to speech envelope was recorded using electroencephalography (EEG). Speech stimuli were presented at three different levels (75, 65, and 55 dB SPL) in the presence of two maskers from three spatially separated speakers. Different combinations of assisted/impaired hearing modes were evaluated for CI users, and the outcomes were analyzed in three categories: electric hearing only, acoustic hearing only, and electric + acoustic hearing. Our results showed that increasing the conversational sound level degraded the selective auditory attention in electrical hearing. On the other hand, increasing the sound level improved the selective auditory attention for the acoustic hearing group. In the NH listeners, however, increasing the sound level did not cause a significant change in the auditory attention. Our result implies that the effect of the sound level on selective auditory attention varies depending on the hearing modes, and the loudness control is necessary for the ease of attending to the conversation by CI users.


Energies ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 1432
Author(s):  
Xwégnon Ghislain Agoua ◽  
Robin Girard ◽  
Georges Kariniotakis

The efficient integration of photovoltaic (PV) production in energy systems is conditioned by the capacity to anticipate its variability, that is, the capacity to provide accurate forecasts. From the classical forecasting methods in the state of the art dealing with a single power plant, the focus has moved in recent years to spatio-temporal approaches, where geographically dispersed data are used as input to improve forecasts of a site for the horizons up to 6 h ahead. These spatio-temporal approaches provide different performances according to the data sources available but the question of the impact of each source on the actual forecasting performance is still not evaluated. In this paper, we propose a flexible spatio-temporal model to generate PV production forecasts for horizons up to 6 h ahead and we use this model to evaluate the effect of different spatial and temporal data sources on the accuracy of the forecasts. The sources considered are measurements from neighboring PV plants, local meteorological stations, Numerical Weather Predictions, and satellite images. The evaluation of the performance is carried out using a real-world test case featuring a high number of 136 PV plants. The forecasting error has been evaluated for each data source using the Mean Absolute Error and Root Mean Square Error. The results show that neighboring PV plants help to achieve around 10% reduction in forecasting error for the first three hours, followed by satellite images which help to gain an additional 3% all over the horizons up to 6 h ahead. The NWP data show no improvement for horizons up to 6 h but is essential for greater horizons.


2009 ◽  
Vol 120 (8) ◽  
pp. 1596-1600 ◽  
Author(s):  
Ying Gu ◽  
Kim Dremstrup ◽  
Dario Farina
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document