The Effects of Speech Masking on Neural Tracking of Acoustic and Semantic Features of Natural Speech DOI Open Access

Sonia Yasmin,

Vanessa C. Irsik,

Ingrid S. Johnsrude

et al.

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2023, Volume and Issue: unknown

Published: Feb. 12, 2023

Abstract Listening environments contain background sounds that mask speech and lead to communication challenges. Sensitivity slow acoustic fluctuations in can help segregate from noise. Semantic context also facilitate perception noise, for example, by enabling prediction of upcoming words. However, not much is known about how different degrees masking affect the neural processing semantic features during naturalistic listening. In current electroencephalography (EEG) study, participants listened engaging, spoken stories masked at levels multi-talker babble investigate activity response changes with challenges, such effects relate intelligibility. The pattern amplitudes associated both across was U-shaped, were largest moderate levels. This U-shape may be due increased attentional focus when comprehension challenging, but manageable. latency responses linearly increasing masking, change most closely mirrored Finally, tracking related dissimilarity remained robust until severe (−3 dB SNR). study reveals are highly sensitive decreasing intelligibility, whereas relatively robust, suggesting individuals track meaning story well even sound.

Language: Английский

Reliability and generalizability of neural speech tracking in younger and older adults DOI Open Access
Ryan A. Panela,

Francesca Copelli,

Björn Herrmann

et al.

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2023, Volume and Issue: unknown

Published: July 28, 2023

Abstract Neural tracking of continuous, spoken speech is increasingly used to examine how the brain encodes and considered a potential clinical biomarker, for example, age-related hearing loss. A biomarker must be reliable (intra-class correlation [ICC] >0.7), but reliability neural-speech unclear. In current study, younger older adults (different genders) listened stories in two separate sessions while electroencephalography (EEG) was recorded order investigate generalizability neural tracking. larger compared under clear background noise conditions, consistent with loss inhibition aged auditory system. For both age groups, lower than responses bursts (ICC >0.8), which we as benchmark maximum reliability. The moderate ∼0.5-0.75) tended when presented noise. also generalized moderately across different ∼0.5-0.6), appeared greatest audiobook-like by same person. This indicates that variety could possibly assessments. Overall, data provide results critical development processing, suggest further work needed increase neural-tracking response meet standards. Significance statement approaches are research impaired processing. needs reliable, study shows ∼0.5-0.75), although more variable adults, generalize especially

Language: Английский

Citations

3

Leveraging Natural Language Processing Models to Automate Speech-Intelligibility Scoring DOI Open Access
Björn Herrmann

Published: July 30, 2023

Assessment of speech intelligibility in noise is critical for measuring the impact age-related hearing loss. However, quantifying often requires a human to manually process responses provided by participant or patient obtain speech-intelligibility score – typically proportion correctly heard words. This manual can be time-consuming and thus costly. The current study investigates whether state-of-the-art Natural Language Processing (NLP) models from Google OpenAI could used calculate scores as an alternative scoring. It was specifically tested NLP capture common speech-in-noise perception phenomena younger older adults (N=144) listening masked modulated unmodulated babble noise. results show that closely matched scorer (r ~0.95). main difference is, on average, ~2% underestimation relative moderate high signal-to-noise ratios. participants making minor errors related misspellings, gender, tense, which are sensitive, but scorers correct prior Critically, known reduction benefit masker. OpenAI’s ADA2 appears perform best out models, showing no compared suggests modern data.

Language: Английский

Citations

2

Assessing real-world music listening in concerts DOI Open Access
Anna Czepiel

Published: Jan. 1, 2023

Language: Английский

Citations

2

Audio-visual concert performances synchronize an audience's heart rates DOI
Anna Czepiel, Lauren K. Fink, Mathias Scharinger

et al.

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2024, Volume and Issue: unknown

Published: April 14, 2024

Abstract People enjoy engaging with music. Live music concerts provide an excellent option to investigate real-world experiences, and at the same time, use neurophysiological synchrony assess dynamic engagement. In current study, we assessed engagement in a live concert setting using of cardiorespiratory measures, comparing inter-subject, stimulus-response, correlation, phase coherence. As might be enhanced by seeing musicians perform, presented audiences audio-only (AO) audio-visual (AV) piano performances. Only correlation measures were above chance level. time-averaged across conditions, AV performances evoked higher inter-subject heart rate (ISC-HR). However, self-reported did not correspond when averaged pieces. On other hand, time-resolved analyses show that synchronized deceleration-acceleration (HR) patterns, typical ‘orienting response’ (an index directed attention), occurred within pieces salient events section boundaries. That is, perform heightened audience structurally important moments Western classical Overall, could multisensory information shapes By different further highlight advantages timeseries analysis, specifically ISC-HR, as robust measure holistic musical listening experiences naturalistic settings.

Language: Английский

Citations

0

Minimal background noise enhances neural speech tracking: Evidence of stochastic resonance DOI Open Access
Björn Herrmann

Published: Dec. 11, 2024

Neural activity in auditory cortex tracks the amplitude envelope of continuous speech, but recent work counter-intuitively suggests that neural tracking increases when speech is masked by background noise, despite reduced intelligibility. Noise-related amplification could indicate stochastic resonance – response facilitation through noise supports tracking. However, a comprehensive account sensitivity to and role cognitive investment lacking. In five electroencephalography (EEG) experiments (N=109; box sexes), current study demonstrates generalized enhancement due minimal noise. Results show a) enhanced for at very high SNRs (∼30 dB SNR) where highly intelligible; b) this independent attention; c) it generalizes across different stationary maskers, strongest 12-talker babble; d) present headphone free-field listening, suggesting neural-tracking real-life listening. The paints clear picture enhances representation envelope, contributes further highlights non-linearities induced make its use as biological marker processing challenging.

Language: Английский

Citations

0

Minimal background noise enhances neural speech tracking: Evidence of stochastic resonance DOI Open Access
Björn Herrmann

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2024, Volume and Issue: unknown

Published: June 24, 2024

Neural activity in auditory cortex tracks the amplitude envelope of continuous speech, but recent work counter-intuitively suggests that neural tracking increases when speech is masked by background noise, despite reduced intelligibility. Noise-related amplification could indicate stochastic resonance - response facilitation through noise supports tracking. However, a comprehensive account sensitivity to and role cognitive investment lacking. In five electroencephalography (EEG) experiments (N=109; box sexes), current study demonstrates generalized enhancement due minimal noise. Results show a) enhanced for at very high SNRs (~30 dB SNR) where highly intelligible; b) this independent attention; c) it generalizes across different stationary maskers, strongest 12-talker babble; d) present headphone free-field listening, suggesting neural-tracking real-life listening. The paints clear picture enhances representation envelope, contributes further highlights non-linearities induced make its use as biological marker processing challenging.

Language: Английский

Citations

0

Minimal background noise enhances neural speech tracking: Evidence of stochastic resonance DOI Open Access

Björn Herrmann

Published: Dec. 11, 2024

Neural activity in auditory cortex tracks the amplitude-onset envelope of continuous speech, but recent work counter-intuitively suggests that neural tracking increases when speech is masked by background noise, despite reduced intelligibility. Noise-related amplification could indicate stochastic resonance – response facilitation through noise supports tracking, a comprehensive account lacking. In five human electroencephalography (EEG) experiments, current study demonstrates generalized enhancement due to minimal noise. Results show a) enhanced for at very high SNRs (∼30 dB SNR) where highly intelligible; b) this independent attention; c) it generalizes across different stationary maskers, strongest 12-talker babble; and d) present headphone free-field listening, suggesting neural-tracking real-life listening. The paints clear picture enhances representation onset-envelope, contributes tracking. further highlights non-linearities induced make its use as biological marker processing challenging.

Language: Английский

Citations

0

Eye movements decrease during effortful speech listening DOI Open Access

M. Eric Cui,

Björn Herrmann

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2023, Volume and Issue: unknown

Published: Feb. 9, 2023

Abstract Pupillometry is the most used objective tool to assess listening effort but has several disadvantages. The current study explores a new, way through eye movements. Building on cognitive and neurophysiological work, we examine hypothesis that movements decrease when speech becomes challenging. In three experiments with human participants from both sexes, demonstrate, consistent this hypothesis, fixation duration increases spatial gaze dispersion decreases increasing masking. Eye decreased during effortful for different visual scenes (free viewing; object tracking) materials (simple sentences; naturalistic stories). contrast, pupillometry was insensitive masking story listening, highlighting challenges pupillometric measures assessments of in speech-listening paradigms. Our results reveal critical link between load, provide foundation novel measure applicable wide range contexts. Significance statement Assessment early diagnosis age-related hearing loss. We effortful. (sentences;

Language: Английский

Citations

0

The Effects of Speech Masking on Neural Tracking of Acoustic and Semantic Features of Natural Speech DOI Open Access

Sonia Yasmin,

Vanessa C. Irsik,

Ingrid S. Johnsrude

et al.

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2023, Volume and Issue: unknown

Published: Feb. 12, 2023

Abstract Listening environments contain background sounds that mask speech and lead to communication challenges. Sensitivity slow acoustic fluctuations in can help segregate from noise. Semantic context also facilitate perception noise, for example, by enabling prediction of upcoming words. However, not much is known about how different degrees masking affect the neural processing semantic features during naturalistic listening. In current electroencephalography (EEG) study, participants listened engaging, spoken stories masked at levels multi-talker babble investigate activity response changes with challenges, such effects relate intelligibility. The pattern amplitudes associated both across was U-shaped, were largest moderate levels. This U-shape may be due increased attentional focus when comprehension challenging, but manageable. latency responses linearly increasing masking, change most closely mirrored Finally, tracking related dissimilarity remained robust until severe (−3 dB SNR). study reveals are highly sensitive decreasing intelligibility, whereas relatively robust, suggesting individuals track meaning story well even sound.

Language: Английский

Citations

0