The Effects of Speech Masking on Neural Tracking of Acoustic and Semantic Features of Natural Speech DOI Open Access

Sonia Yasmin,

Vanessa C. Irsik,

Ingrid S. Johnsrude

et al.

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2023, Volume and Issue: unknown

Published: Feb. 12, 2023

Abstract Listening environments contain background sounds that mask speech and lead to communication challenges. Sensitivity slow acoustic fluctuations in can help segregate from noise. Semantic context also facilitate perception noise, for example, by enabling prediction of upcoming words. However, not much is known about how different degrees masking affect the neural processing semantic features during naturalistic listening. In current electroencephalography (EEG) study, participants listened engaging, spoken stories masked at levels multi-talker babble investigate activity response changes with challenges, such effects relate intelligibility. The pattern amplitudes associated both across was U-shaped, were largest moderate levels. This U-shape may be due increased attentional focus when comprehension challenging, but manageable. latency responses linearly increasing masking, change most closely mirrored Finally, tracking related dissimilarity remained robust until severe (−3 dB SNR). study reveals are highly sensitive decreasing intelligibility, whereas relatively robust, suggesting individuals track meaning story well even sound.

Language: Английский

The effects of speech masking on neural tracking of acoustic and semantic features of natural speech DOI

Sonia Yasmin,

Vanessa C. Irsik,

Ingrid S. Johnsrude

et al.

Neuropsychologia, Journal Year: 2023, Volume and Issue: 186, P. 108584 - 108584

Published: May 9, 2023

Language: Английский

Citations

17

Eye Movements Decrease during Effortful Speech Listening DOI Creative Commons

M. Eric Cui,

Björn Herrmann

Journal of Neuroscience, Journal Year: 2023, Volume and Issue: 43(32), P. 5856 - 5869

Published: July 25, 2023

Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing earlier. However, pupillometry-the most used approach to assess effort-has limitations that hinder its use practice. The current study explores a novel way through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis movements decrease when becomes challenging. In three experiments with human participants from both sexes, demonstrate, consistent this hypothesis, fixation duration increases spatial gaze dispersion decreases increasing masking. Eye decreased during effortful for different visual scenes (free viewing, object tracking) materials (simple sentences, naturalistic stories). contrast, pupillometry was less sensitive masking story listening, suggesting pupillometric measures not be as effective assessments speech-listening paradigms. Our results reveal critical link between load, neural activity brain regions support regulation movements, such frontal field superior colliculus, are modulated

Language: Английский

Citations

14

Exploring Age Differences in Absorption and Enjoyment during Story Listening DOI Creative Commons
Signe Lund Mathiesen, Stephen C. Van Hedger,

Vanessa C. Irsik

et al.

Deleted Journal, Journal Year: 2024, Volume and Issue: 6(2), P. 667 - 684

Published: June 13, 2024

Using naturalistic spoken narratives to investigate speech processes and comprehension is becoming increasingly popular in experimental hearing research. Yet, little known about how individuals engage with story materials listening experiences change age. We investigated absorption the context of stories, explored predictive factors for engagement, examined utility a scale developed written assess auditory materials. Adults aged 20–78 years (N = 216) participated an online study. Participants listened one ten stories intended be engaging different degrees rated terms enjoyment. ages similarly absorbing enjoyable. Further, higher mood scores predicted enjoyment ratings. Factor analysis showed items approximately grouped according original dimensions, suggesting that may similar although certain discriminated less effectively between more or engaging. The present study provides novel insights into adults supports using stimuli

Language: Английский

Citations

4

Audio‐visual concert performances synchronize audience's heart rates DOI Creative Commons
Anna Czepiel, Lauren K. Fink, Mathias Scharinger

et al.

Annals of the New York Academy of Sciences, Journal Year: 2025, Volume and Issue: unknown

Published: Jan. 3, 2025

Abstract People enjoy engaging with music. Live music concerts provide an excellent option to investigate real‐world experiences, and at the same time, use neurophysiological synchrony assess dynamic engagement. In current study, we assessed engagement in a live concert setting using of cardiorespiratory measures, comparing inter‐subject, stimulus–response, correlation, phase coherence. As might be enhanced by seeing musicians perform, presented audiences audio‐only (AO) audio‐visual (AV) piano performances. Only correlation measures were above chance level. time‐averaged across conditions, AV performances evoked higher inter‐subject heart rate (ISC‐HR). However, averaged pieces did not correspond self‐reported On other hand, time‐resolved analyses show that synchronized deceleration‐acceleration (HR) patterns, typical “orienting response” (an index directed attention), occurred within salient events section boundaries. That is, perform heightened audience structurally important moments Western classical Overall, could multisensory information shapes By different further highlight advantages time series analysis, specifically ISC‐HR, as robust measure holistic musical listening experiences naturalistic settings.

Language: Английский

Citations

0

Eye movements of younger and older adults decrease during story listening in background noise DOI Creative Commons
Björn Herrmann, Florian Scharf, Andreas Widmann

et al.

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2025, Volume and Issue: unknown

Published: April 20, 2025

Abstract Assessments of listening effort are increasingly relevant to understanding the speech-comprehension difficulties experienced by older adults. Pupillometry is most common tool assess but has limitations. Recent research shown that eye movements decrease when effortful and proposed indicators as alternative measures. However, much work was conducted in younger adults trial-based sentence-listening paradigm, during concurrent visual stimulation. The extent which index con tinuous speech listening, independently stimuli, adults, unknown. In current study, listened continuous stories with varying degrees background noise under free moving-dot viewing conditions. Eye decreased (as indexed fixation duration, gaze dispersion, saccade rate) increasing masking. reduction did not depend on age group or conditions, indicating can be used effects masking different situations people ages. pupil area only sensitive early experiment. sum, study suggests a potential listening.

Language: Английский

Citations

0

Interpersonal synchronization as an objective measure of listening engagement DOI Creative Commons
Lotte Lambrechts, Bernd Accou, Jonas Vanthornhout

et al.

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2025, Volume and Issue: unknown

Published: Feb. 26, 2025

Abstract Listening engagement plays a crucial role in effective communication and knowledge transfer, reflecting state of deep absorption an auditory stimulus. The available behavioral assessments listening are limited capturing its multidimensional nature. Measuring objectively using brain body signals is compelling alternative. In particular, interpersonal synchronization—observed through synchronized physiological responses among listeners—may offer promising objective measure. this study, we examined synchronization activity, heart rate, electrodermal activity between participants while they listened to engaging non-engaging stories. Subjective ratings were collected as ground truth reference. Results showed higher across all modalities when stories compared ones, with significant correlations measures subjective engagement. These results confirm that may be reliable, marker We anticipate these will provide powerful framework for future research relevant domains, including education, audiology, science, enable impactful real-world applications, such automatically tracking audience entertainment, broader societal contexts. Significance Statement the first direct empirical evidence serves robust reliable Using novel experimental paradigm ecologically valid stimuli, demonstrate heightened leads increased neural listeners, disengagement reduces it. This measure significantly correlates established assessments, validating relevance reliability. Our innovative approach offers domains (education, audiology science) enables automatic domains.

Language: Английский

Citations

0

Minimal background noise enhances neural speech tracking: Evidence of stochastic resonance DOI Open Access

Björn Herrmann

Published: March 10, 2025

Neural activity in auditory cortex tracks the amplitude-onset envelope of continuous speech, but recent work counter-intuitively suggests that neural tracking increases when speech is masked by background noise, despite reduced intelligibility. Noise-related amplification could indicate stochastic resonance – response facilitation through noise supports tracking, a comprehensive account lacking. In five human electroencephalography (EEG) experiments, current study demonstrates generalized enhancement due to minimal noise. Results show a) enhanced for at very high SNRs (∼30 dB SNR) where highly intelligible; b) this independent attention; c) it generalizes across different stationary maskers, strongest 12-talker babble; and d) present headphone free-field listening, suggesting neural-tracking real-life listening. The paints clear picture enhances representation onset-envelope, contributes tracking. further highlights non-linearities induced make its use as biological marker processing challenging.

Language: Английский

Citations

0

Enhanced neural speech tracking through noise indicates stochastic resonance in humans DOI Creative Commons
Björn Herrmann

eLife, Journal Year: 2025, Volume and Issue: 13

Published: March 18, 2025

Neural activity in auditory cortex tracks the amplitude-onset envelope of continuous speech, but recent work counterintuitively suggests that neural tracking increases when speech is masked by background noise, despite reduced intelligibility. Noise-related amplification could indicate stochastic resonance – response facilitation through noise supports tracking, a comprehensive account lacking. In five human electroencephalography experiments, current study demonstrates generalized enhancement due to minimal noise. Results show (1) enhanced for at very high signal-to-noise ratios (~30 dB SNR) where highly intelligible; (2) this independent attention; (3) it generalizes across different stationary maskers, strongest 12-talker babble; and (4) present headphone free-field listening, suggesting neural-tracking real-life listening. The paints clear picture enhances representation onset-envelope, contributes tracking. further highlights non-linearities induced make its use as biological marker processing challenging.

Language: Английский

Citations

0

Reliability and generalizability of neural speech tracking in younger and older adults DOI
Ryan A. Panela,

Francesca Copelli,

Björn Herrmann

et al.

Neurobiology of Aging, Journal Year: 2023, Volume and Issue: 134, P. 165 - 180

Published: Nov. 21, 2023

Language: Английский

Citations

9

Leveraging natural language processing models to automate speech-intelligibility scoring DOI

Björn Herrmann

Speech Language and Hearing, Journal Year: 2024, Volume and Issue: unknown, P. 1 - 18

Published: July 7, 2024

Assessment of speech intelligibility in noise is critical for measuring the impact age-related hearing loss. However, quantifying often requires a human to manually process responses provided by participant or patient obtain speech-intelligibility score – typically proportion correctly heard words. This manual can be time-consuming and thus costly. The current study investigates whether state-of-the-art Natural Language Processing (NLP) models from Google OpenAI could used calculate scores as an alternative scoring. It was specifically tested NLP capture common speech-in-noise perception phenomena younger older adults (N = 144) listening masked modulated unmodulated babble noise. results show that closely matched scorer (r ∼0.95). main difference is, on average, ∼2% underestimation relative moderate high signal-to-noise ratios. participants making minor errors related misspellings, gender, tense, which are sensitive, but scorers correct prior Critically, known reduction benefit masker. OpenAI's ADA2 appears perform best out models, showing no compared suggests modern data.

Language: Английский

Citations

2