bioRxiv (Cold Spring Harbor Laboratory),
Journal Year:
2023,
Volume and Issue:
unknown
Published: Feb. 12, 2023
Abstract
Listening
environments
contain
background
sounds
that
mask
speech
and
lead
to
communication
challenges.
Sensitivity
slow
acoustic
fluctuations
in
can
help
segregate
from
noise.
Semantic
context
also
facilitate
perception
noise,
for
example,
by
enabling
prediction
of
upcoming
words.
However,
not
much
is
known
about
how
different
degrees
masking
affect
the
neural
processing
semantic
features
during
naturalistic
listening.
In
current
electroencephalography
(EEG)
study,
participants
listened
engaging,
spoken
stories
masked
at
levels
multi-talker
babble
investigate
activity
response
changes
with
challenges,
such
effects
relate
intelligibility.
The
pattern
amplitudes
associated
both
across
was
U-shaped,
were
largest
moderate
levels.
This
U-shape
may
be
due
increased
attentional
focus
when
comprehension
challenging,
but
manageable.
latency
responses
linearly
increasing
masking,
change
most
closely
mirrored
Finally,
tracking
related
dissimilarity
remained
robust
until
severe
(−3
dB
SNR).
study
reveals
are
highly
sensitive
decreasing
intelligibility,
whereas
relatively
robust,
suggesting
individuals
track
meaning
story
well
even
sound.
bioRxiv (Cold Spring Harbor Laboratory),
Journal Year:
2023,
Volume and Issue:
unknown
Published: July 28, 2023
Abstract
Neural
tracking
of
continuous,
spoken
speech
is
increasingly
used
to
examine
how
the
brain
encodes
and
considered
a
potential
clinical
biomarker,
for
example,
age-related
hearing
loss.
A
biomarker
must
be
reliable
(intra-class
correlation
[ICC]
>0.7),
but
reliability
neural-speech
unclear.
In
current
study,
younger
older
adults
(different
genders)
listened
stories
in
two
separate
sessions
while
electroencephalography
(EEG)
was
recorded
order
investigate
generalizability
neural
tracking.
larger
compared
under
clear
background
noise
conditions,
consistent
with
loss
inhibition
aged
auditory
system.
For
both
age
groups,
lower
than
responses
bursts
(ICC
>0.8),
which
we
as
benchmark
maximum
reliability.
The
moderate
∼0.5-0.75)
tended
when
presented
noise.
also
generalized
moderately
across
different
∼0.5-0.6),
appeared
greatest
audiobook-like
by
same
person.
This
indicates
that
variety
could
possibly
assessments.
Overall,
data
provide
results
critical
development
processing,
suggest
further
work
needed
increase
neural-tracking
response
meet
standards.
Significance
statement
approaches
are
research
impaired
processing.
needs
reliable,
study
shows
∼0.5-0.75),
although
more
variable
adults,
generalize
especially
Assessment
of
speech
intelligibility
in
noise
is
critical
for
measuring
the
impact
age-related
hearing
loss.
However,
quantifying
often
requires
a
human
to
manually
process
responses
provided
by
participant
or
patient
obtain
speech-intelligibility
score
–
typically
proportion
correctly
heard
words.
This
manual
can
be
time-consuming
and
thus
costly.
The
current
study
investigates
whether
state-of-the-art
Natural
Language
Processing
(NLP)
models
from
Google
OpenAI
could
used
calculate
scores
as
an
alternative
scoring.
It
was
specifically
tested
NLP
capture
common
speech-in-noise
perception
phenomena
younger
older
adults
(N=144)
listening
masked
modulated
unmodulated
babble
noise.
results
show
that
closely
matched
scorer
(r
~0.95).
main
difference
is,
on
average,
~2%
underestimation
relative
moderate
high
signal-to-noise
ratios.
participants
making
minor
errors
related
misspellings,
gender,
tense,
which
are
sensitive,
but
scorers
correct
prior
Critically,
known
reduction
benefit
masker.
OpenAI’s
ADA2
appears
perform
best
out
models,
showing
no
compared
suggests
modern
data.
bioRxiv (Cold Spring Harbor Laboratory),
Journal Year:
2024,
Volume and Issue:
unknown
Published: April 14, 2024
Abstract
People
enjoy
engaging
with
music.
Live
music
concerts
provide
an
excellent
option
to
investigate
real-world
experiences,
and
at
the
same
time,
use
neurophysiological
synchrony
assess
dynamic
engagement.
In
current
study,
we
assessed
engagement
in
a
live
concert
setting
using
of
cardiorespiratory
measures,
comparing
inter-subject,
stimulus-response,
correlation,
phase
coherence.
As
might
be
enhanced
by
seeing
musicians
perform,
presented
audiences
audio-only
(AO)
audio-visual
(AV)
piano
performances.
Only
correlation
measures
were
above
chance
level.
time-averaged
across
conditions,
AV
performances
evoked
higher
inter-subject
heart
rate
(ISC-HR).
However,
self-reported
did
not
correspond
when
averaged
pieces.
On
other
hand,
time-resolved
analyses
show
that
synchronized
deceleration-acceleration
(HR)
patterns,
typical
‘orienting
response’
(an
index
directed
attention),
occurred
within
pieces
salient
events
section
boundaries.
That
is,
perform
heightened
audience
structurally
important
moments
Western
classical
Overall,
could
multisensory
information
shapes
By
different
further
highlight
advantages
timeseries
analysis,
specifically
ISC-HR,
as
robust
measure
holistic
musical
listening
experiences
naturalistic
settings.
Neural
activity
in
auditory
cortex
tracks
the
amplitude
envelope
of
continuous
speech,
but
recent
work
counter-intuitively
suggests
that
neural
tracking
increases
when
speech
is
masked
by
background
noise,
despite
reduced
intelligibility.
Noise-related
amplification
could
indicate
stochastic
resonance
–
response
facilitation
through
noise
supports
tracking.
However,
a
comprehensive
account
sensitivity
to
and
role
cognitive
investment
lacking.
In
five
electroencephalography
(EEG)
experiments
(N=109;
box
sexes),
current
study
demonstrates
generalized
enhancement
due
minimal
noise.
Results
show
a)
enhanced
for
at
very
high
SNRs
(∼30
dB
SNR)
where
highly
intelligible;
b)
this
independent
attention;
c)
it
generalizes
across
different
stationary
maskers,
strongest
12-talker
babble;
d)
present
headphone
free-field
listening,
suggesting
neural-tracking
real-life
listening.
The
paints
clear
picture
enhances
representation
envelope,
contributes
further
highlights
non-linearities
induced
make
its
use
as
biological
marker
processing
challenging.
bioRxiv (Cold Spring Harbor Laboratory),
Journal Year:
2024,
Volume and Issue:
unknown
Published: June 24, 2024
Neural
activity
in
auditory
cortex
tracks
the
amplitude
envelope
of
continuous
speech,
but
recent
work
counter-intuitively
suggests
that
neural
tracking
increases
when
speech
is
masked
by
background
noise,
despite
reduced
intelligibility.
Noise-related
amplification
could
indicate
stochastic
resonance
-
response
facilitation
through
noise
supports
tracking.
However,
a
comprehensive
account
sensitivity
to
and
role
cognitive
investment
lacking.
In
five
electroencephalography
(EEG)
experiments
(N=109;
box
sexes),
current
study
demonstrates
generalized
enhancement
due
minimal
noise.
Results
show
a)
enhanced
for
at
very
high
SNRs
(~30
dB
SNR)
where
highly
intelligible;
b)
this
independent
attention;
c)
it
generalizes
across
different
stationary
maskers,
strongest
12-talker
babble;
d)
present
headphone
free-field
listening,
suggesting
neural-tracking
real-life
listening.
The
paints
clear
picture
enhances
representation
envelope,
contributes
further
highlights
non-linearities
induced
make
its
use
as
biological
marker
processing
challenging.
Neural
activity
in
auditory
cortex
tracks
the
amplitude-onset
envelope
of
continuous
speech,
but
recent
work
counter-intuitively
suggests
that
neural
tracking
increases
when
speech
is
masked
by
background
noise,
despite
reduced
intelligibility.
Noise-related
amplification
could
indicate
stochastic
resonance
–
response
facilitation
through
noise
supports
tracking,
a
comprehensive
account
lacking.
In
five
human
electroencephalography
(EEG)
experiments,
current
study
demonstrates
generalized
enhancement
due
to
minimal
noise.
Results
show
a)
enhanced
for
at
very
high
SNRs
(∼30
dB
SNR)
where
highly
intelligible;
b)
this
independent
attention;
c)
it
generalizes
across
different
stationary
maskers,
strongest
12-talker
babble;
and
d)
present
headphone
free-field
listening,
suggesting
neural-tracking
real-life
listening.
The
paints
clear
picture
enhances
representation
onset-envelope,
contributes
tracking.
further
highlights
non-linearities
induced
make
its
use
as
biological
marker
processing
challenging.
bioRxiv (Cold Spring Harbor Laboratory),
Journal Year:
2023,
Volume and Issue:
unknown
Published: Feb. 9, 2023
Abstract
Pupillometry
is
the
most
used
objective
tool
to
assess
listening
effort
but
has
several
disadvantages.
The
current
study
explores
a
new,
way
through
eye
movements.
Building
on
cognitive
and
neurophysiological
work,
we
examine
hypothesis
that
movements
decrease
when
speech
becomes
challenging.
In
three
experiments
with
human
participants
from
both
sexes,
demonstrate,
consistent
this
hypothesis,
fixation
duration
increases
spatial
gaze
dispersion
decreases
increasing
masking.
Eye
decreased
during
effortful
for
different
visual
scenes
(free
viewing;
object
tracking)
materials
(simple
sentences;
naturalistic
stories).
contrast,
pupillometry
was
insensitive
masking
story
listening,
highlighting
challenges
pupillometric
measures
assessments
of
in
speech-listening
paradigms.
Our
results
reveal
critical
link
between
load,
provide
foundation
novel
measure
applicable
wide
range
contexts.
Significance
statement
Assessment
early
diagnosis
age-related
hearing
loss.
We
effortful.
(sentences;
bioRxiv (Cold Spring Harbor Laboratory),
Journal Year:
2023,
Volume and Issue:
unknown
Published: Feb. 12, 2023
Abstract
Listening
environments
contain
background
sounds
that
mask
speech
and
lead
to
communication
challenges.
Sensitivity
slow
acoustic
fluctuations
in
can
help
segregate
from
noise.
Semantic
context
also
facilitate
perception
noise,
for
example,
by
enabling
prediction
of
upcoming
words.
However,
not
much
is
known
about
how
different
degrees
masking
affect
the
neural
processing
semantic
features
during
naturalistic
listening.
In
current
electroencephalography
(EEG)
study,
participants
listened
engaging,
spoken
stories
masked
at
levels
multi-talker
babble
investigate
activity
response
changes
with
challenges,
such
effects
relate
intelligibility.
The
pattern
amplitudes
associated
both
across
was
U-shaped,
were
largest
moderate
levels.
This
U-shape
may
be
due
increased
attentional
focus
when
comprehension
challenging,
but
manageable.
latency
responses
linearly
increasing
masking,
change
most
closely
mirrored
Finally,
tracking
related
dissimilarity
remained
robust
until
severe
(−3
dB
SNR).
study
reveals
are
highly
sensitive
decreasing
intelligibility,
whereas
relatively
robust,
suggesting
individuals
track
meaning
story
well
even
sound.