All-day
augmented
reality
(AR)
requires
contextually-aware
artificial
intelligence
(AI)
models
that
excel
across
diverse
daily
contexts.
Eye
tracking
could
be
a
key
source
of
information
about
user
context
and
intention.
However,
such
using
gaze
sometimes
struggle
to
outperform
egocentric
video-based
baseline
models.
We
propose
learning
representations
scanpath
history
in
perceptually-relevant
state
space
may
solve
this
problem.
scanpaths
are
often
assumed
obey
Markovian
assumption,
i.e.,
only
the
current
previous
fixation
matter.
In
study
(30
participants;
26.2
hours
total),
we
analyzed
during
nine
everyday
tasks
identified
long-term
temporal
dependencies,
with
an
average
timescale
four
fixations
(2
seconds)
into
past
(i.e.,
violating
assumption).
discovered
substantial
task-specific
variations
these
dependencies.
This
confirms
contain
stereotyped
"motifs"
context-dependent
lengths/timescales.
discuss
implications
for
designing
contextual
AI
AR
applications.
Fluctuations
in
arousal,
controlled
by
subcortical
neuromodulatory
systems,
continuously
shape
cortical
state,
with
profound
consequences
for
information
processing.
Yet,
how
arousal
signals
influence
population
activity
detail
has
so
far
only
been
characterized
a
few
selected
brain
regions.
Traditional
accounts
conceptualize
as
homogeneous
modulator
of
neural
across
the
cerebral
cortex.
Recent
insights,
however,
point
to
higher
specificity
effects
on
different
components
and
Here,
we
provide
comprehensive
account
relationships
between
fluctuations
neuronal
human
brain.
Exploiting
established
link
pupil
size
central
performed
concurrent
magnetoencephalographic
(MEG)
pupillographic
recordings
large
number
participants,
pooled
three
laboratories.
We
found
cascade
relative
peak
timing
spontaneous
dilations:
Decreases
low-frequency
(2–8
Hz)
temporal
lateral
frontal
cortex,
followed
increased
high-frequency
(>64
mid-frontal
regions,
monotonic
inverted
U
intermediate
frequency-range
(8–32
occipito-parietal
Pupil-linked
also
coincided
widespread
changes
structure
aperiodic
component
activity,
indicative
excitation-inhibition
balance
underlying
microcircuits.
Our
results
novel
basis
studying
modulation
cognitive
computations
circuits.
Neural,
physiological,
and
behavioral
signals
synchronize
between
human
subjects
in
a
variety
of
settings.
Multiple
hypotheses
have
been
proposed
to
explain
this
interpersonal
synchrony,
but
there
is
no
clarity
under
which
conditions
it
arises,
for
signals,
or
whether
common
underlying
mechanism.
We
hypothesized
that
cognitive
processing
shared
stimulus
the
source
synchrony
subjects,
measured
here
as
intersubject
correlation
(ISC).
To
test
this,
we
presented
informative
videos
participants
an
attentive
distracted
condition
subsequently
information
recall.
ISC
was
observed
electro-encephalography,
gaze
position,
pupil
size,
heart
rate,
not
respiration
head
movements.
The
strength
co-modulated
different
changed
with
attentional
state,
predicted
subsequent
recall
videos.
There
robust
within-subject
coupling
brain,
heart,
eyes,
results
suggest
result
effective
processing,
thus
emerges
only
those
exhibit
brain-body
connection.
While
physiological
fluctuations
may
be
driven
by
multiple
features
stimulus,
other
individuals
level
engagement
stimulus.
PLoS Biology,
Год журнала:
2024,
Номер
22(5), С. e3002614 - e3002614
Опубликована: Май 14, 2024
The
processing
of
sensory
information,
even
at
early
stages,
is
influenced
by
the
internal
state
animal.
Internal
states,
such
as
arousal,
are
often
characterized
relating
neural
activity
to
a
single
“level”
defined
behavioral
indicator
pupil
size.
In
this
study,
we
expand
understanding
arousal-related
modulations
in
systems
uncovering
multiple
timescales
dynamics
and
their
relationship
activity.
Specifically,
observed
robust
coupling
between
spiking
mouse
dorsolateral
geniculate
nucleus
(dLGN)
thalamus
across
spanning
few
seconds
several
minutes.
Throughout
all
these
timescales,
2
distinct
modes—individual
tonic
spikes
tightly
clustered
bursts
spikes—preferred
opposite
phases
dynamics.
This
multi-scale
reveals
from
those
captured
size
per
se,
locomotion,
eye
movements.
Furthermore,
persisted
during
viewing
naturalistic
movie,
where
it
contributed
differences
encoding
visual
information.
We
conclude
that
dLGN
under
simultaneous
influence
processes
associated
with
occurring
over
broad
range
timescales.
Journal of Vision,
Год журнала:
2023,
Номер
23(3), С. 9 - 9
Опубликована: Март 16, 2023
Temporal
attention
is
the
selection
and
prioritization
of
information
at
a
specific
moment.
Exogenous
temporal
automatic,
stimulus
driven
deployment
attention.
The
benefits
costs
exogenous
on
performance
have
not
been
isolated.
Previous
experimental
designs
precluded
distinguishing
effects
expectation
about
timing.
Here,
we
manipulated
uncertainty
timing
independently
investigated
visual
attended
unattended
moments
with
different
levels
uncertainty.
In
each
trial,
two
Gabor
patches
were
presented
consecutively
variable
onset.
To
drive
test
moments,
task-irrelevant,
brief
cue
was
100
ms
before
target
onset,
an
independent
response
end
trial.
slightly
improved
accuracy,
varied
uncertainty,
suggesting
possible
interaction
expectations
in
time.
Journal of Neuroscience,
Год журнала:
2023,
Номер
43(32), С. 5856 - 5869
Опубликована: Июль 25, 2023
Hearing
impairment
affects
many
older
adults
but
is
often
diagnosed
decades
after
speech
comprehension
in
noisy
situations
has
become
effortful.
Accurate
assessment
of
listening
effort
may
thus
help
diagnose
hearing
earlier.
However,
pupillometry-the
most
used
approach
to
assess
effort-has
limitations
that
hinder
its
use
practice.
The
current
study
explores
a
novel
way
through
eye
movements.
Building
on
cognitive
and
neurophysiological
work,
we
examine
the
hypothesis
movements
decrease
when
becomes
challenging.
In
three
experiments
with
human
participants
from
both
sexes,
demonstrate,
consistent
this
hypothesis,
fixation
duration
increases
spatial
gaze
dispersion
decreases
increasing
masking.
Eye
decreased
during
effortful
for
different
visual
scenes
(free
viewing,
object
tracking)
materials
(simple
sentences,
naturalistic
stories).
contrast,
pupillometry
was
less
sensitive
masking
story
listening,
suggesting
pupillometric
measures
not
be
as
effective
assessments
speech-listening
paradigms.
Our
results
reveal
critical
link
between
load,
neural
activity
brain
regions
support
regulation
movements,
such
frontal
field
superior
colliculus,
are
modulated
Journal of Neuroscience,
Год журнала:
2022,
Номер
43(6), С. 949 - 964
Опубликована: Дек. 14, 2022
Arousal
state
affects
neural
activity
and
vascular
dynamics
in
the
cortex,
with
sleep
associated
large
changes
local
field
potential
increases
cortical
blood
flow.
We
investigated
relationship
between
pupil
diameter
blink
rate
volume
somatosensory
cortex
male
female
unanesthetized,
head-fixed
mice.
monitored
these
variables
while
mice
were
awake,
during
periods
of
rapid
eye
movement
(REM),
non-rapid
(NREM)
sleep.
Pupil
was
smaller
than
awake
state.
Changes
coherent
both
gamma-band
power
but
strength
sign
this
varied
arousal
observed
a
strong
negative
correlation
rest
NREM
sleep,
although
correlations
signals
became
positive
alertness,
active
whisking,
REM.
Blinking
decreases
when
mouse
asleep.
Bilateral
coherence
dropped
following
blinking,
indicating
reset
activity.
Using
only
metrics
(pupil
motion),
we
could
determine
('Awake,'
'NREM,'
'REM')
>90%
accuracy
5
s
resolution.
There
is
hemodynamics
mice,
reflecting
pronounced
effects
on
cerebrovascular
dynamics.
SIGNIFICANCE
STATEMENT
Determining
critical
component
any
neuroscience
experiment.
blinking
are
influenced
by
state,
as
cortex.
found
that
strongly
related
to
Mice
more
likely
be
after
before,
resets
motion
can
used
reliable,
noninvasive
indicator
As
transition
from
wake
back
again
over
timescale
seconds,
monitoring
permits
detection
events
behavioral
or
resting-state
experiments.
European Journal of Neuroscience,
Год журнала:
2023,
Номер
59(2), С. 256 - 282
Опубликована: Дек. 18, 2023
Abstract
Working
memory
is
integral
to
a
range
of
critical
cognitive
functions
such
as
reasoning
and
decision‐making.
Although
alterations
in
working
have
been
observed
neurodivergent
populations,
there
has
no
review
mapping
how
load
measured
common
neurodevelopmental
conditions
attention‐deficit/hyperactivity
disorder
(ADHD),
autism
spectrum
(ASD)
dyslexia.
This
scoping
explores
the
neurophysiological
measures
used
study
these
specific
populations.
Our
findings
highlight
that
electroencephalography
(EEG)
functional
magnetic
resonance
imaging
(fMRI)
are
most
frequently
methods,
with
limited
number
studies
employing
near‐infrared
spectroscopy
(fNIRs),
magnetoencephalography
(MEG)
or
eye‐tracking.
Notably,
eye‐related
less
commonly
used,
despite
their
prominence
research
among
neurotypical
individuals.
The
also
highlights
potential
correlates
load,
neural
oscillations
theta
alpha
ranges
for
EEG
studies,
blood
oxygenation
level‐dependent
(BOLD)
responses
lateral
medial
frontal
brain
regions
fMRI
fNIRS
pupil
dilation
blink
rate.
Finally,
issues
future
discussed,
including
technical
challenges
associated
multimodal
approaches,
possible
impact
atypical
features
on
balancing
data
richness
participant
well‐being.
These
insights
contribute
more
nuanced
understanding
measurement
populations
point
important
methodological
considerations
neuroscientific
this
area.
Journal of Neuroscience,
Год журнала:
2023,
Номер
43(23), С. 4352 - 4364
Опубликована: Май 9, 2023
Cognitive
demand
is
thought
to
modulate
two
often
used,
but
rarely
combined,
measures:
pupil
size
and
neural
α
(8-12
Hz)
oscillatory
power.
However,
it
unclear
whether
these
measures
capture
cognitive
in
a
similar
way
under
complex
audiovisual-task
conditions.
Here
we
recorded
power
(using
electroencephalography),
while
human
participants
of
both
sexes
concurrently
performed
visual
multiple
object-tracking
task
an
auditory
gap
detection
task.
Difficulties
the
tasks
were
manipulated
independent
each
other.
Participants'
performance
decreased
accuracy
speed
with
increasing
demand.
Pupil
increased
difficulty
for
In
contrast,
showed
diverging
dynamics:
parietal
task,
not
Furthermore,
difficulty,
within-participant
trial-by-trial
fluctuations
negatively
correlated
Difficulty-induced
changes
power,
however,
did
correlate,
which
consistent
their
different
cognitive-demand
sensitivities.
Overall,
current
study
demonstrates
that
dynamics
neurophysiological
indices
associated
effort
are
multifaceted
potentially
modality-dependent
Frontiers in Psychology,
Год журнала:
2024,
Номер
15
Опубликована: Фев. 5, 2024
Introduction
Understanding
speech
in
background
noise
is
an
effortful
endeavor.
When
acoustic
challenges
arise,
linguistic
context
may
help
us
fill
perceptual
gaps.
However,
more
knowledge
needed
regarding
how
different
types
of
affect
our
ability
to
construct
meaning
from
perceptually
complex
input.
Additionally,
there
limited
evidence
whether
complexity
(e.g.,
informational
masking)
and
occurrence
contextually
incongruous
words)
interact
during
processing
material
that
longer
than
a
single
sentence.
Our
first
research
objective
was
determine
comprehension
spoken
sentence
pairs
impacted
by
the
masking
masker.
second
identify
interaction
between
processing.
Methods
We
used
multiple
measures
including
accuracy,
reaction
time,
effort
(as
indicated
task-evoked
pupil
response),
making
comparisons
across
three
levels
two
conditions.
Context
conditions
varied
final
word,
with
each
pair
ending
expected
exemplar
(EE),
within-category
violation
(WV),
or
between-category
(BV).
Forty
young
adults
typical
hearing
performed
task
over
visits.
Each
participant
heard
presented
either
multi-talker
babble
spectrally
shaped
steady-state
(SSN),
same
condition
all
Results
observed
effect
but
not
on
accuracy.
Further,
we
peak
dilation
data.
Specifically,
modulated
type:
facilitated
only
condition.
Discussion
These
findings
suggest
when
arises,
listeners
make
use
facilitate
obscured
noise.
results
extend
existing
accounts
demonstrating
engage
higher-level
processes,
such
as
construction
segments
are
European Journal of Neuroscience,
Год журнала:
2024,
Номер
59(10), С. 2686 - 2701
Опубликована: Март 12, 2024
Abstract
In
everyday
perception,
we
combine
incoming
sensory
information
with
prior
expectations.
Expectations
can
be
induced
by
cues
that
indicate
the
probability
of
following
events.
The
provided
may
differ
and
hence
lead
to
different
levels
uncertainty
about
which
event
will
follow.
this
experiment,
employed
pupillometry
investigate
whether
pupil
dilation
response
visual
varies
depending
on
level
cue‐associated
a
auditory
outcome.
Also,
tested
reflects
amount
surprise
subsequently
presented
stimulus.
each
trial,
participants
were
cue
(face
image)
was
followed
an
outcome
(spoken
vowel).
After
face
cue,
had
keypress
three
vowels
they
expected
hear
next.
We
manipulated
varying
probabilistic
cue‐outcome
contingencies:
One
most
likely
one
specific
vowel
(low
uncertainty),
another
equally
either
two
(intermediate
uncertainty)
third
all
(high
uncertainty).
Our
results
suggest
in
task‐relevant
depends
associated
uncertainty,
but
only
for
large
differences
uncertainty.
Additionally,
outcomes,
scaled
negatively
cue‐dependent
probabilities,
signalling
surprise.