When
recalling
memories,
we
often
scan
information-rich
continuous
episodes,
e.g.,
to
find
our
keys.
How
does
brain
access
and
search
through
naturalistic
memories?
We
suggest
that
high-level
structure,
marked
by
event
boundaries,
guides
us
this
process.
present
a
computational
model
where
memory-scanning
is
sped
up
``skipping
ahead’’
the
next
boundary
upon
reaching
decision-threshold.
Using
movie
(normed
for
boundaries;
study
1),
then
prompt
participants
perform
of
movie-segments
target
answers
(study
2)
mental
simulation
3)
these
segments
(total
N=601
adults
across
studies).
Confirming
predictions,
times
were
function
number
boundaries
within
segment
distance
search-target
previous
boundary.
Mental
also
described
skipping-process,
but
with
higher
skipping-threshold
than
memory-scanning.
These
findings
identify
as
points
memory.
Nature Communications,
Год журнала:
2023,
Номер
14(1)
Опубликована: Март 8, 2023
Abstract
Although
every
life
event
is
unique,
there
are
considerable
commonalities
across
events.
However,
little
known
about
whether
or
how
the
brain
flexibly
represents
information
different
components
at
encoding
and
during
remembering.
Here,
we
show
that
cortico-hippocampal
networks
systematically
represent
specific
of
events
depicted
in
videos,
both
online
experience
episodic
memory
retrieval.
Regions
an
Anterior
Temporal
Network
represented
people,
generalizing
contexts,
whereas
regions
a
Posterior
Medial
context
information,
people.
prefrontal
cortex
generalized
videos
depicting
same
schema,
hippocampus
maintained
event-specific
representations.
Similar
effects
were
seen
real-time
recall,
suggesting
reuse
overlapping
memories.
These
representational
profiles
together
provide
computationally
optimal
strategy
to
scaffold
for
high-level
components,
allowing
efficient
comprehension,
recollection,
imagination.
Scientific Reports,
Год журнала:
2022,
Номер
12(1)
Опубликована: Сен. 29, 2022
Abstract
Deep
language
algorithms,
like
GPT-2,
have
demonstrated
remarkable
abilities
to
process
text,
and
now
constitute
the
backbone
of
automatic
translation,
summarization
dialogue.
However,
whether
these
models
encode
information
that
relates
human
comprehension
still
remains
controversial.
Here,
we
show
representations
GPT-2
not
only
map
onto
brain
responses
spoken
stories,
but
they
also
predict
extent
which
subjects
understand
corresponding
narratives.
To
this
end,
analyze
101
recorded
with
functional
Magnetic
Resonance
Imaging
while
listening
70
min
short
stories.
We
then
fit
a
linear
mapping
model
activity
from
GPT-2’s
activations.
Finally,
reliably
correlates
(
$$\mathcal
{R}=0.50,
p<10^{-15}$$
R=0.50,p<10-15
)
subjects’
scores
as
assessed
for
each
story.
This
effect
peaks
in
angular,
medial
temporal
supra-marginal
gyri,
is
best
accounted
by
long-distance
dependencies
generated
deep
layers
GPT-2.
Overall,
study
shows
how
help
clarify
computations
underlying
comprehension.
Psychological Science,
Год журнала:
2023,
Номер
34(3), С. 326 - 344
Опубликована: Янв. 3, 2023
When
recalling
memories,
we
often
scan
information-rich
continuous
episodes,
for
example,
to
find
our
keys.
How
does
brain
access
and
search
through
those
memories?
We
suggest
that
high-level
structure,
marked
by
event
boundaries,
guides
us
this
process:
In
computational
model,
memory
scanning
is
sped
up
skipping
ahead
the
next
boundary
upon
reaching
a
decision
threshold.
adult
Mechanical
Turk
workers
from
United
States,
used
movie
(normed
boundaries;
Study
1,
Nature Communications,
Год журнала:
2023,
Номер
14(1)
Опубликована: Май 23, 2023
Abstract
Recent
work
in
cognitive
and
systems
neuroscience
has
suggested
that
the
hippocampus
might
support
planning,
imagination,
navigation
by
forming
maps
capture
abstract
structure
of
physical
spaces,
tasks,
situations.
Navigation
involves
disambiguating
similar
contexts,
planning
execution
a
sequence
decisions
to
reach
goal.
Here,
we
examine
hippocampal
activity
patterns
humans
during
goal-directed
task
investigate
how
contextual
goal
information
are
incorporated
construction
navigational
plans.
During
pattern
similarity
is
enhanced
across
routes
share
context
navigation,
observe
prospective
activation
reflects
retrieval
related
key-decision
point.
These
results
suggest
that,
rather
than
simply
representing
overlapping
associations
or
state
transitions,
shaped
goals.
Scientific Reports,
Год журнала:
2024,
Номер
14(1)
Опубликована: Июль 22, 2024
Abstract
It
has
been
proposed
that,
when
processing
a
stream
of
events,
humans
divide
their
experiences
in
terms
inferred
latent
causes
(LCs)
to
support
context-dependent
learning.
However,
shared
structure
is
present
across
contexts,
it
still
unclear
how
the
“splitting”
LCs
and
learning
can
be
simultaneously
achieved.
Here,
we
Latent
Cause
Network
(LCNet),
neural
network
model
LC
inference.
Through
learning,
naturally
stores
that
tasks
weights.
Additionally,
represents
context-specific
using
context
module,
controlled
by
Bayesian
nonparametric
inference
algorithm,
which
assigns
unique
vector
for
each
LC.
Across
three
simulations,
found
LCNet
could
(1)
extract
function
task
while
avoiding
catastrophic
interference,
(2)
capture
human
data
on
curriculum
effects
schema
(3)
infer
underlying
event
naturalistic
videos
daily
events.
Overall,
these
results
demonstrate
computationally
feasible
approach
reconciling
scalable
from
laboratory
experiment
settings
settings.
bioRxiv (Cold Spring Harbor Laboratory),
Год журнала:
2025,
Номер
unknown
Опубликована: Фев. 13, 2025
Prior
behavioral
work
showed
that
event
structure
plays
a
key
role
in
our
ability
to
mentally
search
through
memories
of
continuous
naturalistic
experience.
We
hypothesized
that,
neurally,
this
mem-
ory
process
involves
division
labor
between
slowly
un-
furling
neocortical
states
representing
knowledge
and
fast
hippocampal-neocortical
communication
supports
retrieval
new
information
at
transitions
events.
To
test
this,
we
tracked
slow
neural
state-patterns
sample
ten
patients
under-
going
intracranial
electroencephalography
as
they
viewed
movie
then
searched
their
structured
in-
terview.
As
answered
questions
("after
X,
when
does
Y
happen
next?"),
from
movie-viewing
were
reinstated
neocortex;
during
memory-search,
unfurled
forward
di-
rection.
Moments
state-transition
marked
by
low-frequency
power
decreases
cortex
preceded
hip-
pocampus
correlated
with
reinstatement.
Connectivity-analysis
revealed
information-flow
hippocampus
underpinning
state-transitions.
Together,
these
results
support
hypothesis
hippocampal
processes
bridge
memory
search.
Nature Communications,
Год журнала:
2022,
Номер
13(1)
Опубликована: Авг. 6, 2022
Abstract
Some
experiences
linger
in
mind,
spontaneously
returning
to
our
thoughts
for
minutes
after
their
conclusion.
Other
fall
out
of
mind
immediately.
It
remains
unclear
why.
We
hypothesize
that
an
input
is
more
likely
persist
when
it
has
been
deeply
processed:
we
have
extracted
its
situational
meaning
rather
than
physical
properties
or
low-level
semantics.
Here,
participants
read
sequences
words
with
different
levels
coherence
(word-,
sentence-,
narrative-level).
probe
participants’
spontaneous
via
free
word
association,
before
and
reading.
By
measuring
lingering
subjectively
(via
self-report)
objectively
changes
association
content),
find
information
lingers
coherent
at
the
narrative
level.
Furthermore,
individual’s
feeling
transportation
into
reading
material
predicts
better
material’s
objective
coherence.
Thus,
present
moment
echo
prior
incorporated
deeper,
forms
thinking.