bioRxiv (Cold Spring Harbor Laboratory),
Год журнала:
2022,
Номер
unknown
Опубликована: Дек. 7, 2022
ABSTRACT
The
signed
value
and
unsigned
salience
of
reward
prediction
errors
(RPEs)
are
critical
to
understanding
reinforcement
learning
(RL)
cognitive
control.
Dorsomedial
prefrontal
cortex
(dMPFC)
insula
(INS)
key
regions
for
integrating
surprise
information,
but
conflicting
evidence
both
activity
has
led
competing
proposals
the
nature
RPE
representations
in
these
brain
areas.
Recently,
distributional
RL
theory
(dRL)
been
used
explain
coding
diversity
rodent
midbrain
by
proposing
that
dopaminergic
neurons
have
differential
sensitivity
positive
negative
RPEs.
Here,
we
use
intracranially
recorded
high
frequency
(HFA)
show
this
asymmetric
scaling
strategy
captures
human
dMPFC
INS.
We
found
neural
populations
responding
valence-specific
RPEs,
as
well
salience,
which
spatially
interleaved
within
each
region.
Furthermore,
directional
connectivity
estimates
suggest
a
leading
role
INS
communicating
RPEs
dMPFC.
These
findings
support
across
distinct
intermingled
core
principle
coding,
expand
scope
dRL,
reconcile
longstanding
theoretical
debates
on
Brain Structure and Function,
Год журнала:
2023,
Номер
228(5), С. 1201 - 1257
Опубликована: Май 13, 2023
The
orbitofrontal
cortex
and
amygdala
are
involved
in
emotion
motivation,
but
the
relationship
between
these
functions
performed
by
brain
structures
is
not
clear.
To
address
this,
a
unified
theory
of
motivation
described
which
motivational
states
instrumental
goal-directed
actions
to
obtain
rewards
or
avoid
punishers,
emotional
that
elicited
when
reward
punisher
received.
This
greatly
simplifies
our
understanding
for
same
set
genes
associated
systems
can
define
primary
unlearned
punishers
such
as
sweet
taste
pain.
Recent
evidence
on
connectivity
human
indicates
value
experienced
with
outputs
cortical
regions
including
those
language,
key
region
depression
changes
motivation.
has
weak
effective
back
humans,
implicated
brainstem-mediated
responses
stimuli
freezing
autonomic
activity,
rather
than
declarative
emotion.
anterior
cingulate
learning
rewards,
ventromedial
prefrontal
providing
goals
navigation
reward-related
effects
memory
consolidation
mediated
partly
via
cholinergic
system.
Annual Review of Neuroscience,
Год журнала:
2023,
Номер
46(1), С. 211 - 231
Опубликована: Март 14, 2023
Emotions
are
fundamental
to
our
experience
and
behavior,
affecting
motivating
all
aspects
of
lives.
Scientists
various
disciplines
have
been
fascinated
by
emotions
for
centuries,
yet
even
today
vigorous
debates
abound
about
how
define
best
study
their
neural
underpinnings.
Defining
from
an
evolutionary
perspective
acknowledging
important
functional
roles
in
supporting
survival
allows
the
emotion
states
diverse
species.
This
approach
enables
taking
advantage
modern
tools
behavioral,
systems,
circuit
neurosciences,
allowing
precise
dissection
mechanisms
behavior
underlying
processes
model
organisms.
Here
we
review
findings
processing
across
species
try
identify
points
convergence
as
well
next
steps
pursuit
understanding
emerge
activity.
Trends in Cognitive Sciences,
Год журнала:
2024,
Номер
28(6), С. 541 - 553
Опубликована: Фев. 28, 2024
Anhedonia
is
a
reduction
in
enjoyment,
motivation,
or
interest.
It
common
across
mental
health
disorders
and
harbinger
of
poor
treatment
outcomes.
The
enjoyment
aspect,
termed
'consummatory
anhedonia',
particular
poses
fundamental
questions
about
how
the
brain
constructs
rewards:
what
processes
determine
intensely
reward
experienced?
Here,
we
outline
limitations
existing
computational
conceptualisations
consummatory
anhedonia.
We
then
suggest
richer
reinforcement
learning
(RL)
account
anhedonia
with
reconceptualisation
subjective
hedonic
experience
terms
goal
progress.
This
accounts
qualitatively
for
impact
stress,
dysfunctional
cognitions,
maladaptive
beliefs
on
experience.
model
also
offers
new
views
treatments
Nature Communications,
Год журнала:
2023,
Номер
14(1)
Опубликована: Дек. 21, 2023
Abstract
The
signed
value
and
unsigned
salience
of
reward
prediction
errors
(RPEs)
are
critical
to
understanding
reinforcement
learning
(RL)
cognitive
control.
Dorsomedial
prefrontal
cortex
(dMPFC)
insula
(INS)
key
regions
for
integrating
surprise
information,
but
conflicting
evidence
both
activity
has
led
multiple
proposals
the
nature
RPE
representations
in
these
brain
areas.
Recently
developed
RL
models
allow
neurons
respond
differently
positive
negative
RPEs.
Here,
we
use
intracranially
recorded
high
frequency
(HFA)
test
whether
this
flexible
asymmetric
coding
strategy
captures
diversity
human
INS
dMPFC.
At
region
level,
found
a
bias
towards
RPEs
areas
which
paralleled
behavioral
adaptation.
local
spatially
interleaved
neural
populations
responding
valence-specific
Furthermore,
directional
connectivity
estimates
revealed
leading
role
communicating
These
findings
support
across
distinct
intermingled
as
core
principle
processing
inform
theories
dMPFC
Biological reviews/Biological reviews of the Cambridge Philosophical Society,
Год журнала:
2025,
Номер
unknown
Опубликована: Апрель 10, 2025
ABSTRACT
The
world
around
us
is
full
of
beauty.
Explaining
a
sense
the
beautiful
has
beguiled
philosophers
and
artists
for
millennia,
but
scientists
have
also
pondered
beauty,
most
notably
Darwin,
who
used
beauty
to
describe
sexual
ornaments
that
he
argued
were
subject
female
mate
choice.
In
doing
so,
ascribed
‘sense
beautiful’
non‐human
animals.
Darwin's
ideas
about
choice
not
widely
accepted,
however.
Humans
may
experience
assuming
same
other
animals
risks
anthropomorphism:
we
might
find
tail
peacock
be
beautiful,
there
no
reason
believe
peahens
do.
Moreover,
choice,
resurrected
as
an
object
serious
study
in
1970s,
simply
requires
attraction,
necessarily
However,
recent
advances
psychology
cognitive
neuroscience
are
providing
new,
mechanistic
framework
Here
take
these
findings
apply
them
evolutionary
biology.
First,
review
progress
human
empirical
aesthetics
provide
biological
definition
Central
this
discovery
merely
processing
information
can
hedonic
reward.
As
such,
propose
pleasure
fluent
processing,
independent
function
or
consummatory
reward
provided
by
stimulus
.
We
develop
context
three
key
attributes
(pleasure,
interaction,
disinterestedness)
psychological
distinction
between
‘wanting’
‘liking’.
Second,
show
how
provides
proximate
approach
studying
evolution
signalling
help
resolve
some
problems,
such
mating
biases
evolve.
situate
within
more
general
animal
signals,
suggesting
only
ornaments,
traits
diverse
aposematic
signals
camouflage.
Third,
outline
variety
experimental
approaches
test
whether
their
intended
receivers,
including
tests
fluency
impact
using
behavioural
neurological
approaches.
Brain Sciences,
Год журнала:
2025,
Номер
15(5), С. 507 - 507
Опубликована: Май 16, 2025
A
unified
theory
of
emotion
and
motivation
is
updated
in
which
motivational
states
are
instrumental
goal-directed
actions
performed
to
obtain
anticipated
rewards
or
avoid
punishers,
emotional
that
elicited
when
the
(conditioned
unconditioned)
reward
punisher
not
received.
This
advances
our
understanding
motivation,
for
same
set
genes
associated
brain
systems
can
define
primary
unlearned
punishers
such
as
a
sweet
taste
pain,
learn
expect
therefore
produce
states.
It
argued
under
control
goal
important
emotion,
because
they
require
an
intervening
state
action
learned
goal,
is,
reward,
punisher.
The
primate
including
human
orbitofrontal
cortex
computes
value,
anterior
cingulate
involved
learning
goal.
In
contrast,
response
overlearned
becomes
habit
with
stimulus-response
associations,
may
be
less
involved.
another
route
output,
has
effective
connectivity
inferior
frontal
gyrus
regions
language
provides
declarative
reports
about
subjective
produced.
Reasoning
provide
alternative
strategies
different
goals
compared
systems.
Hormones and Behavior,
Год журнала:
2024,
Номер
161, С. 105529 - 105529
Опубликована: Март 15, 2024
Central
to
the
navigation
of
an
ever-changing
environment
is
ability
form
positive
associations
with
places
and
conspecifics.
The
functions
location
social
conditioned
preferences
are
often
studied
independently,
limiting
our
understanding
their
interplay.
Furthermore,
a
de-emphasis
on
natural
has
led
neurobiological
interpretations
separated
from
ecological
context.
By
adopting
naturalistic
ethological
perspective,
we
uncover
complexities
underlying
expression
preferences.
Development
combination
motivation,
reward,
associative
learning,
context,
including
for
spatial
environments.
Both
social-
location-dependent
reward-responsive
behaviors
conditioning
rely
internal
state-gating
mechanisms
that
include
neuroendocrine
hormone
systems
such
as
opioids,
dopamine,
testosterone,
estradiol,
oxytocin.
Such
reinforced
behavior
emerges
integrating
past
experience
current
environmental
conditions.
Moreover,
stimuli,
state
gate
modulate
motivation
learning
via
shaping
process.
We
highlight
research
incorporating
these
concepts,
focusing
integration
behavioral
conditioning.
explore
three
paradigms:
1)
place
preference,
2)
3)
preference.
nonclassical
species
emphasize
applications
To
fully
appreciate
complex
information,
future
must
identify
neural
networks
where
endocrine
exert
influence
behaviors.
promises
provide
valuable
insights
into
within
broader