Neural Circuitry of Reward Prediction Error

Annual Review of Neuroscience, Год журнала: 2017, Номер 40(1), С. 373 - 394

Опубликована: Апрель 25, 2017

Dopamine neurons facilitate learning by calculating reward prediction error, or the difference between expected and actual reward. Despite two decades of research, it remains unclear how dopamine make this calculation. Here we review studies that tackle problem from a diverse set approaches, anatomy to electrophysiology computational modeling behavior. Several patterns emerge synthesis: themselves calculate rather than inherit passively upstream regions; they combine multiple separate redundant inputs, which are interconnected in dense recurrent network; despite complexity output is remarkably homogeneous robust. The more study simple arithmetic computation, knottier appears be, suggesting daunting (but stimulating) path ahead for neuroscience generally.

Язык: Английский

---

Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli

Nature Neuroscience, Год журнала: 2018, Номер 21(10), С. 1421 - 1430

Опубликована: Авг. 21, 2018

Язык: Английский

---

Activity patterns of serotonin neurons underlying cognitive flexibility

eLife, Год журнала: 2017, Номер 6

Опубликована: Март 21, 2017

Serotonin is implicated in mood and affective disorders. However, growing evidence suggests that a core endogenous role to promote flexible adaptation changes the causal structure of environment, through behavioral inhibition enhanced plasticity. We used long-term photometric recordings mice study population dorsal raphe serotonin neurons, whose activity we could link normal reversal learning using pharmacogenetics. found these neurons are activated by both positive negative prediction errors, thus report signals similar those proposed conditions uncertainty. Furthermore, comparing cue responses dopamine differences rates explain importance inhibiting perseverative responding. Our findings show how patterns support cognitive flexibility, suggest revised model dopamine-serotonin opponency with potential clinical implications.

Язык: Английский

---

Believing in dopamine

Nature reviews. Neuroscience, Год журнала: 2019, Номер 20(11), С. 703 - 714

Опубликована: Сен. 30, 2019

Язык: Английский

---

Functional dissociation of stimulus intensity encoding and predictive coding of pain in the insula

eLife, Год журнала: 2017, Номер 6

Опубликована: Май 19, 2017

The computational principles by which the brain creates a painful experience from nociception are still unknown. Classic theories suggest that cortical regions either reflect stimulus intensity or additive effects of and expectations, respectively. By contrast, predictive coding provide unified framework explaining how perception is shaped integration beliefs about world with mismatches resulting comparison these against sensory input. Using functional magnetic resonance imaging during probabilistic heat pain paradigm, we investigated computations underlie perception. Skin conductance, pupil dilation, anterior insula responses to cued stimuli strictly followed response patterns hypothesized model, whereas posterior encoded intensity. This novel dissociation processing within together previously observed alterations in chronic offer interpretation aberrant as disturbed weighting predictions prediction errors.

Язык: Английский

---

Dopamine neurons drive fear extinction learning by signaling the omission of expected aversive outcomes

eLife, Год журнала: 2018, Номер 7

Опубликована: Ноя. 13, 2018

Extinction of fear responses is critical for adaptive behavior and deficits in this form safety learning are hallmark anxiety disorders. However, the neuronal mechanisms that initiate extinction largely unknown. Here we show, using single-unit electrophysiology cell-type specific fiber photometry, dopamine neurons ventral tegmental area (VTA) activated by omission aversive unconditioned stimulus (US) during extinction. This signal occurred specifically beginning when US unexpected, correlated strongly with learning. Furthermore, temporally-specific optogenetic inhibition or excitation at time revealed both necessary for, sufficient to accelerate, normal These results identify a prediction error-like reveal crucial role DA

Язык: Английский

---

A Model for Basic Emotions Using Observations of Behavior in Drosophila

Frontiers in Psychology, Год журнала: 2019, Номер 10

Опубликована: Апрель 24, 2019

Emotion plays a crucial role, both in general human experience and psychiatric illnesses. Despite the importance of emotion, relative lack objective methodologies to scientifically studying emotional phenomena limits our current understanding thereby calls for development novel methodologies, such us study illustrative animal models. Analysis Drosophila other insects has unlocked new opportunities elucidate behavioral phenotypes fundamentally phenomena. Here we propose an integrative model basic emotions based on observations this model. The are internal states that modulated by neuromodulators, these externally expressed as certain stereotypical behaviors, instinct, which is proposed ancient mechanisms survival. There four kinds emotions: happiness, sadness, fear anger, differentially associated with three core affects: reward (happiness), punishment (sadness), stress (fear anger). These affects analogous primary colors (red, yellow, blue) they combined various proportions result more complex "higher order" emotions, love aesthetic emotion. We refer called "Three Primary Color Model Basic Emotions".

Язык: Английский

---

State-specific gating of salient cues by midbrain dopaminergic input to basal amygdala

Nature Neuroscience, Год журнала: 2019, Номер 22(11), С. 1820 - 1833

Опубликована: Окт. 14, 2019

Язык: Английский

---

VTA dopamine neuron activity encodes social interaction and promotes reinforcement learning through social prediction error

Nature Neuroscience, Год журнала: 2021, Номер 25(1), С. 86 - 97

Опубликована: Дек. 2, 2021

Язык: Английский

---

A feature-specific prediction error model explains dopaminergic heterogeneity

Nature Neuroscience, Год журнала: 2024, Номер 27(8), С. 1574 - 1586

Опубликована: Июль 3, 2024

Язык: Английский

---