Neural Circuitry of Reward Prediction Error

Annual Review of Neuroscience, Journal Year: 2017, Volume and Issue: 40(1), P. 373 - 394

Published: April 25, 2017

Dopamine neurons facilitate learning by calculating reward prediction error, or the difference between expected and actual reward. Despite two decades of research, it remains unclear how dopamine make this calculation. Here we review studies that tackle problem from a diverse set approaches, anatomy to electrophysiology computational modeling behavior. Several patterns emerge synthesis: themselves calculate rather than inherit passively upstream regions; they combine multiple separate redundant inputs, which are interconnected in dense recurrent network; despite complexity output is remarkably homogeneous robust. The more study simple arithmetic computation, knottier appears be, suggesting daunting (but stimulating) path ahead for neuroscience generally.

Language: Английский

---

Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli

Nature Neuroscience, Journal Year: 2018, Volume and Issue: 21(10), P. 1421 - 1430

Published: Aug. 21, 2018

Language: Английский

---

Activity patterns of serotonin neurons underlying cognitive flexibility

eLife, Journal Year: 2017, Volume and Issue: 6

Published: March 21, 2017

Serotonin is implicated in mood and affective disorders. However, growing evidence suggests that a core endogenous role to promote flexible adaptation changes the causal structure of environment, through behavioral inhibition enhanced plasticity. We used long-term photometric recordings mice study population dorsal raphe serotonin neurons, whose activity we could link normal reversal learning using pharmacogenetics. found these neurons are activated by both positive negative prediction errors, thus report signals similar those proposed conditions uncertainty. Furthermore, comparing cue responses dopamine differences rates explain importance inhibiting perseverative responding. Our findings show how patterns support cognitive flexibility, suggest revised model dopamine-serotonin opponency with potential clinical implications.

Language: Английский

---

Believing in dopamine

Nature reviews. Neuroscience, Journal Year: 2019, Volume and Issue: 20(11), P. 703 - 714

Published: Sept. 30, 2019

Language: Английский

---

Functional dissociation of stimulus intensity encoding and predictive coding of pain in the insula

eLife, Journal Year: 2017, Volume and Issue: 6

Published: May 19, 2017

The computational principles by which the brain creates a painful experience from nociception are still unknown. Classic theories suggest that cortical regions either reflect stimulus intensity or additive effects of and expectations, respectively. By contrast, predictive coding provide unified framework explaining how perception is shaped integration beliefs about world with mismatches resulting comparison these against sensory input. Using functional magnetic resonance imaging during probabilistic heat pain paradigm, we investigated computations underlie perception. Skin conductance, pupil dilation, anterior insula responses to cued stimuli strictly followed response patterns hypothesized model, whereas posterior encoded intensity. This novel dissociation processing within together previously observed alterations in chronic offer interpretation aberrant as disturbed weighting predictions prediction errors.

Language: Английский

---

Dopamine neurons drive fear extinction learning by signaling the omission of expected aversive outcomes

eLife, Journal Year: 2018, Volume and Issue: 7

Published: Nov. 13, 2018

Extinction of fear responses is critical for adaptive behavior and deficits in this form safety learning are hallmark anxiety disorders. However, the neuronal mechanisms that initiate extinction largely unknown. Here we show, using single-unit electrophysiology cell-type specific fiber photometry, dopamine neurons ventral tegmental area (VTA) activated by omission aversive unconditioned stimulus (US) during extinction. This signal occurred specifically beginning when US unexpected, correlated strongly with learning. Furthermore, temporally-specific optogenetic inhibition or excitation at time revealed both necessary for, sufficient to accelerate, normal These results identify a prediction error-like reveal crucial role DA

Language: Английский

---

A Model for Basic Emotions Using Observations of Behavior in Drosophila

Frontiers in Psychology, Journal Year: 2019, Volume and Issue: 10

Published: April 24, 2019

Emotion plays a crucial role, both in general human experience and psychiatric illnesses. Despite the importance of emotion, relative lack objective methodologies to scientifically studying emotional phenomena limits our current understanding thereby calls for development novel methodologies, such us study illustrative animal models. Analysis Drosophila other insects has unlocked new opportunities elucidate behavioral phenotypes fundamentally phenomena. Here we propose an integrative model basic emotions based on observations this model. The are internal states that modulated by neuromodulators, these externally expressed as certain stereotypical behaviors, instinct, which is proposed ancient mechanisms survival. There four kinds emotions: happiness, sadness, fear anger, differentially associated with three core affects: reward (happiness), punishment (sadness), stress (fear anger). These affects analogous primary colors (red, yellow, blue) they combined various proportions result more complex "higher order" emotions, love aesthetic emotion. We refer called "Three Primary Color Model Basic Emotions".

Language: Английский

---

State-specific gating of salient cues by midbrain dopaminergic input to basal amygdala

Nature Neuroscience, Journal Year: 2019, Volume and Issue: 22(11), P. 1820 - 1833

Published: Oct. 14, 2019

Language: Английский

---

VTA dopamine neuron activity encodes social interaction and promotes reinforcement learning through social prediction error

Nature Neuroscience, Journal Year: 2021, Volume and Issue: 25(1), P. 86 - 97

Published: Dec. 2, 2021

Language: Английский

---

A feature-specific prediction error model explains dopaminergic heterogeneity

Nature Neuroscience, Journal Year: 2024, Volume and Issue: 27(8), P. 1574 - 1586

Published: July 3, 2024

Language: Английский

---