Behavioral and neurobiological mechanisms of pavlovian and instrumental extinction learning

Physiological Reviews, Journal Year: 2020, Volume and Issue: 101(2), P. 611 - 681

Published: Sept. 24, 2020

This article reviews the behavioral neuroscience of extinction, phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases strength when outcome reinforced it is removed. Behavioral research indicates neither nor operant extinction depends substantially on erasure original but instead new inhibitory primarily expressed context learned, as exemplified by renewal effect. Although nature inhibition may differ and either case decline responding depend both generalization decrement correction prediction error. At neural level, requires tripartite circuit involving amygdala, prefrontal cortex, hippocampus. Synaptic plasticity amygdala essential for learning, cortical neurons encoding fear memories involved retrieval. Hippocampal-prefrontal circuits mediate relapse phenomena, including renewal. Instrumental involves distinct ensembles corticostriatal, striatopallidal, striatohypothalamic well their thalamic returns (extinction) excitatory (renewal other phenomena) control over responding. The field made significant progress recent decades, although fully integrated biobehavioral understanding still awaits.

Language: Английский

---

Emotion, motivation, decision-making, the orbitofrontal cortex, anterior cingulate cortex, and the amygdala

Brain Structure and Function, Journal Year: 2023, Volume and Issue: 228(5), P. 1201 - 1257

Published: May 13, 2023

The orbitofrontal cortex and amygdala are involved in emotion motivation, but the relationship between these functions performed by brain structures is not clear. To address this, a unified theory of motivation described which motivational states instrumental goal-directed actions to obtain rewards or avoid punishers, emotional that elicited when reward punisher received. This greatly simplifies our understanding for same set genes associated systems can define primary unlearned punishers such as sweet taste pain. Recent evidence on connectivity human indicates value experienced with outputs cortical regions including those language, key region depression changes motivation. has weak effective back humans, implicated brainstem-mediated responses stimuli freezing autonomic activity, rather than declarative emotion. anterior cingulate learning rewards, ventromedial prefrontal providing goals navigation reward-related effects memory consolidation mediated partly via cholinergic system.

Language: Английский

---

Separate gut-brain circuits for fat and sugar reinforcement combine to promote overeating

Cell Metabolism, Journal Year: 2024, Volume and Issue: 36(2), P. 393 - 407.e7

Published: Jan. 18, 2024

Food is a powerful natural reinforcer that guides feeding decisions. The vagus nerve conveys internal sensory information from the gut to brain about nutritional value; however, cellular and molecular basis of macronutrient-specific reward circuits poorly understood. Here, we monitor in vivo calcium dynamics provide direct evidence independent vagal sensing pathways for detection dietary fats sugars. Using activity-dependent genetic capture neurons activated response infusions nutrients, demonstrate existence separate gut-brain fat sugar are necessary sufficient nutrient-specific reinforcement. Even when controlling calories, combined activation increases nigrostriatal dopamine release overeating compared with or alone. This work provides new insights into complex circuitry mediates motivated behavior suggests subconscious drive consume obesogenic diets (e.g., those high both sugar) may impede conscious dieting efforts.

Language: Английский

---

The mediodorsal thalamus in executive control

Neuron, Journal Year: 2024, Volume and Issue: 112(6), P. 893 - 908

Published: Jan. 30, 2024

Language: Английский

---

A neural mechanism for conserved value computations integrating information and rewards

Nature Neuroscience, Journal Year: 2024, Volume and Issue: 27(1), P. 159 - 175

Published: Jan. 1, 2024

Abstract Behavioral and economic theory dictate that we decide between options based on their values. However, humans animals eagerly seek information about uncertain future rewards, even when this does not provide any objective value. This implies decisions are made by endowing with subjective value integrating it the of extrinsic but mechanism is unknown. Here, show human monkey judgements obey strikingly conserved computational principles during multi-attribute trading off reward. We then identify a neural substrate in highly ancient structure, lateral habenula (LHb). LHb neurons signal value, information’s predicts causally influences ongoing decisions. Neurons key input areas to largely components these computations, integrated signals. Thus, our data uncover mechanisms computations underlying future.

Language: Английский

---

Reinforcement-learning in fronto-striatal circuits

Neuropsychopharmacology, Journal Year: 2021, Volume and Issue: 47(1), P. 147 - 162

Published: Aug. 5, 2021

Language: Английский

---

A cerebellar-thalamocortical pathway drives behavioral context-dependent movement initiation

Neuron, Journal Year: 2021, Volume and Issue: unknown

Published: June 1, 2021

Executing learned motor behaviors often requires the transformation of sensory cues into patterns commands that generate appropriately timed actions. The cerebellum and thalamus are two key areas involved in shaping cortical output movement, but contribution a cerebellar-thalamocortical pathway to voluntary movement initiation remains poorly understood. Here, we investigated how an auditory "go cue" transforms thalamocortical activity these changes relate initiation. Population responses dentate/interpositus-recipient regions reflect time-locked increase immediately prior is temporally uncoupled from go cue, indicative fixed-latency feedforward timing signal. Blocking cerebellar or thalamic suppresses initiation, while stimulation triggers movements behavioral context-dependent manner. Our findings show output, via thalamus, shapes necessary for

Language: Английский

---

A theory of actions and habits: The interaction of rate correlation and contiguity systems in free-operant behavior.

Psychological Review, Journal Year: 2020, Volume and Issue: 127(6), P. 945 - 971

Published: May 14, 2020

Contemporary theories of instrumental performance assume that responding can be controlled by 2 behavioral systems, 1 goal-directed encodes the outcome an action, and habitual reinforces response strength same action. Here we present a model free-operant behavior in which control is determined correlation between rates action whereas total prediction error generated contiguous reinforcement controls strength. The outputs these two systems summate to generate This cooperative addresses difference impact ratio interval schedules, transition from with extended training, persistence under choice procedures following extinction, among other phenomena. In respects, this dual-system unique its account behavior. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Language: Английский

---

As soon as there was life, there was danger: the deep history of survival behaviours and the shallower history of consciousness

Philosophical Transactions of the Royal Society B Biological Sciences, Journal Year: 2021, Volume and Issue: 377(1844)

Published: Dec. 27, 2021

It is often said that fear a universal innate emotion we humans have inherited from our mammalian ancestors by virtue of having conserved features their nervous systems. Contrary to this common sense-based scientific point view, I argued what ancestors, and they distal vertebrate chordate so forth, not circuit. is, instead, defensive survival circuit detects threats, in response, initiates behaviours supporting physiological adjustments. Seen light, the circuits other mammals can be conceptualized as manifestations an ancient function-the ability detect danger respond it-that may fact predate animals systems, perhaps go back beginning life. Fear, on hand, my perspective, product cortical cognitive circuits. This conception just academic interest. also has practical implications, offering clues why efforts treat problems related anxiety are more effective, might make them better. article part theme issue 'Systems neuroscience through lens evolutionary theory'.

Language: Английский

---

Local D2- to D1-neuron transmodulation updates goal-directed learning in the striatum

Science, Journal Year: 2020, Volume and Issue: 367(6477), P. 549 - 555

Published: Jan. 31, 2020

Extinction learning allows animals to withhold voluntary actions that are no longer related reward and so provides a major source of behavioral control. Although such is thought depend on dopamine signals in the striatum, way circuits mediate goal-directed control reorganized during new remains unknown. Here, by mapping dopamine-dependent transcriptional activation marker large ensembles spiny projection neurons (SPNs) expressing receptor type 1 (D1-SPNs) or 2 (D2-SPNs) mice, we demonstrate an extensive dynamic D2- D1-SPN transmodulation across striatum necessary for updating previous learning. Our findings suggest D2-SPNs suppress influence outdated plasticity within functionally relevant striatal territories reshape volitional action.

Language: Английский

---