Spontaneous behaviour is structured by reinforcement without explicit reward

Nature, Год журнала: 2023, Номер 614(7946), С. 108 - 117

Опубликована: Янв. 18, 2023

Abstract Spontaneous animal behaviour is built from action modules that are concatenated by the brain into sequences 1,2 . However, neural mechanisms guide composition of naturalistic, self-motivated remain unknown. Here we show dopamine systematically fluctuates in dorsolateral striatum (DLS) as mice spontaneously express sub-second behavioural modules, despite absence task structure, sensory cues or exogenous reward. Photometric recordings and calibrated closed-loop optogenetic manipulations during open field demonstrate DLS fluctuations increase sequence variation over seconds, reinforce use associated minutes, modulate vigour with which expressed, without directly influencing movement initiation moment-to-moment kinematics. Although reinforcing effects vary across individual mice, these differences well predicted observed relationships between endogenous module use. Consistent possibility act a teaching signal, build exploration if to maximize dopamine. Together, findings suggest model same circuits computations govern choices structured tasks have key role sculpting content unconstrained, high-dimensional, spontaneous behaviour.

Язык: Английский

---

Unique functional responses differentially map onto genetic subtypes of dopamine neurons

Nature Neuroscience, Год журнала: 2023, Номер 26(10), С. 1762 - 1774

Опубликована: Авг. 3, 2023

Abstract Dopamine neurons are characterized by their response to unexpected rewards, but they also fire during movement and aversive stimuli. neuron diversity has been observed based on molecular expression profiles; however, whether different functions map onto such genetic subtypes remains unclear. In this study, we established that three dopamine within the substantia nigra pars compacta, of Slc17a6 ( Vglut2 ), Calb1 Anxa1 , each have a unique set responses stimuli accelerations decelerations, these signaling patterns highly correlated between somas axons subtypes. Remarkably, reward were almost entirely absent in + subtype, which instead displayed acceleration-correlated signaling. Our findings establish connection functional demonstrate can serve as common framework dissect dopaminergic functions.

Язык: Английский

---

Reward signals in the cerebellum: Origins, targets, and functional implications

Neuron, Год журнала: 2022, Номер 110(8), С. 1290 - 1303

Опубликована: Март 23, 2022

Язык: Английский

---

Dopamine transients follow a striatal gradient of reward time horizons

Nature Neuroscience, Год журнала: 2024, Номер 27(4), С. 737 - 746

Опубликована: Фев. 6, 2024

Abstract Animals make predictions to guide their behavior and update those through experience. Transient increases in dopamine (DA) are thought be critical signals for updating predictions. However, it is unclear how this mechanism handles a wide range of behavioral timescales—from seconds or less (for example, if singing song) potentially hours more hunting food). Here we report that DA transients distinct rat striatal subregions convey prediction errors based on time horizons. dynamics systematically accelerated from ventral dorsomedial dorsolateral striatum, the tempo spontaneous fluctuations, temporal integration prior rewards discounting future rewards. This spectrum timescales evaluative computations can help achieve efficient learning adaptive motivation broad behaviors.

Язык: Английский

---

A feature-specific prediction error model explains dopaminergic heterogeneity

Nature Neuroscience, Год журнала: 2024, Номер 27(8), С. 1574 - 1586

Опубликована: Июль 3, 2024

Язык: Английский

---

State and rate-of-change encoding in parallel mesoaccumbal dopamine pathways

Nature Neuroscience, Год журнала: 2024, Номер 27(2), С. 309 - 318

Опубликована: Янв. 11, 2024

Язык: Английский

---

Striatal dopamine signals reflect perceived cue–action–outcome associations in mice

Nature Neuroscience, Год журнала: 2024, Номер 27(4), С. 747 - 757

Опубликована: Янв. 30, 2024

Abstract Striatal dopamine drives associative learning by acting as a teaching signal. Much work has focused on simple paradigms, including Pavlovian and instrumental learning. However, higher cognition requires that animals generate internal concepts of their environment, where sensory stimuli, actions outcomes become flexibly associated. Here, we performed fiber photometry measurements across the striatum male mice they learned cue–action–outcome associations based implicit changing task rules. Reinforcement models behavioral data showed rule changes lead to adjustments associations. After changes, discarded reset outcome expectations. Cue- outcome-triggered signals became uncoupled dependent adopted strategy. As new association, coupling between cue- performance re-emerged. Our results suggest dopaminergic reward prediction errors reflect an agent’s perceived locus control.

Язык: Английский

---

A hypothalamic circuit underlying the dynamic control of social homeostasis

Nature, Год журнала: 2025, Номер unknown

Опубликована: Фев. 26, 2025

Abstract Social grouping increases survival in many species, including humans 1,2 . By contrast, social isolation generates an aversive state (‘loneliness’) that motivates seeking and heightens interaction upon reunion 3–5 The observed rebound triggered by suggests a homeostatic process underlying the control of need, similar to physiological drives such as hunger, thirst or sleep 3,6 In this study, we assessed responses several mouse strains, among which FVB/NJ mice emerged highly, C57BL/6J moderately, sensitive isolation. Using both uncovered two previously uncharacterized neuronal populations hypothalamic preoptic nucleus are activated during either orchestrate behaviour display need satiety, respectively. We identified direct connectivity between these with brain areas associated behaviour, emotional state, reward needs showed require touch assess presence others fulfil their need. These data show brain-wide neural system homeostasis provide significant mechanistic insights into nature function circuits controlling instinctive for understanding healthy diseased states context.

Язык: Английский

---

Dopamine in the tail of the striatum facilitates avoidance in threat–reward conflicts

Nature Neuroscience, Год журнала: 2025, Номер unknown

Опубликована: Март 10, 2025

Responding appropriately to potential threats before they materialize is critical avoiding disastrous outcomes. Here we examine how threat-coping behavior regulated by the tail of striatum (TS) and its dopamine input. Mice were presented with a threat (a moving object) while pursuing rewards. Initially, mice failed obtain rewards but gradually improved in later trials. We found that TS promoted avoidance threat, even at expense reward acquisition. Furthermore, activity D1 receptor-expressing neurons prediction. In contrast, D2 suppressed facilitated overcoming threat. Dopamine axon activation not only potentiated responses novel sensory stimuli also boosted them acutely. These results demonstrate an opponent interaction TS, modulated dopamine, dynamically regulates threats. During foraging threat–reward conflicts mice, modulates two competing neuron types for flexible coping, from initial eventual

Язык: Английский

---

A gradual temporal shift of dopamine responses mirrors the progression of temporal difference error in machine learning

Nature Neuroscience, Год журнала: 2022, Номер 25(8), С. 1082 - 1092

Опубликована: Июль 7, 2022

Язык: Английский

---