Does the notion of intrinsic reward explain context-dependent valuation in reinforcement learning? DOI Open Access
Sophie Bavard, Stefano Palminteri

Опубликована: Янв. 17, 2024

Does the notion of intrinsic reward explain context-dependent valuation in reinforcement learning? A comment on Molinaro & Collins, 2023 - Intrinsic rewards context-sensitive learning; https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3002201

Язык: Английский

Curiosity and the dynamics of optimal exploration DOI Creative Commons
Francesco Poli, Jill X. O’Reilly, Rogier B. Mars

и другие.

Trends in Cognitive Sciences, Год журнала: 2024, Номер 28(5), С. 441 - 453

Опубликована: Фев. 26, 2024

What drives our curiosity remains an elusive and hotly debated issue, with multiple hypotheses proposed but a cohesive account yet to be established. This review discusses traditional emergent theories that frame as desire know drive learn, respectively. We adopt model-based approach maps the temporal dynamics of various factors underlying curiosity-based exploration, such uncertainty, information gain, learning progress. In so doing, we identify limitations past posit integrated harnesses their strengths in describing tool for optimal environmental exploration. unified account, serves 'common currency' which must balanced other safety hunger achieve efficient action.

Язык: Английский

Процитировано

22

Goal commitment is supported by vmPFC through selective attention DOI Creative Commons
Eleanor Holton, Jan Grohn, Harry Ward

и другие.

Nature Human Behaviour, Год журнала: 2024, Номер unknown

Опубликована: Апрель 17, 2024

When striking a balance between commitment to goal and flexibility in the face of better options, people often demonstrate strong perseveration. Here, using functional MRI (n = 30) lesion patient 26) studies, we argue that ventromedial prefrontal cortex (vmPFC) drives linked changes goal-directed selective attention. Participants performed an incremental pursuit task involving sequential decisions persisting with versus abandoning progress for alternative options. Individuals stronger perseveration showed higher attention interleaved task. Increasing also affected abandonment decisions: while pursuing goal, lost their sensitivity valuable goals remaining more sensitive current goal. In healthy population, individual differences both biases goal-oriented were predicted by baseline goal-related activity vmPFC. Among patients, vmPFC damage reduced commitment, leading performance benefit.

Язык: Английский

Процитировано

9

Fundamental processes in sensorimotor learning: Reasoning, refinement, and retrieval DOI Creative Commons
Jonathan S. Tsay, Hyosub E. Kim, Samuel D. McDougle

и другие.

eLife, Год журнала: 2024, Номер 13

Опубликована: Авг. 1, 2024

Motor learning is often viewed as a unitary process that operates outside of conscious awareness. This perspective has led to the development sophisticated models designed elucidate mechanisms implicit sensorimotor learning. In this review, we argue for broader perspective, emphasizing contribution explicit strategies tasks. Furthermore, propose theoretical framework motor consists three fundamental processes: reasoning, understanding action–outcome relationships; refinement, optimizing and cognitive parameters achieve goals; retrieval, inferring context recalling control policy. We anticipate ‘3R’ how complex movements are learned will open exciting avenues future research at intersection between cognition action.

Язык: Английский

Процитировано

9

Fundamental processes in sensorimotor learning: Reasoning, Refinement, and Retrieval DOI Open Access
Jonathan S. Tsay, Hyosub E. Kim, Samuel D. McDougle

и другие.

Опубликована: Авг. 2, 2023

[Now published in eLife: https://elifesciences.org/articles/91839] Motor learning is often viewed as a unitary process that operates outside of conscious awareness. This perspective has led to the development sophisticated models designed elucidate mechanisms implicit sensorimotor learning. In this review we argue for broader perspective, emphasizing contribution explicit strategies tasks. Furthermore, propose theoretical framework motor consists three fundamental processes: Reasoning, understanding action-outcome relationships; Refinement, optimizing and cognitive parameters achieve goals; Retrieval, inferring context recalling control policy. We anticipate “3R” how complex movements are learned will open exciting avenues future research at intersection between cognition action.

Язык: Английский

Процитировано

15

The affective gradient hypothesis: an affect-centered account of motivated behavior DOI
Amitai Shenhav

Trends in Cognitive Sciences, Год журнала: 2024, Номер unknown

Опубликована: Сен. 1, 2024

Язык: Английский

Процитировано

6

From tripping and falling to ruminating and worrying: a meta-control account of repetitive negative thinking DOI Creative Commons

Peter F Hitchcock,

Michael J. Frank

Current Opinion in Behavioral Sciences, Год журнала: 2024, Номер 56, С. 101356 - 101356

Опубликована: Фев. 16, 2024

Язык: Английский

Процитировано

4

Neurocomputational model of compulsivity: deviating from an uncertain goal-directed system DOI Creative Commons
Taekwan Kim, Sang Wan Lee, Silvia Kyungjin Lho

и другие.

Brain, Год журнала: 2024, Номер 147(6), С. 2230 - 2244

Опубликована: Апрель 8, 2024

Despite a theory that an imbalance in goal-directed versus habitual systems serve as building blocks of compulsions, research has yet to delineate how this occurs during arbitration between the two obsessive-compulsive disorder. Inspired by brain model which inferior frontal cortex selectively gates putamen guide or actions, study aimed examine whether disruptions process via fronto-striatal circuit would underlie imbalanced decision-making and compulsions patients. Thirty patients with disorder [mean (standard deviation) age = 26.93 (6.23) years, 12 females (40%)] 30 healthy controls 24.97 (4.72) 17 (57%)] underwent functional MRI scans while performing two-step Markov decision task, was designed dissociate behaviour from behaviour. We employed neurocomputational account for uncertainty-based process, prefrontal arbitrator (i.e. gyrus) allocates behavioural control more reliable strategy gating putamen. analysed group differences neural estimates uncertainty each strategy. also compared psychophysiological interaction effects system preference (goal-directed habitual) on coupling groups. examined correlation compulsivity score activity connectivity involved process. The computational captured subjects' preferences strategies. Compared controls, had stronger (t -2.88, P 0.006), attributed uncertain 2.72, 0.009). Before allocation exhibited hypoactivity gyrus when region tracked inverse reliability) (P 0.001, family-wise error rate corrected). When reorienting behaviours reach specific goals, weaker right ipsilateral ventrolateral prefronto-putamen than This hypoconnectivity correlated severe (r -0.57, 0.002). Our findings suggest attenuated top-down underlies Enhancing may be potential neurotherapeutic approach adaptive decision-making.

Язык: Английский

Процитировано

4

Motivational context determines the impact of aversive outcomes on mental effort allocation DOI
Mahalia Prater Fahey, Debbie Yee, Xiamin Leng

и другие.

Cognition, Год журнала: 2024, Номер 254, С. 105973 - 105973

Опубликована: Окт. 15, 2024

Язык: Английский

Процитировано

4

Goals as reward-producing programs DOI
Guy Davidson, Graham Todd,

Julian Togelius

и другие.

Nature Machine Intelligence, Год журнала: 2025, Номер 7(2), С. 205 - 220

Опубликована: Фев. 21, 2025

Язык: Английский

Процитировано

0

Spontaneous thought as play: the value of fictional goals in the default mode network DOI Creative Commons
Gaia Molinaro, Moshe Bar

Current Opinion in Behavioral Sciences, Год журнала: 2025, Номер 63, С. 101504 - 101504

Опубликована: Март 11, 2025

Язык: Английский

Процитировано

0