Cognitive mechanisms of learning in sequential decision-making under uncertainty: an experimental and theoretical approach

Frontiers in Behavioral Neuroscience, Journal Year: 2024, Volume and Issue: 18

Published: Aug. 12, 2024

Learning to make adaptive decisions involves making choices, assessing their consequence, and leveraging this assessment attain higher rewarding states. Despite vast literature on value-based decision-making, relatively little is known about the cognitive processes underlying in highly uncertain contexts. Real world are rarely accompanied by immediate feedback, explicit rewards, or complete knowledge of environment. Being able informed such contexts requires significant environment, which can only be gained via exploration. Here we aim at understanding formalizing brain mechanisms these processes. To end, first designed performed an experimental task. Human participants had learn maximize reward while sequences with basic absence performance cues. Participants rely own internal reveal a covert relationship between choices subsequent consequences find strategy leading highest cumulative reward. Our results show that participants’ reaction times were longer whenever decision involved future suggesting greater introspection delayed value considered. The learning time varied significantly across participants. Second, formalized neurocognitive decision-making within task, combining mean-field representations competing neural populations reinforcement mechanism. This model provided plausible characterization dynamics processes, reproduced each aspect behavior, from rates. In summary, both provide principled explanation how may computed incorporated into occurs scenarios.

Language: Английский

---

Task goals shape the relationship between decision and movement speed

Journal of Neurophysiology, Journal Year: 2024, Volume and Issue: 132(6), P. 1837 - 1856

Published: Nov. 6, 2024

The speed at which we move is linked to the decide make these movements. Yet principles guiding such relationship remain unclear: whereas some studies point toward a shared invigoration process boosting decision and movement jointly, others rather indicate trade-off between both levels of control, with slower movements accompanying faster decisions. Here, aimed

Language: Английский

---

Integrated control of non-motor and motor efforts during perceptual decision-making and action execution: a pilot study

Scientific Reports, Journal Year: 2023, Volume and Issue: 13(1)

Published: June 8, 2023

Humans daily life is characterized by a succession of voluntary actions. Since energy resources are limited, the ability to invest appropriate amount effort for selecting and executing these actions hallmark adapted behavior. Recent studies indicate that decisions share important principles, including optimization their duration when context requires it. In present pilot study, we test hypothesis management effort-related shared between decision action too. Healthy human subjects performed perceptual task where they had choose two levels in making (i.e. difficulty), report it with reaching movement. Crucially, movement accuracy requirement gradually increased from trial depending on participants' performance. Results an overall moderate non-significant impact increasing motor difficulty choice non-motor (decision) each By contrast, performance strongly decreased both decisional difficulties. Together, results support integrated action. They also suggest task, mutualized primarily allocated decision-making process detriment movements.

Language: Английский

---

Task goals shape the relationship between decision and movement speed

bioRxiv (Cold Spring Harbor Laboratory), Journal Year: 2023, Volume and Issue: unknown

Published: Dec. 30, 2023

The speed at which we move is linked to the decide make these movements. Yet, principles guiding such relationship remain unclear: while some studies point towards a shared invigoration process boosting decision and movement jointly, others rather indicate tradeoff between both levels of control, with slower movements accompanying faster decisions. Here, aimed (1) further investigating existence linking (2) testing hypothesis that link masked when detrimental reward rate. To this aim, tested 62 subjects who performed tokens task in two experiments (separate sessions): Experiment 1 evaluated how changing affects 2 assessed speed. In latter experiment, were either encouraged favor (fast group) or accuracy (slow group). Various mixed model analyses revealed coregulation (urgency) fast group 2, but not slow despite fact same displayed effect 1. Altogether, our findings support idea occurs as default mode form control diminished supplanted by relationship, contingent on rate maximization. Drawing from behavioral observations, propose multiple processes contribute shaping decisions

Language: Английский

---

Concepts as an Interface

Oxford University Press eBooks, Journal Year: 2024, Volume and Issue: unknown, P. 117 - 154

Published: Aug. 9, 2024

Abstract Concepts act as an interface between general-purpose conceptual thought and special-purpose informational models. A concept is a ‘plug-and-play’ device connecting deliberative thinking to simulations in sensory, motor, affective, evaluative systems. Concept-driven starts with conceptually structured thought. This drives the construction of ‘suppositional scenario’—an interconnected representation situation built up using For example, ‘will chair fit my car?’ prompts mental simulation assessing spatial configurations. Conclusions are expressed back facilitate this working memory labels that sustain manipulate representations, while also plugging into compositional structures for content-general composition reasoning. gives concepts crucial interfacing role. Evidence supports providing such access, combination control. framework explains power human thought—flexibly combining construct integrated scenarios from which new conclusions can be drawn.

Language: Английский

---