Computational mechanisms of curiosity and goal-directed exploration

eLife, Journal Year: 2019, Volume and Issue: 8

Published: May 10, 2019

Successful behaviour depends on the right balance between maximising reward and soliciting information about world. Here, we show how different types of information-gain emerge when casting as surprise minimisation. We present two distinct mechanisms for goal-directed exploration that express separable profiles active sampling to reduce uncertainty. 'Hidden state' motivates agents sample unambiguous observations accurately infer (hidden) state Conversely, 'model parameter' exploration, compels outcomes associated with high uncertainty, if they are informative their representation task structure. illustrate emergence these information-gain, termed inference learning, forms induce patterns 'Bayes-optimal' behaviour. Our findings provide a computational framework understanding levels uncertainty systematically affect exploration-exploitation trade-off in decision-making.

Language: Английский

---

Words as social tools: Language, sociality and inner grounding in abstract concepts

Physics of Life Reviews, Journal Year: 2018, Volume and Issue: 29, P. 120 - 153

Published: Dec. 6, 2018

Language: Английский

---

Believing in dopamine

Nature reviews. Neuroscience, Journal Year: 2019, Volume and Issue: 20(11), P. 703 - 714

Published: Sept. 30, 2019

Language: Английский

---

The hierarchically mechanistic mind: A free-energy formulation of the human psyche

Physics of Life Reviews, Journal Year: 2019, Volume and Issue: 31, P. 104 - 121

Published: Jan. 10, 2019

This article presents a unifying theory of the embodied, situated human brain called Hierarchically Mechanistic Mind (HMM). The HMM describes as complex adaptive system that actively minimises decay our sensory and physical states by producing self-fulfilling action-perception cycles via dynamical interactions between hierarchically organised neurocognitive mechanisms. synthesises free-energy principle (FEP) in neuroscience with an evolutionary systems psychology explains brains, minds, behaviour appealing to Tinbergen's four questions: adaptation, phylogeny, ontogeny, mechanism. After leveraging FEP formally define across different spatiotemporal scales, we conclude exploring its implications for theorising research sciences mind behaviour.

Language: Английский

---

Theory of Event Coding (TEC) V2.0: Representing and controlling perception and action

Attention Perception & Psychophysics, Journal Year: 2019, Volume and Issue: 81(7), P. 2139 - 2154

Published: June 5, 2019

This article provides an update of the Theory Event Coding (TEC), which claims that perception and action are identical processes operating on same codes - event files consisting integrated networks sensorimotor feature codes. The original version theory emphasized its representational underpinnings, but recent theoretical developments provide basis for a more view both shared between in control these Four discussed detail: degree to integration retrieval depends current goals, how metacontrol states impact handling files, binding relates learning, non-social events social events. Case examples using various versions Simon task used explain new TEC explains interactions situations.

Language: Английский

---

A step-by-step tutorial on active inference and its application to empirical data

Journal of Mathematical Psychology, Journal Year: 2022, Volume and Issue: 107, P. 102632 - 102632

Published: Feb. 4, 2022

The active inference framework, and in particular its recent formulation as a partially observable Markov decision process (POMDP), has gained increasing popularity years useful approach for modeling neurocognitive processes. This framework is highly general flexible ability to be customized model any cognitive process, well simulate predicted neuronal responses based on accompanying neural theory. It also affords both simulation experiments proof of principle behavioral empirical studies. However, there are limited resources that explain how build run these models practice, which limits their widespread use. Most introductions assume technical background programming, mathematics, machine learning. In this paper we offer step-by-step tutorial POMDPs, simulations using standard MATLAB routines, fit data. We minimal programming thoroughly all equations, provide exemplar scripts can theoretical Our goal the reader with requisite knowledge practical tools apply own research. optional sections multiple appendices, interested additional details. should necessary use follow emerging advances

Language: Английский

---

Neuroimaging the consciousness of self: Review, and conceptual-methodological framework

Neuroscience & Biobehavioral Reviews, Journal Year: 2020, Volume and Issue: 112, P. 164 - 212

Published: Jan. 26, 2020

We review neuroimaging research investigating self-referential processing (SRP), that is, how we respond to stimuli reference ourselves, prefaced by a lexical-thematic analysis of words indicative "self-feelings". consider SRP as occurring verbally (V-SRP) and non-verbally (NV-SRP), both in the controlled, "top-down" form introspective interoceptive tasks, respectively, well "bottom-up" spontaneous or automatic "mind wandering" "body occurs during resting state. Our leads us outline conceptual methodological framework for future briefly apply toward understanding certain psychological neurological disorders symptomatically associated with abnormal SRP. discussion is partly guided William James' original writings on consciousness self.

Language: Английский

---

The secret life of predictive brains: what’s spontaneous activity for?

Trends in Cognitive Sciences, Journal Year: 2021, Volume and Issue: 25(9), P. 730 - 743

Published: June 16, 2021

Language: Английский

---

Interoception of breathing and its relationship with anxiety

Neuron, Journal Year: 2021, Volume and Issue: 109(24), P. 4080 - 4093.e8

Published: Oct. 22, 2021

Interoception, the perception of internal bodily states, is thought to be inextricably linked affective qualities such as anxiety. Although interoception spans sensory metacognitive processing, it not clear whether anxiety differentially related these processing levels. Here we investigated this question in domain breathing, using computational modeling and high-field (7 T) fMRI assess brain activity relating dynamic changes inspiratory resistance varying predictability. Notably, anterior insula was associated with both breathing-related prediction certainty errors, suggesting an important role representing updating models body. Individuals low versus moderate traits showed differential for certainty. Multi-modal analyses data from fMRI, assessments metacognition, questionnaires demonstrated that anxiety-interoception links span all levels perceptual sensitivity strong effects seen at higher interoceptive processes.

Language: Английский

---

Simulating homeostatic, allostatic and goal-directed forms of interoceptive control using active inference

Biological Psychology, Journal Year: 2022, Volume and Issue: 169, P. 108266 - 108266

Published: Jan. 17, 2022

Language: Английский

---