Learning predictive cognitive maps with spiking neurons during behavior and replays

eLife, Journal Year: 2023, Volume and Issue: 12

Published: March 16, 2023

The hippocampus has been proposed to encode environments using a representation that contains predictive information about likely future states, called the successor representation. However, it is not clear how such could be learned in hippocampal circuit. Here, we propose plasticity rule can learn this map of environment spiking neural network. We connect biologically plausible reinforcement learning, mathematically and numerically showing implements TD-lambda algorithm. By spanning these different levels, show our framework naturally encompasses behavioral activity replays, smoothly moving from rate temporal coding, allows learning over timescales with acting on timescale milliseconds. discuss biological parameters as dwelling times at neuronal firing rates neuromodulation relate delay discounting parameter TD algorithm, they influence also find that, agreement psychological studies contrary theory, discount factor decreases hyperbolically time. Finally, suggests role for both aiding novel finding shortcut trajectories were experienced during behavior, experimental data.

Language: Английский

---

Human hippocampal and entorhinal neurons encode the temporal structure of experience

Nature, Journal Year: 2024, Volume and Issue: 635(8037), P. 160 - 167

Published: Sept. 25, 2024

Abstract Extracting the underlying temporal structure of experience is a fundamental aspect learning and memory that allows us to predict what likely happen next. Current knowledge about neural underpinnings this cognitive process in humans stems from functional neuroimaging research 1–5 . As these methods lack direct access neuronal level, it remains unknown how computed by neurons human brain. Here we record single individuals who have been implanted with intracranial electrodes for clinical reasons, show hippocampal entorhinal gradually modify their activity encode complex image presentation sequence. This representation was formed rapidly, without providing specific instructions participants, persisted when prescribed no longer present. Furthermore, recovered population hippocampal–entorhinal closely resembled structural graph defining sequence, but at same time, also reflected probability upcoming stimuli. Finally, sequence related spontaneous, time-compressed replay individual neurons’ corresponding previously experienced trajectories. These findings demonstrate hippocampus cortex integrate ‘what’ ‘when’ information extract durable predictive representations experience.

Language: Английский

---

The grid code for ordered experience

Nature reviews. Neuroscience, Journal Year: 2021, Volume and Issue: 22(10), P. 637 - 649

Published: Aug. 27, 2021

Language: Английский

---

Goal-oriented representations in the human hippocampus during planning and navigation

Nature Communications, Journal Year: 2023, Volume and Issue: 14(1)

Published: May 23, 2023

Abstract Recent work in cognitive and systems neuroscience has suggested that the hippocampus might support planning, imagination, navigation by forming maps capture abstract structure of physical spaces, tasks, situations. Navigation involves disambiguating similar contexts, planning execution a sequence decisions to reach goal. Here, we examine hippocampal activity patterns humans during goal-directed task investigate how contextual goal information are incorporated construction navigational plans. During pattern similarity is enhanced across routes share context navigation, observe prospective activation reflects retrieval related key-decision point. These results suggest that, rather than simply representing overlapping associations or state transitions, shaped goals.

Language: Английский

---

Centering cognitive neuroscience on task demands and generalization

Nature Neuroscience, Journal Year: 2024, Volume and Issue: 27(9), P. 1656 - 1667

Published: July 29, 2024

Language: Английский

---