Real-World Scanpaths Exhibit Long-Term Temporal Dependencies: Considerations for Contextual AI for AR Applications DOI
Charlie S. Burlingham, Naveen Sendhilnathan, Xiuyun Wu

и другие.

Опубликована: Май 31, 2024

All-day augmented reality (AR) requires contextually-aware artificial intelligence (AI) models that excel across diverse daily contexts. Eye tracking could be a key source of information about user context and intention. However, such using gaze sometimes struggle to outperform egocentric video-based baseline models. We propose learning representations scanpath history in perceptually-relevant state space may solve this problem. scanpaths are often assumed obey Markovian assumption, i.e., only the current previous fixation matter. In study (30 participants; 26.2 hours total), we analyzed during nine everyday tasks identified long-term temporal dependencies, with an average timescale four fixations (2 seconds) into past (i.e., violating assumption). discovered substantial task-specific variations these dependencies. This confirms contain stereotyped "motifs" context-dependent lengths/timescales. discuss implications for designing contextual AI AR applications.

Язык: Английский

Coupling of pupil- and neuronal population dynamics reveals diverse influences of arousal on cortical processing DOI Creative Commons
Thomas Pfeffer, Christian Keitel, Daniel S. Kluger

и другие.

eLife, Год журнала: 2022, Номер 11

Опубликована: Фев. 8, 2022

Fluctuations in arousal, controlled by subcortical neuromodulatory systems, continuously shape cortical state, with profound consequences for information processing. Yet, how arousal signals influence population activity detail has so far only been characterized a few selected brain regions. Traditional accounts conceptualize as homogeneous modulator of neural across the cerebral cortex. Recent insights, however, point to higher specificity effects on different components and Here, we provide comprehensive account relationships between fluctuations neuronal human brain. Exploiting established link pupil size central performed concurrent magnetoencephalographic (MEG) pupillographic recordings large number participants, pooled three laboratories. We found cascade relative peak timing spontaneous dilations: Decreases low-frequency (2–8 Hz) temporal lateral frontal cortex, followed increased high-frequency (>64 mid-frontal regions, monotonic inverted U intermediate frequency-range (8–32 occipito-parietal Pupil-linked also coincided widespread changes structure aperiodic component activity, indicative excitation-inhibition balance underlying microcircuits. Our results novel basis studying modulation cognitive computations circuits.

Язык: Английский

Процитировано

68

Cognitive processing of a common stimulus synchronizes brains, hearts, and eyes DOI Creative Commons
Jens Madsen, Lucas C. Parra

PNAS Nexus, Год журнала: 2022, Номер 1(1)

Опубликована: Март 1, 2022

Neural, physiological, and behavioral signals synchronize between human subjects in a variety of settings. Multiple hypotheses have been proposed to explain this interpersonal synchrony, but there is no clarity under which conditions it arises, for signals, or whether common underlying mechanism. We hypothesized that cognitive processing shared stimulus the source synchrony subjects, measured here as intersubject correlation (ISC). To test this, we presented informative videos participants an attentive distracted condition subsequently information recall. ISC was observed electro-encephalography, gaze position, pupil size, heart rate, not respiration head movements. The strength co-modulated different changed with attentional state, predicted subsequent recall videos. There robust within-subject coupling brain, heart, eyes, results suggest result effective processing, thus emerges only those exhibit brain-body connection. While physiological fluctuations may be driven by multiple features stimulus, other individuals level engagement stimulus.

Язык: Английский

Процитировано

58

Spiking activity in the visual thalamus is coupled to pupil dynamics across temporal scales DOI Creative Commons
Davide Crombie, Martin A. Spacek, Christian Leibold

и другие.

PLoS Biology, Год журнала: 2024, Номер 22(5), С. e3002614 - e3002614

Опубликована: Май 14, 2024

The processing of sensory information, even at early stages, is influenced by the internal state animal. Internal states, such as arousal, are often characterized relating neural activity to a single “level” defined behavioral indicator pupil size. In this study, we expand understanding arousal-related modulations in systems uncovering multiple timescales dynamics and their relationship activity. Specifically, observed robust coupling between spiking mouse dorsolateral geniculate nucleus (dLGN) thalamus across spanning few seconds several minutes. Throughout all these timescales, 2 distinct modes—individual tonic spikes tightly clustered bursts spikes—preferred opposite phases dynamics. This multi-scale reveals from those captured size per se, locomotion, eye movements. Furthermore, persisted during viewing naturalistic movie, where it contributed differences encoding visual information. We conclude that dLGN under simultaneous influence processes associated with occurring over broad range timescales.

Язык: Английский

Процитировано

10

Exogenous temporal attention varies with temporal uncertainty DOI Creative Commons
Aysun Duyar, Rachel N. Denison, Marisa Carrasco

и другие.

Journal of Vision, Год журнала: 2023, Номер 23(3), С. 9 - 9

Опубликована: Март 16, 2023

Temporal attention is the selection and prioritization of information at a specific moment. Exogenous temporal automatic, stimulus driven deployment attention. The benefits costs exogenous on performance have not been isolated. Previous experimental designs precluded distinguishing effects expectation about timing. Here, we manipulated uncertainty timing independently investigated visual attended unattended moments with different levels uncertainty. In each trial, two Gabor patches were presented consecutively variable onset. To drive test moments, task-irrelevant, brief cue was 100 ms before target onset, an independent response end trial. slightly improved accuracy, varied uncertainty, suggesting possible interaction expectations in time.

Язык: Английский

Процитировано

14

Eye Movements Decrease during Effortful Speech Listening DOI Creative Commons

M. Eric Cui,

Björn Herrmann

Journal of Neuroscience, Год журнала: 2023, Номер 43(32), С. 5856 - 5869

Опубликована: Июль 25, 2023

Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing earlier. However, pupillometry-the most used approach to assess effort-has limitations that hinder its use practice. The current study explores a novel way through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis movements decrease when becomes challenging. In three experiments with human participants from both sexes, demonstrate, consistent this hypothesis, fixation duration increases spatial gaze dispersion decreases increasing masking. Eye decreased during effortful for different visual scenes (free viewing, object tracking) materials (simple sentences, naturalistic stories). contrast, pupillometry was less sensitive masking story listening, suggesting pupillometric measures not be as effective assessments speech-listening paradigms. Our results reveal critical link between load, neural activity brain regions support regulation movements, such frontal field superior colliculus, are modulated

Язык: Английский

Процитировано

14

Relating Pupil Diameter and Blinking to Cortical Activity and Hemodynamics across Arousal States DOI Creative Commons
Kevin L. Turner, Kyle W. Gheres, Patrick J. Drew

и другие.

Journal of Neuroscience, Год журнала: 2022, Номер 43(6), С. 949 - 964

Опубликована: Дек. 14, 2022

Arousal state affects neural activity and vascular dynamics in the cortex, with sleep associated large changes local field potential increases cortical blood flow. We investigated relationship between pupil diameter blink rate volume somatosensory cortex male female unanesthetized, head-fixed mice. monitored these variables while mice were awake, during periods of rapid eye movement (REM), non-rapid (NREM) sleep. Pupil was smaller than awake state. Changes coherent both gamma-band power but strength sign this varied arousal observed a strong negative correlation rest NREM sleep, although correlations signals became positive alertness, active whisking, REM. Blinking decreases when mouse asleep. Bilateral coherence dropped following blinking, indicating reset activity. Using only metrics (pupil motion), we could determine ('Awake,' 'NREM,' 'REM') >90% accuracy 5 s resolution. There is hemodynamics mice, reflecting pronounced effects on cerebrovascular dynamics. SIGNIFICANCE STATEMENT Determining critical component any neuroscience experiment. blinking are influenced by state, as cortex. found that strongly related to Mice more likely be after before, resets motion can used reliable, noninvasive indicator As transition from wake back again over timescale seconds, monitoring permits detection events behavioral or resting-state experiments.

Язык: Английский

Процитировано

21

Neurophysiological measures and correlates of cognitive load in attention‐deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD) and dyslexia: A scoping review and research recommendations DOI Creative Commons
Anne‐Laure Le Cunff, Eleanor J. Dommett, Vincent Giampietro

и другие.

European Journal of Neuroscience, Год журнала: 2023, Номер 59(2), С. 256 - 282

Опубликована: Дек. 18, 2023

Abstract Working memory is integral to a range of critical cognitive functions such as reasoning and decision‐making. Although alterations in working have been observed neurodivergent populations, there has no review mapping how load measured common neurodevelopmental conditions attention‐deficit/hyperactivity disorder (ADHD), autism spectrum (ASD) dyslexia. This scoping explores the neurophysiological measures used study these specific populations. Our findings highlight that electroencephalography (EEG) functional magnetic resonance imaging (fMRI) are most frequently methods, with limited number studies employing near‐infrared spectroscopy (fNIRs), magnetoencephalography (MEG) or eye‐tracking. Notably, eye‐related less commonly used, despite their prominence research among neurotypical individuals. The also highlights potential correlates load, neural oscillations theta alpha ranges for EEG studies, blood oxygenation level‐dependent (BOLD) responses lateral medial frontal brain regions fMRI fNIRS pupil dilation blink rate. Finally, issues future discussed, including technical challenges associated multimodal approaches, possible impact atypical features on balancing data richness participant well‐being. These insights contribute more nuanced understanding measurement populations point important methodological considerations neuroscientific this area.

Язык: Английский

Процитировано

13

Neural α Oscillations and Pupil Size Differentially Index Cognitive Demand under Competing Audiovisual Task Conditions DOI Creative Commons
Frauke Kraus, Sarah Tune, Jonas Obleser

и другие.

Journal of Neuroscience, Год журнала: 2023, Номер 43(23), С. 4352 - 4364

Опубликована: Май 9, 2023

Cognitive demand is thought to modulate two often used, but rarely combined, measures: pupil size and neural α (8-12 Hz) oscillatory power. However, it unclear whether these measures capture cognitive in a similar way under complex audiovisual-task conditions. Here we recorded power (using electroencephalography), while human participants of both sexes concurrently performed visual multiple object-tracking task an auditory gap detection task. Difficulties the tasks were manipulated independent each other. Participants' performance decreased accuracy speed with increasing demand. Pupil increased difficulty for In contrast, showed diverging dynamics: parietal task, not Furthermore, difficulty, within-participant trial-by-trial fluctuations negatively correlated Difficulty-induced changes power, however, did correlate, which consistent their different cognitive-demand sensitivities. Overall, current study demonstrates that dynamics neurophysiological indices associated effort are multifaceted potentially modality-dependent

Язык: Английский

Процитировано

11

Effects of linguistic context and noise type on speech comprehension DOI Creative Commons
Laura P. Fitzgerald, Gayle DeDe, Jing Shen

и другие.

Frontiers in Psychology, Год журнала: 2024, Номер 15

Опубликована: Фев. 5, 2024

Introduction Understanding speech in background noise is an effortful endeavor. When acoustic challenges arise, linguistic context may help us fill perceptual gaps. However, more knowledge needed regarding how different types of affect our ability to construct meaning from perceptually complex input. Additionally, there limited evidence whether complexity (e.g., informational masking) and occurrence contextually incongruous words) interact during processing material that longer than a single sentence. Our first research objective was determine comprehension spoken sentence pairs impacted by the masking masker. second identify interaction between processing. Methods We used multiple measures including accuracy, reaction time, effort (as indicated task-evoked pupil response), making comparisons across three levels two conditions. Context conditions varied final word, with each pair ending expected exemplar (EE), within-category violation (WV), or between-category (BV). Forty young adults typical hearing performed task over visits. Each participant heard presented either multi-talker babble spectrally shaped steady-state (SSN), same condition all Results observed effect but not on accuracy. Further, we peak dilation data. Specifically, modulated type: facilitated only condition. Discussion These findings suggest when arises, listeners make use facilitate obscured noise. results extend existing accounts demonstrating engage higher-level processes, such as construction segments are

Язык: Английский

Процитировано

4

The pupil dilation response as an indicator of visual cue uncertainty and auditory outcome surprise DOI Creative Commons
Janika Becker,

Marvin Viertler,

Christoph W. Korn

и другие.

European Journal of Neuroscience, Год журнала: 2024, Номер 59(10), С. 2686 - 2701

Опубликована: Март 12, 2024

Abstract In everyday perception, we combine incoming sensory information with prior expectations. Expectations can be induced by cues that indicate the probability of following events. The provided may differ and hence lead to different levels uncertainty about which event will follow. this experiment, employed pupillometry investigate whether pupil dilation response visual varies depending on level cue‐associated a auditory outcome. Also, tested reflects amount surprise subsequently presented stimulus. each trial, participants were cue (face image) was followed an outcome (spoken vowel). After face cue, had keypress three vowels they expected hear next. We manipulated varying probabilistic cue‐outcome contingencies: One most likely one specific vowel (low uncertainty), another equally either two (intermediate uncertainty) third all (high uncertainty). Our results suggest in task‐relevant depends associated uncertainty, but only for large differences uncertainty. Additionally, outcomes, scaled negatively cue‐dependent probabilities, signalling surprise.

Язык: Английский

Процитировано

4