Cognitive processing of a common stimulus synchronizes brains, hearts, and eyes

PNAS Nexus, Journal Year: 2022, Volume and Issue: 1(1)

Published: March 1, 2022

Neural, physiological, and behavioral signals synchronize between human subjects in a variety of settings. Multiple hypotheses have been proposed to explain this interpersonal synchrony, but there is no clarity under which conditions it arises, for signals, or whether common underlying mechanism. We hypothesized that cognitive processing shared stimulus the source synchrony subjects, measured here as intersubject correlation (ISC). To test this, we presented informative videos participants an attentive distracted condition subsequently information recall. ISC was observed electro-encephalography, gaze position, pupil size, heart rate, not respiration head movements. The strength co-modulated different changed with attentional state, predicted subsequent recall videos. There robust within-subject coupling brain, heart, eyes, results suggest result effective processing, thus emerges only those exhibit brain-body connection. While physiological fluctuations may be driven by multiple features stimulus, other individuals level engagement stimulus.

Language: Английский

---

From pre-processing to advanced dynamic modeling of pupil data

Behavior Research Methods, Journal Year: 2023, Volume and Issue: 56(3), P. 1376 - 1412

Published: June 22, 2023

The pupil of the eye provides a rich source information for cognitive scientists, as it can index variety bodily states (e.g., arousal, fatigue) and processes attention, decision-making). As pupillometry becomes more accessible popular methodology, researchers have proposed techniques analyzing data. Here, we focus on time series-based, signal-to-signal approaches that enable one to relate dynamic changes in size over with stimulus series, continuous behavioral outcome measures, or other participants' traces. We first introduce pupillometry, its neural underpinnings, relation between measurements oculomotor behaviors blinks, saccades), stress importance understanding what is being measured be inferred from pupillary activity. Next, discuss possible pre-processing steps, contexts which they may necessary. Finally, turn analytic techniques, including regression-based approaches, time-warping, phase clustering, detrended fluctuation analysis, recurrence quantification analysis. Assumptions these examples scientific questions each address, are outlined, references key papers software packages. Additionally, provide detailed code tutorial steps through figures this paper. Ultimately, contend insights gained constrained by analysis used, offer means generate novel taking into account understudied spectro-temporal relationships signal signals interest.

Language: Английский

---

Onscreen presence of instructors in video lectures affects learners’ neural synchrony and visual attention during multimedia learning

Proceedings of the National Academy of Sciences, Journal Year: 2024, Volume and Issue: 121(12)

Published: March 11, 2024

COVID-19 forced students to rely on online learning using multimedia tools, and continues impact education beyond the pandemic. In this study, we combined behavioral, eye-tracking, neuroimaging paradigms identify processes outcomes. College viewed four video lectures including slides with either an onscreen human instructor, animated or no instructor. Brain activity was recorded via fMRI, visual attention outcome assessed post-tests. Onscreen presence of compared instructor presence, resulted in superior post-test performance, less slide, more synchronized eye movements during learning, higher neural synchronization cortical networks associated socio-emotional processing working memory. Individual variation cognitive abilities intersubject revealed different levels conditions. The instructor-present condition evoked increased synchronization, likely reflecting extra demands attentional control, memory engagement, processing. Although instructors led comparable outcomes, effects were due dynamic interplay information vs. distraction. These findings reflect a benefit–cost trade-off where is enhanced only when benefits motivated by social outweigh costs brought about concurrent distraction unrelated learning.

Language: Английский

---

Effect of explanation videos on learning: The role of attention and academic performance

Education and Information Technologies, Journal Year: 2025, Volume and Issue: unknown

Published: Jan. 7, 2025

Students often search for answers online, and gravitate to short explanation videos, which are abundant online. While they seem useful can be quite engaging, it is unclear if these videos benefit classroom learning. We hypothesized that when carefully matched the class instruction, video helpful, but benefits will depend on ability of students pay attention. To test this we recruited from The City College New York first- second-year college physics classes (n = 139) showed them matching their course material. Quizzes before or after measured video. also eye movement gauge attention analyzed results as a function grade point average (GPA). saw quiz performance student, larger effects with higher GPA. GPA was not correlated attention, nor did consistently affect performance. In an online replication participants broader STEM background 215) apparent only one four tested. conclude some available effective support instruction. However, mostly strong academically, despite similar levels overt across all students.

Language: Английский

---

A review of eye tracking research on video-based learning

Education and Information Technologies, Journal Year: 2022, Volume and Issue: 28(6), P. 7671 - 7702

Published: Dec. 7, 2022

Language: Английский

---

Online eye tracking and real-time sentence processing: On opportunities and efficacy for capturing psycholinguistic effects of different magnitudes and diversity

Behavior Research Methods, Journal Year: 2023, Volume and Issue: 56(4), P. 3504 - 3522

Published: Aug. 1, 2023

Online research methods have the potential to facilitate equitable accessibility otherwise-expensive resources, as well more diverse populations and language combinations than currently populate our studies. In psycholinguistics specifically, webcam-based eye tracking is emerging a powerful online tool capable of capturing sentence processing effects in real time. The present paper asks whether provides necessary granularity replicate effects-crucially both large small-that tracker-based has shown. Using Gorilla Experiment Builder platform, this study set out two psycholinguistic effects: robust one, verb semantic constraint effect, first reported Altmann Kamide, Cognition 73(3), 247-264 (1999), smaller lexical interference examined by Kukona et al. Journal Experimental Psychology: Learning, Memory, Cognition, 40(2), 326 (2014). Webcam-based was able effects, thus showing that its functionality not limited effects. Moreover, also reports approaches computing statistical power discusses differences their outputs. Beyond discussing several important methodological, theoretical, practical implications, we offer some further technical details advice on how implement eye-tracking We believe advent tracking, at least respect visual world paradigm, will kickstart new wave studies with populations.

Language: Английский

---

Students’ achievement motivation moderates the effects of interpolated pre-questions on attention and learning from video lectures

Learning and Individual Differences, Journal Year: 2021, Volume and Issue: 91, P. 102055 - 102055

Published: Aug. 13, 2021

Language: Английский

---

Comparing infrared and webcam eye tracking in the Visual World Paradigm

Glossa Psycholinguistics, Journal Year: 2022, Volume and Issue: 1(1)

Published: Aug. 15, 2022

Visual World eye tracking is a temporally fine-grained method of monitoring attention, making it popular tool in the study online sentence processing. Recently, while infrared was mostly unavailable, various web-based experiment platforms have rapidly developed webcam functionalities, which are now urgent need testing and evaluation. We replicated recent on incremental processing verb aspect English using ‘out box’ software (jsPsych; de Leeuw, 2015) crowdsourced participants, fully both offline results original study. furthermore discuss factors influencing quality interpretability data, particularly with regards to temporal spatial resolution; conclude that remote can serve as an affordable accessible alternative lab-based tracking, even for questions probing time-course language

Language: Английский

---

Bidirectional brain-body interactions during natural story listening

Cell Reports, Journal Year: 2024, Volume and Issue: 43(4), P. 114081 - 114081

Published: April 1, 2024

Narratives can synchronize neural and physiological signals between individuals, but the relationship these signals, underlying mechanism, is unclear. We hypothesized a top-down effect of cognition on arousal predicted that auditory narratives will drive not only brain also peripheral signals. find entrained gaze variation, saccade initiation, pupil size, heart rate. This consistent with autonomic function. bottom-up effect, whereby physiology affects arousal. Controlled breathing affected rate was by controlled saccades. Additionally, fluctuations in preceded size Gaze were all associated anterior-central Together, results suggest bidirectional causal effects function central circuits involved control

Language: Английский

---

On Task and in Sync: Examining the Relationship between Gaze Synchrony and Self-reported Attention During Video Lecture Learning

Proceedings of the ACM on Human-Computer Interaction, Journal Year: 2024, Volume and Issue: 8(ETRA), P. 1 - 18

Published: May 20, 2024

Successful learning depends on learners' ability to sustain attention, which is particularly challenging in online education due limited teacher interaction. A potential indicator for attention gaze synchrony, demonstrating predictive power achievements video-based controlled experiments focusing manipulating attention. This study (N=84) examines the relationship between synchronization and self-reported of learners, using experience sampling, during realistic video learning. Gaze synchrony was assessed through Kullback-Leibler Divergence density maps MultiMatch algorithm scanpath comparisons. Results indicated significantly higher attentive participants both measures predicted post-test scores. In contrast, did not correlate with outcomes. While supporting hypothesis that learners exhibit similar eye movements, direct use as an poses challenges, requiring further research interplay content type.

Language: Английский

---