Estimating correlations in low-reliability settings with constrained hierarchical models DOI
Mahbod Mehrvarz, Jeffrey N. Rouder

Behavior Research Methods, Journal Year: 2025, Volume and Issue: 57(2)

Published: Jan. 17, 2025

Language: Английский

Individual differences in computational psychiatry: A review of current challenges DOI Creative Commons
Povilas Karvelis, Martin P. Paulus, Andreea O. Diaconescu

et al.

Neuroscience & Biobehavioral Reviews, Journal Year: 2023, Volume and Issue: 148, P. 105137 - 105137

Published: March 20, 2023

Bringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is development computational assays: integrating models with cognitive tasks infer latent patient-specific disease processes in brain computations. While recent years have seen many methodological advancements modelling cross-sectional patient studies, much less attention has been paid basic psychometric properties (reliability construct validity) measures provided by assays. In this review, we assess extent issue examining emerging empirical evidence. We find that suffer from poor properties, which poses a risk invalidating previous findings undermining ongoing research efforts using assays study (and even group) provide recommendations how address these problems and, crucially, embed them within broader perspective on key developments are needed translating clinical practice.

Language: Английский

Citations

49

Why many studies of individual differences with inhibition tasks may not localize correlations DOI Creative Commons
Jeffrey N. Rouder, Aakriti Kumar, Julia M. Haaf

et al.

Psychonomic Bulletin & Review, Journal Year: 2023, Volume and Issue: 30(6), P. 2049 - 2066

Published: July 5, 2023

Abstract Individual difference exploration of cognitive domains is predicated on being able to ascertain how well performance tasks covary. Yet, establishing correlations among common inhibition such as Stroop or flanker has proven quite difficult. It remains unclear whether this difficulty occurs because there truly a lack correlation analytic techniques localize perform poorly real-world contexts excessive measurement error from trial noise. In paper, we explore may localized in large data sets with many people, tasks, and replicate trials. Using hierarchical models separate noise true individual variability, show that 24 extant about 8 times greater than variability. This degree results massive attenuation instability Spearman corrections. We then develop account for variation across trials, individuals, covariation individuals tasks. These also localizing correlations. The advantage these not estimation efficiency, but providing sense uncertainty so researchers are less likely misinterpret variability their data. discuss possible improvements study designs help

Language: Английский

Citations

49

Dynamic computational phenotyping of human cognition DOI Creative Commons
Roey Schurr, Daniel Reznik, Hanna Hillman

et al.

Nature Human Behaviour, Journal Year: 2024, Volume and Issue: 8(5), P. 917 - 931

Published: Feb. 8, 2024

Abstract Computational phenotyping has emerged as a powerful tool for characterizing individual variability across variety of cognitive domains. An individual’s computational phenotype is defined set mechanistically interpretable parameters obtained from fitting models to behavioural data. However, the interpretation these hinges critically on their psychometric properties, which are rarely studied. To identify sources governing temporal phenotype, we carried out 12-week longitudinal study using battery seven tasks that measure aspects human learning, memory, perception and decision making. examine influence state effects, each week, participants provided reports tracking mood, habits daily activities. We developed dynamic framework, allowed us tease apart time-varying effects practice internal states such affective valence arousal. Our results show many dimensions covary with factors, indicating what appears be unreliability may reflect previously unmeasured structure. These support fundamentally understanding within an individual.

Language: Английский

Citations

23

From Classical Methods to Generative Models: Tackling the Unreliability of Neuroscientific Measures in Mental Health Research DOI
Nathaniel Haines, Holly Sullivan‐Toole, Thomas M. Olino

et al.

Biological Psychiatry Cognitive Neuroscience and Neuroimaging, Journal Year: 2023, Volume and Issue: 8(8), P. 822 - 831

Published: Jan. 11, 2023

Language: Английский

Citations

23

Editorial: an emerging field with bright prospects DOI Creative Commons
Philip J. Corr, Dean Mobbs

Personality Neuroscience, Journal Year: 2023, Volume and Issue: 6

Published: Jan. 1, 2023

An abstract is not available for this content. As you have access to content, full HTML content provided on page. A PDF of also in through the 'Save PDF' action button.

Language: Английский

Citations

23

On the psychometric evaluation of cognitive control tasks: An Investigation with the Dual Mechanisms of Cognitive Control (DMCC) battery DOI Creative Commons
Jean-Paul Snijder, Rongxiang Tang,

Julie M. Bugg

et al.

Behavior Research Methods, Journal Year: 2023, Volume and Issue: 56(3), P. 1604 - 1639

Published: April 11, 2023

The domain of cognitive control has been a major focus experimental, neuroscience, and individual differences research. Currently, however, no theory successfully unifies both experimental findings. Some perspectives deny that there even exists unified psychometric construct to be measured at all. These shortcomings the current literature may reflect fact paradigms are optimized for detection within-subject effects rather than differences. In study, we examine properties Dual Mechanisms Cognitive Control (DMCC) task battery, which was designed in accordance with theoretical framework postulates common sources variation. We evaluated internal consistency test-retest reliability, latter, utilized classical test measures (i.e., split-half methods, intraclass correlation) newer hierarchical Bayesian estimation generative models. Although traditional suggested poor models indicated different pattern, good excellent reliability almost all tasks conditions examined. Moreover, within-task, between-condition correlations were generally increased when using model-derived estimates, these higher appeared directly linked measures. contrast, between-task remained low regardless manipulations or approach. Together, findings highlight advantages while also pointing important role search control.

Language: Английский

Citations

23

Different components of cognitive-behavioral therapy affect specific cognitive mechanisms DOI Creative Commons
Agnes Norbury, Tobias U. Hauser, Stephen M. Fleming

et al.

Science Advances, Journal Year: 2024, Volume and Issue: 10(13)

Published: March 27, 2024

Psychological therapies are among the most effective treatments for common mental health problems—however, we still know relatively little about how exactly they improve symptoms. Here, demonstrate power of combining theory with computational methods to parse effects different components cognitive-behavioral onto underlying mechanisms. Specifically, present data from a series randomized-controlled experiments testing brief behavioral and cognitive on processes, using well-validated measures associated models. A goal setting intervention, based activation therapy activities, reliably selectively reduced sensitivity effort when deciding act gain reward. By contrast, restructuring materials, tendency attribute negative everyday events self-related causes. The each intervention were specific these respective measures. Our approach provides basis beginning understand elements psychotherapy programs may work.

Language: Английский

Citations

15

On the (un)reliability of common behavioral and electrophysiological measures from the stop signal task: Measures of inhibition lack stability over time DOI Creative Commons
Christina Thunberg, Thea Wiker, Carsten Bundt

et al.

Cortex, Journal Year: 2024, Volume and Issue: 175, P. 81 - 105

Published: Feb. 27, 2024

Response inhibition, the intentional stopping of planned or initiated actions, is often considered a key facet control, impulsivity, and self-regulation. The stop signal task argued to be purest inhibition we have, it thus central much work investigating role in areas like development psychopathology. Most this quantifies behavior by calculating reaction time as measure individual latency. Individual difference studies aiming investigate why how latencies differ between people do under assumption that indexes stable, dispositional trait. However, empirical support for lacking, common measures control tend show low test-retest reliability appear unstable over time. reasons could methodological, where stability driven measurement noise, substantive, larger influence state-like situational factors. To this, characterized split-half range behavioral electrophysiological derived from task. Across three independent studies, different modalities, systematic review literature, found pattern temporal higher manifest non-inhibitory processing. This not explained noise internal consistency. Consequently, response appears have mostly determinants, there little validity conceptualizing reflecting stable traits.

Language: Английский

Citations

12

Complementary benefits of multivariate and hierarchical models for identifying individual differences in cognitive control DOI Creative Commons
Michael Freund, Ruiqi Chen, Gang Chen

et al.

Imaging Neuroscience, Journal Year: 2025, Volume and Issue: 3

Published: Jan. 1, 2025

Abstract Understanding individual differences in cognitive control is a central goal psychology and neuroscience. Reliably measuring these differences, however, has proven extremely challenging, at least when using standard measures neuroscience such as response times or task-based fMRI activity. While prior work pinpointed the source of issue—the vast amount cross-trial variability within measures—solutions remain elusive. Here, we propose one potential way forward: an analytic framework that combines hierarchical Bayesian modeling with multivariate decoding trial-level data. Using this longitudinal data from Dual Mechanisms Cognitive Control project, estimated individuals’ neural responses associated color-word Stroop task, then assessed reliability across time interval several months. We show many prefrontal parietal brain regions, test–retest was near maximal, only models were able to reveal state affairs. Further, compared traditional univariate contrasts, enabled individual-level correlations be significantly greater precision. specifically link improvements precision optimized suppression decoding. Together, findings not indicate control-related individuate people highly stable manner time, but also suggest integrating provides powerful approach for investigating control, can effectively address issue high-variability measures.

Language: Английский

Citations

1

What is (perception of) effort? Objective and subjective effort during attempted task performance DOI Open Access
James Steele

Published: June 6, 2020

Despite its apparent intuitiveness and widespread interest across various fields, ‘effort’ is a concept that seems difficult to define. The purpose of this article consider define during attempted task performance. In doing so I argue for distinction between the actual effort (objective effort) required, perception (subjective effort), intentionally adopt set theoretical approach defining intensional concepts, extensional phenomenal constructs, employ tradition Theory-Theory illustrate tentative causal theories relating concepts. definitions propose are deliberately agnostic specific demands being (e.g. physical, cognitive, self-control, or combination) thus reflect ‘general’ perception. Throughout, draw upon synthesise literature from multitude disciplines, combining empirical evidence with armchair philosophising, offer what insights have my own experience both as someone experiencing ‘effort’, third-person observer investigating it. This work intended to, at very least, make current pretheoretical conceptualisation understanding transparent other researchers, aid interpretation subsequent work, theory building, testing on topic. Further, hope it might be useful researchers unify paradigms help integration learnings further role broad scientific perspective.

Language: Английский

Citations

56