Quantifying convergence and consistency DOI Creative Commons
Nicholas J. Matiasz, Justin N. Wood, Alcino J. Silva

et al.

European Journal of Neuroscience, Journal Year: 2024, Volume and Issue: 60(10), P. 6391 - 6394

Published: Oct. 15, 2024

Abstract The reproducibility crisis highlights several unresolved issues in science, including the need to develop measures that gauge both consistency and convergence of data sets. While existing meta‐analytic methods quantify evidence, they do not its : extent which different types empirical have provided evidence support a hypothesis. To address this gap meta‐analysis, we colleagues developed summary metric—the cumulative index (CEI)—which uses Bayesian statistics degree regarding causal hypotheses between two phenomena. Here, outline CEI's underlying model, quantifies studies four types— positive intervention , negative non‐intervention —lend credence any three relations: excitatory inhibitory or no‐connection . Along with p ‐values other measures, CEI can provide more holistic perspective on set by quantitatively expressing epistemic principles scientists regularly employ qualitatively. thus formally demonstrating how convergent across multiple study yield progress toward scientific consensus, even when an individual type fails reproducible results.

Language: Английский

Quantitative evidence synthesis: a practical guide on meta-analysis, meta-regression, and publication bias tests for environmental sciences DOI Creative Commons
Shinichi Nakagawa, Yefeng Yang, Erin L. Macartney

et al.

Environmental Evidence, Journal Year: 2023, Volume and Issue: 12(1)

Published: April 24, 2023

Meta-analysis is a quantitative way of synthesizing results from multiple studies to obtain reliable evidence an intervention or phenomenon. Indeed, increasing number meta-analyses are conducted in environmental sciences, and resulting meta-analytic often used policies decision-making. We survey recent sciences found poor standards current practice reporting. For example, only ~ 40% the 73 reviewed reported heterogeneity (variation among effect sizes beyond sampling error), publication bias was assessed fewer than half. Furthermore, although almost all had originating same studies, non-independence considered half meta-analyses. To improve implementation meta-analysis we here outline practical guidance for conducting sciences. describe key concepts size detail procedures fitting multilevel meta-regression models performing associated tests. demonstrate clear need scientists embrace models, which explicitly model dependence sizes, rather commonly random-effects models. Further, discuss how reporting visual presentations can be much improved by following guidelines such as PRISMA-EcoEvo (Preferred Reporting Items Systematic Reviews Meta-Analyses Ecology Evolutionary Biology). This paper, along with accompanying online tutorial, serves guide on complete set (i.e., meta-analysis, quantification, meta-regression, tests sensitivity analysis) also gateway more advanced, yet appropriate, methods.

Language: Английский

Citations

75

Species sensitivities to artificial light at night: A phylogenetically controlled multilevel meta‐analysis on melatonin suppression DOI Creative Commons
Yefeng Yang, Qiong Liu,

Chenghao Pan

et al.

Ecology Letters, Journal Year: 2024, Volume and Issue: 27(2)

Published: Feb. 1, 2024

The rapid urbanization of our world has led to a surge in artificial lighting at night (ALAN), with profound effects on wildlife. Previous research wildlife's melatonin, crucial mechanistic indicator and mediator, yielded inconclusive evidence due lack comparative analysis. We compiled analysed an base including 127 experiments 437 observations across 31 wild vertebrates using phylogenetically controlled multilevel meta-analytic models. comes mainly from the white light melatonin suppression birds mammals. show 36% average decrease secretion response ALAN diverse range species. This effect was observed for central peripheral diurnal nocturnal species, captive free-living populations. also reveal intensity-, wavelength-, timing-dependent patterns effects. Exposure 23% rise inter-individual variability suppression, important implications natural selection vertebrates, as some individuals may display higher tolerance ALAN. cross-species strong conservation populations that are subject recommend measures mitigate harmful impacts ALAN, such 'smart' systems tune spectra less compositions.

Language: Английский

Citations

15

Trace amine-associated receptor 1 (TAAR1) agonism for psychosis: a living systematic review and meta-analysis of human and non-human data DOI Creative Commons
Spyridon Siafis, Virginia Chiocchia, Malcolm Macleod

et al.

Wellcome Open Research, Journal Year: 2024, Volume and Issue: 9, P. 182 - 182

Published: April 11, 2024

Trace amine-associated receptor 1 (TAAR1) agonism shows promise for treating psychosis, prompting us to synthesise data from human and non-human studies.

Language: Английский

Citations

8

The therapeutic potential of exercise in post-traumatic stress disorder and its underlying mechanisms: A living systematic review of human and non-human studies DOI Creative Commons
Simonne Wright, Virginia Chiocchia, Olufisayo Elugbadebo

et al.

Wellcome Open Research, Journal Year: 2025, Volume and Issue: 9, P. 720 - 720

Published: Feb. 5, 2025

Background Exercise for post-traumatic stress disorder (PTSD) is a potentially effective adjunct to psychotherapy. However, the biopsychosocial mechanisms of exercise are not well understood. This co-produced living systematic review synthesizes evidence from human and non-human studies. Methods We Included controlled studies involving searches multiple electronic databases (until 31.10.23). Records were screened, extracted, assessed risk bias, reconciled by two independent reviewers. The primary outcome was PTSD symptom severity, while outcomes interest included freezing behaviour, fear memory, generalization, startle response, locomotion. Data synthesised with random-effects meta-analysis. Results Eleven met eligibility criteria. Overall, associated severity improvement compared control (standardized mean difference [SMD] -0.08, 95% confidence interval [CI] -0.24 0.07; 8 studies, one at low bias). High-intensity reduced symptoms scores more than moderate-intensity exercise. There insufficient data examine effects on functional impairment, clusters, remission. Only three all high examined inconclusive results. in behavioural outcomes, including locomotor activity (SMD 1.30, CI 0.74 1.87, 14 studies), changes several neurobiological markers, increase brain-derived neurotrophic factor 1.79, 0.56 3.01). Conclusions While provide compelling beneficial exercise, trials do not. Evidence suggest that might levels factor, enhance cognitive appraisal, improve perceived exertion. paucity effectiveness action underscore need rigorous trials. Registration protocol registered PROSPERO (ID:453615; 22.08.2023).

Language: Английский

Citations

1

Interpreting prediction intervals and distributions for decoding biological generality in meta-analyses DOI Open Access
Yefeng Yang, Daniel W. A. Noble, Alistair M. Senior

et al.

Published: Feb. 12, 2025

Despite the importance of identifying predictable regularities for knowledge transfer across contexts, generality ecological and evolutionary findings is yet to be systematically quantified. We present first large-scale evaluation using new metrics. By focusing on biologically relevant study levels, we show that generalization not uncommon. Overall, 20% meta-analyses will produce a non-zero effect 95% time in future replication studies with 70% probability observing meaningful effects study-level contexts. argue misconception exceedingly rare due conflating within-study between-study variances meta-analyses, which results from too much total heterogeneity (the sum variances). encourage our proposed approach elucidate general patterns underpinning phenomena.

Language: Английский

Citations

1

The therapeutic potential of exercise in post-traumatic stress disorder and its underlying mechanisms: A living systematic review of human and non-human studies DOI Creative Commons
Simonne Wright, Virginia Chiocchia, Olufisayo Elugbadebo

et al.

Wellcome Open Research, Journal Year: 2025, Volume and Issue: 9, P. 720 - 720

Published: April 7, 2025

Background Exercise for post-traumatic stress disorder (PTSD) is a potentially effective adjunct to psychotherapy. However, the biopsychosocial mechanisms of exercise are not well understood. This co-produced living systematic review synthesizes evidence from human and non-human studies. Methods We Included controlled studies involving searches multiple electronic databases (until 31.10.23). Records were screened, extracted, assessed risk bias, reconciled by two independent reviewers. The primary outcome was PTSD symptom severity, while outcomes interest included freezing behaviour, fear memory, generalization, startle response, locomotion. Data synthesised with random-effects meta-analysis. Results Eleven met eligibility criteria. Overall, associated severity improvement compared control (standardized mean difference [SMD] -0.08, 95% confidence interval [CI] -0.24 0.07; 8 studies, one at low bias). High-intensity reduced symptoms scores more than moderate-intensity exercise. There insufficient data examine effects on functional impairment, clusters, remission. Only three all high examined inconclusive results. in behavioural outcomes, including locomotor activity (SMD 1.30, CI 0.74 1.87, 14 studies), changes several neurobiological markers, increase brain-derived neurotrophic factor 1.79, 0.56 3.01). Conclusions While provide compelling beneficial exercise, trials do not. Evidence suggest that might levels factor, enhance cognitive appraisal, improve perceived exertion. paucity effectiveness action underscore need rigorous trials. Registration protocol registered PROSPERO (ID:453615; 22.08.2023).

Language: Английский

Citations

1

Maternal transfer of per- and polyfluoroalkyl substances (PFAS) in wild birds: A systematic review and meta-analysis DOI Creative Commons
Lorenzo Ricolfi, Matthew D. Taylor, Yefeng Yang

et al.

Chemosphere, Journal Year: 2024, Volume and Issue: 361, P. 142346 - 142346

Published: May 15, 2024

Per- and polyfluoroalkyl substances (PFAS) are synthetic chemicals widely used in consumer products. PFAS can accumulate animal tissues, resulting biomagnification adverse effects on wildlife, such as reproductive impairment. In bird species, transferred from mothers to eggs along with essential nutrients may affect embryo development. However, the extent of maternal transfer across different species compounds remains poorly understood. Here, we conducted a systematic review meta-analysis quantify wild birds investigate potential sources variation. We tested moderating compounds' physicochemical properties biological traits studied birds. The dataset included 505 measurements concentration 371 effect sizes derived 13 studies 16 25 compounds. Overall, all found 41% higher offspring than mothers. Specifically, contaminants were concentrated yolk, longer heavier showed preferential transfer, larger clutch size was associated decreased rate shown piscivorous opportunistic/diverse diets. A validation assessment good robustness overall meta-analytic result. Given crucial role maintaining ecological balance, this research article has relevant implications for modelling impacts ecosystems, human health.

Language: Английский

Citations

7

Addressing Dependency in Meta-Analysis: A Companion to Assink and Wibbelink (2016) DOI Open Access
Mark Assink, Carlijn J. M. Wibbelink

The Quantitative Methods for Psychology, Journal Year: 2024, Volume and Issue: 20(1), P. 1 - 16

Published: March 1, 2024

This research note elaborates on addressing dependency in effect size data and serves as a companion to our tutorial fitting three-level meta-analytic models R (Assink & Wibbelink, 2016).We provide description of standard error dependency, explain how both the multilevel multivariate handle these types discuss role alternative methods data, including approximating variance-covariance matrix applying cluster-robust inference method.These are illustrated with example code that builds upon dataset we presented analyzed tutorial.We conclude more simulation studies needed clearer guidelines for modeling urge statisticians make available technical literature further accessible applied researchers.

Language: Английский

Citations

5

Muscarinic receptor agonists and positive allosteric modulators in animal models of psychosis: protocol for a systematic review and meta-analysis DOI Creative Commons
Spyridon Siafis, Nobuyuki Nomura, Johannes Schneider‐Thoma

et al.

F1000Research, Journal Year: 2025, Volume and Issue: 13, P. 1017 - 1017

Published: Jan. 2, 2025

Background Muscarinic receptor agonism and positive allosteric modulation is a promising mechanism of action for treating psychosis, not present in most D2R-blocking antipsychotics. Xanomeline, an M1/M4-preferring agonist, has shown efficacy late-stage clinical trials, with more compounds being investigated. Therefore, we aim to synthesize evidence on the preclinical muscarinic agonists modulators animal models psychosis provide unique insights evidence-based information guide drug development. Methods We plan systematic review meta-analysis in vivo studies comparing or control conditions existing antipsychotics animals subjected any method that induces behavioural changes relevance psychosis. will identify eligible by searching multiple electronic databases. At least two independent reviewers conduct study selection data extraction using prespecified forms assess risk bias SYRCLE’s tool. Our primary outcomes include locomotor activity prepulse inhibition measured standardized mean differences. examine other readouts as secondary outcomes, such social interaction cognitive function. multi-level predefined random-effects structure, considering non-independence data. In meta-regressions explore potential sources heterogeneity from list characteristics population, model, intervention. confidence self-developed instrument thatconsiders internal external validity evidence. Protocol registration PROSPERO-ID: CRD42024520914

Language: Английский

Citations

0

Interpreting prediction intervals and distributions for decoding biological generality in meta-analyses DOI Open Access
Yefeng Yang, Daniel W. A. Noble, Alistair M. Senior

et al.

Published: Feb. 12, 2025

Despite the importance of identifying predictable regularities for knowledge transfer across contexts, generality ecological and evolutionary findings is yet to be systematically quantified. We present first large-scale evaluation using new metrics. By focusing on biologically relevant study levels, we show that generalization not uncommon. Overall, 20% meta-analyses will produce a non-zero effect 95% time in future replication studies with 70% probability observing meaningful effects study-level contexts. argue misconception exceedingly rare due conflating within-study between-study variances meta-analyses, which results from too much total heterogeneity (the sum variances). encourage our proposed approach elucidate general patterns underpinning phenomena.

Language: Английский

Citations

0