Behavioral optimization in Scientific Publishing DOI Open Access
Milind Watve

Qeios, Год журнала: 2023, Номер unknown

Опубликована: Май 25, 2023

Peer reviewed scientific publishing is critical for communicating important findings, interpretations and theories in any branch of science. While the value peer review rarely doubted, much concern being raised about possible biases process. I argue here that most originate evolved innate tendency every player to optimize one’s own cost benefits. Different players game have different cost-benefit optima. There are multiple conflicts between individual optima collective goals. An analysis shows how why originate. By continuing with current trend, global distribution community would be increasingly clustered. Publication by gender, ethnicity, reputation, conformation conformity will common revolutionary concepts difficult publish. For a better future science, it necessary design publication system based on principles human behaviour rather than some ideological assumptions. If designed such way goal minimized, if everyone cares only his/her personal benefits, get minimized automatically progress towards faster smoother. Changing might prove unless mass authors take an active role revolutionize publishing.

Язык: Английский

Empirical evidence of widespread exaggeration bias and selective reporting in ecology DOI
Kaitlin Kimmel, Meghan L. Avolio, Paul J. Ferraro

и другие.

Nature Ecology & Evolution, Год журнала: 2023, Номер 7(9), С. 1525 - 1536

Опубликована: Авг. 3, 2023

Язык: Английский

Процитировано

48
Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology DOI Creative Commons
Elliot Gould, Hannah Fraser, Timothy Parker

и другие.

BMC Biology, Год журнала: 2025, Номер 23(1)

Опубликована: Фев. 6, 2025

Although variation in effect sizes and predicted values among studies of similar phenomena is inevitable, such far exceeds what might be produced by sampling error alone. One possible explanation for results differences researchers the decisions they make regarding statistical analyses. A growing array has explored this analytical variability different fields found substantial despite analysts having same data research question. Many these have been social sciences, but one small "many analyst" study ecology. We expanded scope prior work implementing a large-scale empirical exploration model predictions generated ecology evolutionary biology. used two unpublished datasets, from (blue tit, Cyanistes caeruleus, to compare sibling number nestling growth) conservation (Eucalyptus, grass cover tree seedling recruitment). The project leaders recruited 174 analyst teams, comprising 246 analysts, investigate answers prespecified questions. Analyses conducted teams yielded 141 usable effects (compatible with our meta-analyses all necessary information provided) blue tit dataset, 85 Eucalyptus dataset. heterogeneity both although patterns differed between them. For analyses, average was convincingly negative, less growth nestlings living more siblings, there near continuous size large negative zero, even crossing traditional threshold significance opposite direction. In contrast, relationship only slightly not most ranged weakly positive, about third direction or other. However, were also several striking outliers zero. we variable selection random structures as well ratings methods peer reviewers, no strong any deviation meta-analytic mean. other words, analyses that mean likely dissimilar sets, use their models, receive poor reviews than those close existence analysis outcomes raises important questions how ecologists biologists should interpret published results, conduct future.

Язык: Английский

Процитировано

11
Four principles for improved statistical ecology DOI Creative Commons
Gordana Popović, Tanya J. Mason, Szymon M. Drobniak

и другие.

Methods in Ecology and Evolution, Год журнала: 2024, Номер 15(2), С. 266 - 281

Опубликована: Янв. 15, 2024

Abstract Increasing attention has been drawn to the misuse of statistical methods over recent years, with particular concern about prevalence practices such as poor experimental design, cherry picking and inadequate reporting. These failures are largely unintentional no more common in ecology than other scientific disciplines, many them easily remedied given right guidance. Originating from a discussion at 2020 International Statistical Ecology Conference, we show how ecologists can build their research following four guiding principles for impactful practices: (1) define focussed question, then plan sampling analysis answer it; (2) develop model that accounts distribution dependence your data; (3) emphasise effect sizes replace significance ecological relevance; (4) report findings sufficient detail so is valid reproducible. provide framework design reporting guards against unsound practices. Starting well‐defined question allows researchers create an efficient study it, lead estimation direction, magnitude, uncertainty relationships, replicability. Correct appropriate models give sound conclusions. Good focus on relevance make results replicable. Illustrated two examples—an experiment impact disturbance upland wetlands, observational blue tit colouring—this paper explains rationale selection use effective provides practical guidance seeking improve methods.

Язык: Английский

Процитировано

16
Finding the right power balance: Better study design and collaboration can reduce dependence on statistical power DOI Creative Commons
Shinichi Nakagawa, Malgorzata Lagisz, Yefeng Yang

и другие.

PLoS Biology, Год журнала: 2024, Номер 22(1), С. e3002423 - e3002423

Опубликована: Янв. 8, 2024

Power analysis currently dominates sample size determination for experiments, particularly in grant and ethics applications. Yet, this focus could paradoxically result suboptimal study design because publication biases towards studies with the largest effects can lead to overestimation of effect sizes. In Essay, we propose a paradigm shift better designs that less on statistical power. We also advocate (pre)registration obligatory reporting all results (regardless significance), facilitation team science multi-institutional collaboration incorporates heterogenization, use prospective living meta-analyses generate generalizable results. Such changes make more effective and, potentially, equitable, helping cultivate collaborations.

Язык: Английский

Процитировано

15
Reasons to Be Skeptical about Sentience and Pain in Fishes and Aquatic Invertebrates DOI Creative Commons

Benjamin K. Diggles,

Robert Arlinghaus, Howard I. Browman

и другие.

Reviews in Fisheries Science & Aquaculture, Год журнала: 2023, Номер 32(1), С. 127 - 150

Опубликована: Окт. 4, 2023

The welfare of fishes and aquatic invertebrates is important, several jurisdictions have included these taxa under regulation in recent years. Regulation requires use scientifically validated criteria. This why applying Mertonian skepticism toward claims for sentience pain sound prudent, particularly when those are used to justify legislation regulating the taxa. Enacting without strong scientific evidence a societal political choice that risks creating interpretational problems as well major policy challenges, including potential generate significant unintended consequences. In contrast, more rigorous science-based approach organisms based on verified, measurable endpoints likely result "win-win" scenarios minimize risk negative impacts all stakeholders, fish invertebrates. authors identify supporters animal welfare, emphasize this issue not about choosing between no invertebrates, but rather ensure important decisions their robust evidence. These ten reasons delivered spirit organized orient legislators, decision makers community, alert them need maintain high evidential bar any operational indicators animals, mandated by legislation. Moving forward, maintaining highest standards vitally order protect only also global food security humans.

Язык: Английский

Процитировано

18
New horizons for comparative studies and meta-analyses DOI
Patrice Pottier, Daniel W. A. Noble, Frank Seebacher

и другие.

Trends in Ecology & Evolution, Год журнала: 2024, Номер 39(5), С. 435 - 445

Опубликована: Янв. 11, 2024

Язык: Английский

Процитировано

9
Computationally reproducing results from meta-analyses in ecology and evolutionary biology using shared code and data DOI Creative Commons
Steven Kambouris, David P. Wilkinson, Eden T. Smith

и другие.

PLoS ONE, Год журнала: 2024, Номер 19(3), С. e0300333 - e0300333

Опубликована: Март 13, 2024

Many journals in ecology and evolutionary biology encourage or require authors to make their data code available alongside articles. In this study we investigated how often could be used together, when both were available, computationally reproduce results published We surveyed the sharing practices of 177 meta-analyses between 2015–17: 60% articles shared only, 1% 15% code. each which had ( n = 26), selected a target result attempted it. Using files, successfully reproduced targeted 27–73% 26 articles, depending on stringency criteria applied for successful reproduction. The from sample 2015–17 literature can provide benchmark future meta-research studies gauging computational reproducibility research biology.

Язык: Английский

Процитировано

7
The effect of pre-COVID and post-COVID vaccination on long COVID: a systematic review and meta-analysis DOI Creative Commons
King Ngai Chow,

Yuk Wah Tsang,

Yan Hei Chan

и другие.

Journal of Infection, Год журнала: 2024, Номер unknown, С. 106358 - 106358

Опубликована: Ноя. 1, 2024

Язык: Английский

Процитировано

6
Estimating the extent of selective reporting: An application to economics DOI Creative Commons
Stephan B. Bruns,

Teshome Kebede Deressa,

T. D. Stanley

и другие.

Research Synthesis Methods, Год журнала: 2024, Номер 15(4), С. 590 - 602

Опубликована: Фев. 21, 2024

Using a sample of 70,399 published p-values from 192 meta-analyses, we empirically estimate the counterfactual distribution in absence any biases. Comparing observed with counterfactually expected allows us to how many are as being statistically significant when they should have been non-significant. We extent selectively reported range between 57.7% and 71.9% p-values. The p-value also assess shifts along entire p-values, revealing that particularly very small (p < 0.001) unexpectedly abundant literature. Subsample analysis suggests selective reporting is reduced research fields use experimental designs, analyze microeconomics questions, at least some adequately powered studies.

Язык: Английский

Процитировано

3
Synthesis of sexual selection: a systematic map of meta‐analyses with bibliometric analysis DOI Creative Commons
Pietro Pollo, Malgorzata Lagisz, Yefeng Yang

и другие.

Biological reviews/Biological reviews of the Cambridge Philosophical Society, Год журнала: 2024, Номер 99(6), С. 2134 - 2175

Опубликована: Июль 9, 2024

ABSTRACT Sexual selection has been a popular subject within evolutionary biology because of its central role in explaining odd and counterintuitive traits observed nature. Consequently, the literature associated with this field study became vast. Meta‐analytical studies attempting to draw inferences from have now accumulated, varying scope quality, thus calling for synthesis these syntheses. We conducted systematic search create map report appraisal meta‐analyses on topics sexual selection, aiming identify conceptual methodological gaps secondary literature. also bibliometric analyses explore whether are gender origin authors meta‐analyses. included 152 meta‐analytical our map. found that most focused males certain animal groups (e.g. birds), indicating severe sex taxonomic biases. The varied greatly, proximate relationship ornaments other traits) ultimate questions formal estimates strength), although former were more common. several common issues studies, such as lack detailed information regarding searches, screening, analyses, which ultimately impairs reliability many In addition, meta‐analyses' men affiliated institutions developed countries, pointing both geographical authorship Most importantly, we aspects studies. Many findings might simply reflect patterns current state primary academia, suggesting can serve an indicator at large. Based findings, provide analytical recommendations improve future selection.

Язык: Английский

Процитировано

3