OtherMolecular autism2025

Better statistical reporting does not lead to statistical rigour: lessons from two decades of pseudoreplication in mouse-model studies of neurological disorders.

Constantinos Eleftheriou, Sarah Giachetti, Raven Hickson and 34 others

PMID 40414919

WHAT IT FOUND

Better statistical reporting has not reduced pseudoreplication in mouse studies of neurological disorders.

Despite stricter guidelines, the error remains widespread and has slightly increased since 2012. Reporting details does not guarantee rigorous analysis.

Key findings

01Pseudoreplication remained prevalent and slightly increased between 2001-2012 and 2013-2024 despite improved statistical reporting.

02Articles reporting adequate statistical details in 2013-2024 were just as likely to contain pseudoreplication as those that did not.

03The presence of pseudoreplication or inadequate reporting did not affect the citation rate of the articles.

STILL TO COME

How it was doneWhat they found

Read the rest of this summary

You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.

Already have one?

What it does not show

The study was limited to neuroscience articles using animal models that permitted repeat sampling; it did not assess the entire literature or non-animal studies. Scoring for pseudoreplication involved subjective judgment, although double-blind scoring and consensus processes were used to mitigate bias. Articles lacking adequate statistical details were assumed to be free of pseudoreplication unless evidence suggested otherwise, which may underestimate the true prevalence.

Declared interests

Funded by the Simons Initiative for the Developing Brain and the Patrick Wild Centre at the University of Edinburgh.

The easy way to misread this

Do not assume that a paper's compliance with statistical reporting guidelines guarantees that the data was analysed correctly. The study shows that rigorous reporting and rigorous analysis are separate issues, and pseudoreplication persists even in well-reported articles.

Read it on PubMed →


The study

Participants
650 publications (345 FXS, 300 ND)
Certainty of evidence
Low

Browse

    Cite

    Constantinos Eleftheriou, Sarah Giachetti, Raven Hickson, et al. Better statistical reporting does not lead to statistical rigour: lessons from two decades of pseudoreplication in mouse-model studies of neurological disorders. Molecular autism. 2025.

    Read the original