Better statistical reporting does not lead to statistical rigour: lessons from two decades of pseudoreplication in mouse-model studies of neurological disorders.
Constantinos Eleftheriou, Sarah Giachetti, Raven Hickson and 34 others
PMID 40414919WHAT IT FOUND
Better statistical reporting has not reduced pseudoreplication in mouse studies of neurological disorders.
Despite stricter guidelines, the error remains widespread and has slightly increased since 2012. Reporting details does not guarantee rigorous analysis.
Key findings
01Pseudoreplication remained prevalent and slightly increased between 2001-2012 and 2013-2024 despite improved statistical reporting.
02Articles reporting adequate statistical details in 2013-2024 were just as likely to contain pseudoreplication as those that did not.
03The presence of pseudoreplication or inadequate reporting did not affect the citation rate of the articles.
STILL TO COME
How it was doneWhat they found
Read the rest of this summary
You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.
What it does not show
The study was limited to neuroscience articles using animal models that permitted repeat sampling; it did not assess the entire literature or non-animal studies. Scoring for pseudoreplication involved subjective judgment, although double-blind scoring and consensus processes were used to mitigate bias. Articles lacking adequate statistical details were assumed to be free of pseudoreplication unless evidence suggested otherwise, which may underestimate the true prevalence.
Declared interests
Funded by the Simons Initiative for the Developing Brain and the Patrick Wild Centre at the University of Edinburgh.
The easy way to misread this
Do not assume that a paper's compliance with statistical reporting guidelines guarantees that the data was analysed correctly. The study shows that rigorous reporting and rigorous analysis are separate issues, and pseudoreplication persists even in well-reported articles.