Evidence-b(i)ased practice: Selective and inadequate reporting in early childhood autism intervention research.
Micheal Sandbank, Kristen Bottema-Beutel, Ya-Cing Syu and 3 others
PMID 38345030WHAT IT FOUND
Completed early autism intervention trials were often unpublished or unreported: only 6 of 84 posted results. 95 of 385 eligible reports could not be included in meta-analysis.
Only 10 of 56 registered studies were free of selective reporting signs.
Key findings
01Of 84 completed registered trials, only 6 had posted results on clinicaltrials.gov, and 53 had associated published papers.
02Of 385 reports eligible for a prior meta-analysis, 95 were excluded from summary effect estimation because of inadequate reporting and lack of data sharing.
03Among 56 studies with registrations, only 10 were not flagged for any selective reporting indicator.
STILL TO COME
How it was doneWhat they foundWhat it means for SLPs
Read the rest of this summary
You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.
What it does not show
The first analysis used only trials registered on clinicaltrials.gov, so it may not represent autism intervention trials outside the United States. Selective reporting was coded only for 56 of 252 studies that had locatable registrations, and many registrations were retrospective or incomplete, so the selective reporting estimates may not represent all published studies. The inadequate reporting count does not include all papers that reported results in a way that prevented effect size derivation, because some supplied the needed data in supplementary materials. The study examined reporting practices, not clinical outcomes, so it cannot tell whether any intervention helps or harms children. The search and prior meta-analysis data set were limited to studies published before November 2021.
Declared interests
The authors received no financial support. Several declared ties to autism intervention practice, training, or funding: M.S. has fees for talks and expert evidence and previously taught in a Behavior Analyst Certification Board accredited program; K.B.-B. has consulted for school districts, has speaker fees, and receives royalties for an early intervention book; J.I.F. has been paid for adaptive horseback riding, has NIH grant funding, and teaches in a department that provides early communication therapies; Nicolette Caldwell is a Board-Certified Behavior Analyst at the Doctoral level, president-elect of the Arkansas Association for Behavior Analysis, teaches in a BACB accredited program, and provided quality assurance or consultation for Arkansas Medicaid behavioral services; T.W. has been paid to provide autism interventions, has NIH and other grant funding, and works in a department of hearing and speech sciences that provides and trains autism intervention services.
The easy way to misread this
Do not conclude that early autism interventions do not work. This paper did not measure child outcomes; it measured missing, incomplete, and inconsistent reporting in autism intervention trials.