SLPOtherAutism research : official journal of the International Society for Autism Research2021

Utility of the Autism Diagnostic Observation Schedule and the Brief Observation of Social and Communication Change for Measuring Outcomes for a Parent-Mediated Early Autism Intervention.

Sophie Carruthers, Tony Charman, Nicole El Hawi and 4 others

PMID 33274842

WHAT IT FOUND

In Module 1 children, the ADOS-BOSCC showed no clear difference between parent-mediated therapy and usual care.

The ADOS did not outperform it. The measure was reliable, but it did not reveal a larger treatment effect.

Key findings

01In Module 1 children, the preregistered ADOS-BOSCC total score did not show a significant intervention effect, and no outcome measure performed significantly better than the others.

02The ADOS-BOSCC had good inter-rater reliability for total and social communication scores (0.89) and for RRB (0.73), and a two-factor structure fitted the data relatively well.

03In exploratory analyses combining Module 1 and Module 2 children, the ADOS algorithm showed a significant moderate intervention effect (ES -0.59) and the ADOS CSS showed a significant small effect (ES -0.45). RRB behaviours contributed to the overall effect.

STILL TO COME

How it was doneWhat they foundWhat it means for SLPs

Read the rest of this summary

You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.

Already have one?

What it does not show

The ADOS-BOSCC total intervention analysis was preregistered, but all other analyses were exploratory and post-hoc, and the authors state that multiple testing makes them underpowered for robust interpretation. The Module 1 comparison of measures used 104 children with complete baseline and endpoint data, not the full 146 children retained in the trial. The supplied text does not describe how children were randomly allocated. ADOS assessments were coded blind to treatment group but not to timepoint, which may introduce bias. The trial used the same ADOS module at baseline and endpoint, so some endpoint assessments were not optimally aligned with the child's language level. Some ADOS-BOSCC items had poor reliability, especially eye contact and mannerisms, partly because the videos were 10-year-old low-definition recordings. The RRB subdomain had lower reliability and infrequent behaviours, so RRB findings should be interpreted cautiously. The significant ADOS effect in children with 'few to no words' was small-sample, not pre-specified, and not significantly different from the 'some words' group. Analyses that used change-score variance suggested a more modest ADOS effect.

Declared interests

The supplied text lists funding from the Efficacy and Mechanism Evaluation Programme, National Institute for Health Research, National Institutes of Health, Department of Health, South London and Maudsley NHS Foundation Trust, Biomedical Research Centre, King's College London, and the Medical Research Council. It does not report author conflicts of interest.

The easy way to misread this

Do not treat the significant ADOS algorithm effect in the combined sample as the main result. The preregistered ADOS-BOSCC total effect was not significant, and the ADOS algorithm result is exploratory, post-hoc, and partly driven by Module 2 children.

Read it on PubMed →


The study

Participants
152 families recruited to the PACT trial and 146 retained to 13-month outcome; 117 received Module 1 ADOS and 35 received Module 2 ADOS; 104 Module 1 children had complete baseline and endpoint data for ADOS-BOSCC and ADOS comparisons.
Certainty of evidence
Low

More in autism spectrum

Browse

Cite

Sophie Carruthers, Tony Charman, Nicole El Hawi, et al. Utility of the Autism Diagnostic Observation Schedule and the Brief Observation of Social and Communication Change for Measuring Outcomes for a Parent-Mediated Early Autism Intervention. Autism research : official journal of the International Society for Autism Research. 2021.

Read the original