SLPOtherAphasiology2019

Statistical analysis in Small-N Designs: using linear mixed-effects modeling for evaluating intervention effectiveness.

Robert W Wiley, Brenda Rapp

PMID 33012945

WHAT IT FOUND

In five adults with acquired dysgraphia, distributed spelling practice within spell-study-spell training produced greater accuracy than clustered practice.

Reaction time improved, but schedules did not differ.

Key findings

01In five adults with acquired dysgraphia, distributed spelling practice within spell-study-spell training produced greater accuracy than clustered practice.

02Training also improved reaction time, but the two schedules did not differ for reaction time.

03The statistical simulation supported using likelihood ratio tests rather than Wald-Z tests for p-values in logistic mixed-effects models with five participants.

STILL TO COME

How it was doneWhat they foundWhat it means for SLPs

Read the rest of this summary

You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.

Already have one?

What it does not show

The clinical result comes from five adults, so it is a small demonstration rather than proof that distributed spelling training works for all people with acquired dysgraphia. The paper's main purpose is to teach linear mixed-effects modelling, and the dysgraphia analysis is used to demonstrate that method. The schedule comparison was within the same spell-study-spell training, so it cannot separate the effect of the training method from the effect of the schedule. With only five participants, estimates of variability across individuals are susceptible to inflated Type I error. The accuracy analysis excluded most within-session clustered trials, reducing available data by about 35%. Autocorrelation and low statistical power remain concerns for small repeated-measures training studies. Follow-up maintenance was reported but was not the focus of the main analyses.

Declared interests

No potential conflict of interest was reported by the authors.

The easy way to misread this

Do not treat this as proof that distributed spelling training works for all people with acquired dysgraphia. It is a five-participant demonstration of statistical analysis, and the schedule comparison used the same spell-study-spell training with reduced clustered-session data.

Read it on PubMed →