Pre-trained artificial intelligence language model represents pragmatic language variability central to autism and genetically related phenotypes.
Joseph Cy Lau, Emily Landau, Qingcheng Zeng and 4 others
PMID 39704443WHAT IT FOUND
The model did not separate fragile X or parent groups from controls, but its score was lower in autistic than non-autistic conversations and tracked hand-coded pragmatic errors.
It is not a clinical test yet.
Key findings
01The model's conversational score differed across clinical groups, and autistic participants scored lower than non-autistic participants; fragile X did not differ from either group.
02Lower model scores were associated with more hand-coded pragmatic violations overall and specifically with presupposition errors in clinical groups.
03In parents, the model did not separate groups, but lower scores were associated with more pragmatic violations overall and with dominating conversation.
STILL TO COME
How it was doneWhat they foundWhat it means for SLPs
Read the rest of this summary
You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.
What it does not show
This is a proof-of-concept study, so the model score has not been validated for clinical diagnosis or treatment decisions. The fragile X group was small, so the lack of difference from other groups may be due to low power. Parent group differences were not detected; the authors suggest subclinical pragmatic differences may be too subtle for this method. BERT compared an examiner utterance with a participant reply, not the flow of the whole conversation. Age and sex were associated with scores, and groups were not closely matched, so differences may be hard to interpret. All participants were native English speakers and fluent enough for ADOS-2 modules 3 or 4, so results may not apply to less fluent or non-English conversations. There was no community involvement.
Declared interests
All authors declared no conflict of interest. The supplied publication types indicate NIH extramural research support.
The easy way to misread this
Do not conclude that this model can diagnose autism, fragile X, or parent phenotype. It did not separate fragile X or parent groups from controls, and the authors say it needs larger validation.