Re-Evaluating the Appropriateness of the "Don't Know" Response Option: Guessing Rate as a Source of Systematic Error on Autism Knowledge Assessments.
Camilla M McMahon, Maryellen Brunson McClain, Cassity R Haverkamp and 1 others
PMID 39096462WHAT IT FOUND
Autism knowledge tests that include a “don’t know” option can make guessing count as knowledge.
In 396 school-based professionals, tendency to guess was linked with higher scores, so a low score may not mean low knowledge and a high score may not mean certainty.
Key findings
01When don’t know or skipped answers were marked incorrect, average ASKSP-R score was 54% and average ASK-Q score was 87%; when those answers were randomly assigned, average scores were 60% and 89%.
02On both autism knowledge tests, participants who had a higher guessing rate had greater autism knowledge scores.
03Participants who had worked with more autistic students had greater autism knowledge on both the ASKSP-R and ASK-Q.
STILL TO COME
How it was doneWhat they foundWhat it means for SLPs
Read the rest of this summary
You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.
What it does not show
Participants were recruited through professional organizations, so the sample may not represent all school-based professionals. Only audiologists, speech-language pathologists, and school psychologists who worked mainly in school settings were included. 171 of 567 initial participants were excluded. 75 did not complete any autism knowledge questions, and 19 had missing predictor data. The final sample was 396 participants; 363 were female, 334 had a master’s or specialist’s degree, and 324 personally knew someone with autism. The study used only two autism knowledge measures, ASKSP-R and ASK-Q, and other measures with a “don’t know” option may behave differently. Personal autism contact was recorded as yes or no, and the number of autistic students worked with was a self-reported ordinal estimate. The study did not ask whether participants themselves were autistic. This was a survey analysis, so it shows links between guessing and scores, not proof that guessing causes higher knowledge scores.
The easy way to misread this
Do not read a low autism knowledge score as proof that a professional lacks autism knowledge. In this study, don’t know or skipped answers were marked incorrect in one analysis, and randomly assigning those answers raised average scores. The finding is about test format and guessing, not about patient care.
Summarised by AI from the full paper, without a clinician reviewing it. Check it against the source before it changes what you do. Read it on PubMed →