Evaluating the Accuracy, Empathy, and Readability of Generative AI Versus Registered Nurses in Discharge Planning: A Vignette-Based Study.
Yike Wang, Meiyan Ji, Xinghua Bai and 1 others
PMID 42655921WHAT IT FOUND
AI-written discharge instructions were more comprehensive but less safe, empathetic and readable than nurse-written ones.
Nurses should review AI drafts for medication warnings and simplify language before giving them to patients.
Key findings
01AI scored higher on accuracy and comprehensiveness, but experts found red flags in 12 of 75 AI text ratings and none in nurse text ratings.
02Patients rated nurse-written instructions as more empathetic and easier to understand and act on than AI-written instructions.
03Older age and lower education were associated with lower patient ratings of AI text understandability.
STILL TO COME
How it was doneWhat they foundWhat it means for RNs
Read the rest of this summary
You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.
What it does not show
All participants came from one tertiary hospital in Northeast China, and patient evaluators were recruited by convenience sampling, so the ratings may not represent other settings. Only five clinical scenarios and five AI texts were tested, so the 16.0% red flag rate and readability findings may not generalize to other discharge conditions. The study tested only GPT-4 version gpt-4-0613, so newer AI models may perform differently. The evaluation compared written texts only, not real bedside discharge conversations, so it may understate nurse communication and overstate AI performance. The study measured text ratings, not patient outcomes such as comprehension after discharge, medication adherence or readmission. Only two patients had a master's degree or higher, so education subgroup estimates were unstable.
Declared interests
The study was funded by the National Natural Science Foundation of China (Grant No. 82403911). The authors declared no conflicts of interest.
The easy way to misread this
Do not read this as proof that AI can replace nurses in discharge conversations. The study compared written texts only, found safety red flags in AI output, and did not measure patient outcomes such as comprehension after discharge, medication adherence or readmission.