Relative Contribution of Auditory and Visual Information to Mandarin Chinese Tone Identification by Native and Tone-naïve Listeners.
Yueqiao Han, Martijn Goudbeek, Maria Mos and 1 others
PMID 31888403WHAT IT FOUND
Native Mandarin listeners identified tones from clear audio even when face cues mismatched.
Tone-naïve listeners used face cues slightly, but only for some tones, and still relied mainly on hearing the tone.
Key findings
01Native Mandarin speakers identified tones correctly at 0.994 for congruent stimuli and 0.995 for incongruent stimuli, and congruent versus incongruent visual information did not significantly affect their responses.
02Tone-naïve listeners identified congruent stimuli more accurately than incongruent stimuli (0.43 vs 0.36), and when cues mismatched they chose the auditory tone more often than the visual tone (0.36 vs 0.25).
03Compared with audio-only performance, congruent audio-visual cues gave tone-naïve listeners only a slight increase (0.43 vs 0.42).
STILL TO COME
How it was doneWhat they foundWhat it means for SLPs
Read the rest of this summary
You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.
What it does not show
The native Mandarin group was almost perfect, so a real visual effect could have been hidden by a ceiling effect. The study used clear audio in a quiet lab and did not test noisy or degraded speech, where visual cues might matter more. The stimuli came from one female native Mandarin speaker, and the visual cues were natural and subtle, so other speakers may look different. The audio-only comparison used a different study with 43 different Dutch listeners and four speakers, not the same participants. Participants were university students, not clinical patients, and the task was forced-choice tone identification in a lab. The tone-naïve group was mainly Dutch, so results may not apply to all non-Mandarin language backgrounds.
Declared interests
The funding statement says the first author received financial support from the China Scholarship Council; no other conflicts are listed.
The easy way to misread this
Do not conclude that seeing a speaker's face improves Mandarin tone identification for all listeners. Native speakers performed near ceiling and showed no significant congruency effect, and tone-naïve listeners showed only a small, tone-specific benefit compared with audio alone.