Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues.
Ronny Bujok, Antje S Meyer, Hans Rutger Bosker
PMID 38877720WHAT IT FOUND
Small hand gestures aligned to syllables shifted listeners’ perception of lexical stress in Dutch words, even when the speaker’s face was visible.
Facial articulatory cues alone did not influence perception when clear audio was present, despite being visible in silent video.
Key findings
01Beat gestures aligned to the first or second syllable significantly shifted listeners’ perception of lexical stress, with a larger effect when the audio was ambiguous.
02Facial articulatory cues did not significantly influence audiovisual lexical stress perception, even though participants could distinguish stress patterns from silent videos.
03Results were similar between in-house and online testing, suggesting online platforms are viable for this type of audiovisual perception research.
STILL TO COME
How it was doneWhat they foundWhat it means for SLPs
Read the rest of this summary
You get three full summaries a month, free, and we do not ask for a card. Search, the TL;DRs and your library stay unlimited either way.
What it does not show
The study used single words rather than sentences or discourse, so the effect of gesture timing might differ in richer linguistic contexts where semantic or syntactic cues are available. The talker was instructed to sit still, which may have minimized other natural visual cues like head nods or eyebrow movements that can signal prominence. The findings are specific to Dutch, where lexical stress is primarily cued by suprasegmental features (F0, duration, intensity). In languages like English, where vowel reduction (a segmental cue) is prominent, visual articulatory cues might have a stronger effect. The study tested perception in quiet conditions. In noisy environments, clients might rely more on visual cues, which was not tested here.
Declared interests
The third author holds an Associate Editor position at the journal publishing the article. Funding was provided by the Max Planck Society and an ERC Starting Grant.
The easy way to misread this
Do not conclude that facial articulatory cues are useless for clients with hearing loss. This study tested perception in quiet conditions with clear audio, where visual cues were redundant. In noise, clients may rely more heavily on visible mouth movements to disambiguate stress.