Speaker
Description
In challenging acoustic scenarios, individuals can implement behavioral strategies (e.g., lip-reading) to enhance speech comprehension. We hypothesized that lip-reading depends on the exerted listening effort that accompanies challenging conditions. To test this, we manipulated listening effort through variations in cognitive demands and motivation. Normal-hearing adults (N=64) performed an audiovisual speech-comprehension in noise in combination with a concurrent mnemonic task with low vs. high working memory engagement. Motivation was manipulated between-subjects through fixed or performance-related monetary rewards. Lip-reading was tracked with eye-movement and pupil dilation served as a physiological measure of listening effort, confirming manipulation effectiveness. Crucially, we found that exerted listening effort influences lip-reading behavior, with motivation playing a key role in this behavioral adaptation to enhanced cognitive demands. These findings document the association between internal mental processes and behavioral adaptation in the speech domain.
