Sep 22 – 25, 2024
Noto (SR)
Europe/Rome timezone

Neural synchronization with audiovisual speech relies on a sensitive period

Sep 23, 2024, 4:30 PM
10m
Aula Fondazione Giavanti

Aula Fondazione Giavanti

Speaker

marta fantoni (IMT School for Advanced Studies Lucca)

Description

Proper sensory inputs at specific time windows are fundamental for shaping infants’ development (Werker, Hensch, 2015). Temporary auditory deprivation in the first year of life can alter the ability to integrate audiovisual speech cues even if hearing is restored with cochlear implants (CI; Schorr et al., 2005).
Yet, it’s unclear if neural circuitries responsible for audiovisual speech integration have a developmentally sensitive period in which auditory information is required. To investigate this issue, we measured the neural tracking of speech sound envelope (auditory-only) and associated lip movements (audiovisual) with EEG in children with congenital (CD) or acquired (AD) deafness and in hearing controls (HC). Because CD and AD groups crucially differed in their lack or presence of functional hearing in the first year of life, this allowed assessing the role of auditory experience within this phase of brain development.
Overall, lip-movement tracking was more evident in CI than in HC. Neural tracking benefited from audiovisual compared to auditory-only speech in HC and AD. The sound envelope tracking was anticipated when the speaker's face was visible at short timescales, ∼30 – 150 ms, indicative of early processing. This facilitatory effect was absent in the CD group, revealing that early acoustic deprivation hindered fast audiovisual integration. However, AD and CD groups showed comparable speech comprehension enhancements with audiovisual speech, highlighting that neural adaptations to different deafness onsets can lead to similar behavioral outcomes. Hence, early acoustic experience is fundamental for developing neural circuitries subtending automatic integration of low-level audiovisual speech signals.

Primary author

marta fantoni (IMT School for Advanced Studies Lucca)

Co-authors

Dr Alessandra Federici (IMT School for Advanced Studies Lucca) Dr Francesco Pavani (Centro Interdipartimentale Mente/Cervello – CIMEC, Universitiy of Trento) Dr Giacomo Handjaras (IMT School for Advanced Studies Lucca) Dr Ivan Camponogara (Zayed University, Abu Dhabi, United Arab Emirates) Dr Emiliano Ricciardi (IMT School for Advanced Studies Lucca) Dr Elena Nava (University of Milan Bicocca, Milan, Italy) Dr Eva Orzan (IRCCS materno infantile Burlo Garofolo, Trieste, Italy) Dr Benedetta Bianchi (IRCCS Azienda ospedaliero-universitaria Meyer, Florence, Italy) Dr Stefan Debener (University of Oldenburg, Oldenburg, Germany) Dr Davide Bottari (IMT School for Advanced Studies Lucca)

Presentation materials

There are no materials yet.