Dr. Matthew H. Schneps Director, LVL (617) 495-7472
mschneps@cfa
Publications of the Laboratory for Visual Learning (Abstract) Research
 

Asynchrony Detection of Visual and Auditory Speech by Adolescents With Autism

Grossman, Ruth B; Matthew H Schneps; Tager-Flusberg, Helen

Autism Consortitum - 2nd Scientific Retreat (2007)

ABSTRACT

Introduction:
One of the often proposed limitations of individuals with Autism Spectrum Disorder (ASD) is their inability to integrate rapidly presented stimuli from visual and auditory modalities, (e.g. de Gelder et al.). This deficit would make it difficult for individuals with ASD to coordinate their perceptions of emotional or language-based facial expressions with simultaneously presented verbal speech, thereby severely limiting their successful participation in face-to-face communication. Studies of lipreading and visual/verbal integration have shown that ASD participants perform poorly when stimuli are presented at natural conversational speed, but improve and may even be superior to those of their typically developing (TD) peers when presentation speed is reduced (Tardif et al., 2007, Grossman et al. 2006, Gepner et al., 2001, De Gelder et al., 1991,). Some individuals with ASD also demonstrate less influence of visual speech in McGurk paradigms involving the presentation of incongruent visual and auditory signals for single syllable non-word stimuli (Irwin, 2006, Condouris et al. 2004). The aim of our present study was to determine whether individuals with ASD are indeed less able to integrate rapidly presented information from visual and auditory channels, even if the stimuli carry more meaningful language information and the task does not involve a stimulus mismatch, but rather an onset asynchrony between visual and auditory information. Our hypothesis is that individuals with ASD will show similar integration abilities to their TD peers and may demonstrate an asynchrony detection advantage due to their relatively good lipreading skills.

Protocol:
Participants were 25 adolescents with autism and 25 TD controls, matched for age, sex, verbal and non-verbal IQ. Our stimuli consisted of 12 video clips taken from a longer narrative about baking dessert. Each clip contained a complete sentence or phrase and was 3 seconds long (+-200ms). We then "slipped" each clip's video and audio tracks out of phase, with the video preceding the audio, by 4, 6, 8, 10, 12, and 14 frames, thereby creating 7 versions of each clip (including one synchronous presentation) for a total of 84 stimuli. The slip rates were selected to allow for performance above and below the reliable asynchrony detection threshold of 8 to 10 frames for a typical adolescent population as determine by a pilot study. Participants were asked to view the clips, which were presented in one of 2 randomized, counterbalanced sequences with a 3 second interstimulus interval to allow for adequate response time, and determine whether each clip was "in-sync" or not. Data analysis: Our data show an expected main effect for slip rate (F(5,260)=397.6, p<.001), with higher slip rates resulting in more accurate asynchrony detection, but no main effect for group, or group by slip rate interaction.

Conclusion:
Our data indicate that individuals with ASD can successfully attend to both the visual and auditory components of language and detect onset asynchrony between the two modalities as successfully as their TD peers. The difference between our results and those obtained for participants with ASD in McGurk paradigms may indicate that meaningful linguistic context provides this population with a better basis for auditory/visual integration than single non-word syllables. Overall we conclude that adolescents with ASD are as able as their TD peers to integrate rapidly presented visual and auditory speech information during the presentation of natural dynamic language.

  Section Photo

Contribute to the Study
Do you work in the sciences and suspect you have dyslexia? If so, we invite you to contribute to this NSF-sponsored study on dyslexia and science: Share information, mentor young people, and participate in the research.

Learn more

 
 

Section Photo