Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The auditory and the visual percept evoked by the same audiovisual stimuli
Stockholm University, Faculty of Humanities, Department of Linguistics, Phonetics.ORCID iD: 0000-0003-4065-7309
Stockholm University, Faculty of Humanities, Department of Linguistics, Phonetics.ORCID iD: 0000-0002-3701-4380
2007 (English)In: Proceedings of the international conference AVSP 2007: International Conference on Auditory-Visual Speech Processing, 2007Conference paper, Published paper (Refereed)
Abstract [en]

In analyses and models of audiovisual speech perception, it has been common to consider three percepts: (1) the auditory percept evoked by acoustic stimuli, (2) the visual percept evoked by optic stimuli and (3) a common percept evoked by synchronous optic and acoustic stimuli. Here, it is shown that a vocal percept that is heard and influenced by vision has to be distinguished from a gestural percept that is seen and influenced by audition. In the two experiments reported, syllables distinguished solely by their vowels [i], [y] or [e] were presented to phonetically sophisticated subjects auditorily, visually and in incongruently cross-dubbed audiovisual form. In the first, the subjects rated roundedness, lip spreading, openness and backness of the vowels they heard - in the second of those they saw. The results confirmed that roundedness is mainly heard by eye while openness is heard by ear. Heard backness (retraction) varied with the acoustic and optic presence of roundedness. Seen openness was substantially influenced by acoustic cues, while there was no such influence on seen roundedness. The results are discussed in the context of theories and models.

Place, publisher, year, edition, pages
2007.
Keyword [en]
auditory-visual integration, vowel perception, visual speech perception, audio-visual speech perception.
National Category
General Language Studies and Linguistics
Identifiers
URN: urn:nbn:se:su:diva-22185OAI: oai:DiVA.org:su-22185DiVA: diva2:188712
Conference
AVSP 2007 International Conference on Auditory-Visual Speech Processing
Available from: 2007-12-19 Created: 2007-12-19 Last updated: 2014-05-26

Open Access in DiVA

No full text

Other links

Full text in AVSP 2007

Search in DiVA

By author/editor
Traunmüller, HartmutÖhrström, Niklas
By organisation
Phonetics
General Language Studies and Linguistics

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 26 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf