Abstract
Primates, including humans, communicate using facial expressions, vocalizations and often a combination of the two modalities. For humans, such bimodal integration is best exemplified by speech-reading - humans readily use facial cues to enhance speech comprehension, particularly in noisy environments. Studies of the eye movement patterns of human speech-readers have revealed, unexpectedly, that they predominantly fixate on the eye region of the face as opposed to the mouth. Here, we tested the evolutionary basis for such a behavioral strategy by examining the eye movements of rhesus monkeys observers as they viewed vocalizing conspecifics. Under a variety of listening conditions, we found that rhesus monkeys predominantly focused on the eye region versus the mouth and that fixations on the mouth were tightly correlated with the onset of mouth movements. These eye movement patterns of rhesus monkeys are strikingly similar to those reported for humans observing the visual components of speech. The data therefore suggest that the sensorimotor strategies underlying bimodal speech perception may have a homologous counterpart in a closely related primate ancestor.
Original language | English (US) |
---|---|
Pages (from-to) | 515-529 |
Number of pages | 15 |
Journal | Cognition |
Volume | 101 |
Issue number | 3 |
DOIs | |
State | Published - Oct 2006 |
Externally published | Yes |
Keywords
- Auditory cortex
- Bimodal
- Crossmodal
- Evolution of speech
- Eye gaze
- Frontal eye fields
- Lip-reading
- Multisensory
- Primate cognition
- Scanpath
- Speech reading
- Superior temporal sulcus
ASJC Scopus subject areas
- Experimental and Cognitive Psychology
- Language and Linguistics
- Developmental and Educational Psychology
- Linguistics and Language
- Cognitive Neuroscience