Spatial reference frames of visual, vestibular, and multimodal heading signals in the dorsal subdivision of the medial superior temporal area

Christopher R. Fetsch, Sentao Wang, Yong Gu, Gregory C. DeAngelis, Dora E. Angelaki

Research output: Contribution to journalArticlepeer-review

95 Scopus citations

Abstract

Heading perception is a complex task that generally requires the integration of visual and vestibular cues. This sensory integration is complicated by the fact that these two modalities encode motion in distinct spatial reference frames (visual, eye-centered; vestibular, head-centered). Visual and vestibular heading signals converge in the primate dorsal subdivision of the medial superior temporal area (MSTd), a region thought to contribute to heading perception, but the reference frames of these signals remain unknown. We measured the heading tuning of MSTd neurons by presenting optic flow (visual condition), inertial motion (vestibular condition), or a congruent combination of both cues (combined condition). Static eye position was varied from trial to trial to determine the reference frame of tuning (eye-centered, head-centered, or intermediate). We found that tuning for optic flow was predominantly eye-centered, whereas tuning for inertial motion was intermediate but closer to head-centered. Reference frames in the two unimodal conditions were rarely matched in single neurons and uncorrelated across the population. Notably, reference frames in the combined condition varied as a function of the relative strength and spatial congruency of visual and vestibular tuning. This represents the first investigation of spatial reference frames in a naturalistic, multimodal condition in which cues may be integrated to improve perceptual performance. Our results compare favorably with the predictions of a recent neural network model that uses a recurrent architecture to perform optimal cue integration, suggesting that the brain could use a similar computational strategy to integrate sensory signals expressed in distinct frames of reference.

Original languageEnglish (US)
Pages (from-to)700-712
Number of pages13
JournalJournal of Neuroscience
Volume27
Issue number3
DOIs
StatePublished - Jan 17 2007
Externally publishedYes

Keywords

  • Coordinate frames
  • MST
  • Monkey
  • Multisensory
  • Optic flow
  • Self-motion

ASJC Scopus subject areas

  • General Neuroscience

Fingerprint

Dive into the research topics of 'Spatial reference frames of visual, vestibular, and multimodal heading signals in the dorsal subdivision of the medial superior temporal area'. Together they form a unique fingerprint.

Cite this