Tracking in 3D: Image variability decomposition for recovering object pose and illumination

Peter N. Belhumeur, Gregory D. Hager

Research output: Contribution to journalArticlepeer-review

9 Scopus citations


As an object moves through space, it changes its orientation relative to the viewing camera and relative to light sources which illuminate it. As a consequence, the images of the object produced by the viewing camera may change dramatically. Thus, to successfully track a moving object, image changes due to varying pose and illumination must be accounted for. In this paper, we develop a method for object tracking that can not only accommodate large changes in object pose and illumination, but can recover these parameters as well. To do this, we separately model the image variation of the object produced by changes in pose and illumination. To track the object through each image in the sequences, we then locally search the models to find the best match, recovering the object's orientation and illumination in the process. Throughout, we present experimental results, achieved in real-time, demonstrating the effectiveness of our methods.

Original languageEnglish (US)
Pages (from-to)82-91
Number of pages10
JournalPattern Analysis and Applications
Issue number1
StatePublished - Jan 1 1999
Externally publishedYes


  • Illumination modelling
  • Image sequence analysis
  • Pose estimation
  • Tracking

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Tracking in 3D: Image variability decomposition for recovering object pose and illumination'. Together they form a unique fingerprint.

Cite this