Data-driven visual tracking in retinal microsurgery

Raphael Sznitman, Karim Ali, Rogério Richa, Russell H. Taylor, Gregory D. Hager, Pascal Fua

Research output: Chapter in Book/Report/Conference proceedingConference contribution

44 Scopus citations


In the context of retinal microsurgery, visual tracking of instruments is a key component of robotics assistance. The difficulty of the task and major reason why most existing strategies fail on in-vivo image sequences lies in the fact that complex and severe changes in instrument appearance are challenging to model. This paper introduces a novel approach, that is both data-driven and complementary to existing tracking techniques. In particular, we show how to learn and integrate an accurate detector with a simple gradient-based tracker within a robust pipeline which runs at framerate. In addition, we present a fully annotated dataset of retinal instruments in in-vivo surgeries, which we use to quantitatively validate our approach. We also demonstrate an application of our method in a laparascopy image sequence.

Original languageEnglish (US)
Title of host publicationMedical Image Computing and Computer-Assisted Intervention - MICCAI2012 - 15th International Conference, Proceedings
EditorsLe Lu, Antonio Criminisi, Georg Langs, Albert Montillo, Bjoern H. Menze, Nicholas Ayache, Hervé Delingette, Bjoern H. Menze, Georg Langs, Zhuowen Tu, Polina Golland, Kensaku Mori
PublisherSpringer Verlag
Number of pages8
ISBN (Print)9783642334177
StatePublished - 2012
Event15th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2012 - Nice, France
Duration: Oct 5 2012Oct 5 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7511 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference15th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2012

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Data-driven visual tracking in retinal microsurgery'. Together they form a unique fingerprint.

Cite this