OneSLAM to map them all: a generalized approach to SLAM for monocular endoscopic imaging based on tracking any point

Timo Teufel, Hongchao Shu, Roger D. Soberanis-Mukul, Jan Emily Mangulabnan, Manish Sahu, S. Swaroop Vedula, Masaru Ishii, Gregory Hager, Russell H. Taylor, Mathias Unberath

Research output: Contribution to journalArticlepeer-review

Abstract

Purpose : Monocular SLAM algorithms are the key enabling technology for image-based surgical navigation systems for endoscopic procedures. Due to the visual feature scarcity and unique lighting conditions encountered in endoscopy, classical SLAM approaches perform inconsistently. Many of the recent approaches to endoscopic SLAM rely on deep learning models. They show promising results when optimized on singular domains such as arthroscopy, sinus endoscopy, colonoscopy or laparoscopy, but are limited by an inability to generalize to different domains without retraining. Methods : To address this generality issue, we propose OneSLAM a monocular SLAM algorithm for surgical endoscopy that works out of the box for several endoscopic domains, including sinus endoscopy, colonoscopy, arthroscopy and laparoscopy. Our pipeline builds upon robust tracking any point (TAP) foundation models to reliably track sparse correspondences across multiple frames and runs local bundle adjustment to jointly optimize camera poses and a sparse 3D reconstruction of the anatomy. Results : We compare the performance of our method against three strong baselines previously proposed for monocular SLAM in endoscopy and general scenes. OneSLAM presents better or comparable performance over existing approaches targeted to that specific data in all four tested domains, generalizing across domains without the need for retraining. Conclusion : OneSLAM benefits from the convincing performance of TAP foundation models but generalizes to endoscopic sequences of different anatomies all while demonstrating better or comparable performance over domain-specific SLAM approaches. Future research on global loop closure will investigate how to reliably detect loops in endoscopic scenes to reduce accumulated drift and enhance long-term navigation capabilities.

Original languageEnglish (US)
Pages (from-to)1259-1266
Number of pages8
JournalInternational Journal of Computer Assisted Radiology and Surgery
Volume19
Issue number7
DOIs
StatePublished - Jul 2024

Keywords

  • 3D motion estimation
  • Arthroscopy
  • Computer vision
  • Endoscopy
  • Image-based navigation
  • Monocular SLAM
  • Tracking any point

ASJC Scopus subject areas

  • Surgery
  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging
  • Computer Vision and Pattern Recognition
  • Computer Science Applications
  • Health Informatics
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'OneSLAM to map them all: a generalized approach to SLAM for monocular endoscopic imaging based on tracking any point'. Together they form a unique fingerprint.

Cite this