A portable projection mapping device for medical augmented reality in single-stage cranioplasty

Shuya Liu, Wei Lun Huang, Austin Shin, Chad Gordon, Mehran Armand

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We introduce a portable projection mapping device (PPMD) for extracting and projecting implant geometric data in single-stage cranioplasty surgery. Our system consists of a real-time tracking device, which tracks the reference markers fixed on the skull, and a digitizing probe for localizing the contour of the cranial defect for modifying the oversized customized cranial implant (CCI). The feature points on the surface of the skull are registered to the reconstructed surface model of the skull obtained from CT image. The CT model is then projected on the surface of the skull. The digitizer is used to outline the geometry of the skull resection with sub-millimeter tracking accuracy. The proposed PPMD and its associated pipeline enable intraoperative cranial implant modification with image feedback to surgeons for the very first time. Our proposed PPMD system, an inexpensive device can also be used for other medical augmented reality applications, especially when direct projection mapping is preferred over the use of wearable head-mounted displays.

Original languageEnglish (US)
Title of host publicationOptical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR)
EditorsBernard C. Kress, Christophe Peroz
PublisherSPIE
ISBN (Electronic)9781510633872
DOIs
StatePublished - 2020
EventOptical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) 2020 - San Francisco, United States
Duration: Feb 2 2020 → …

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11310
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceOptical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) 2020
Country/TerritoryUnited States
CitySan Francisco
Period2/2/20 → …

Keywords

  • Augmented reality
  • IR tracking
  • Projection mapping
  • Single-stage cranioplasty

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'A portable projection mapping device for medical augmented reality in single-stage cranioplasty'. Together they form a unique fingerprint.

Cite this