Effect of statistical mismatch between training and test images for CNN-based deformable registration

M. D. Ketcha, T. De Silva, R. Han, A. Uneri, S. Vogt, G. Kleinszig, J. H. Siewerdsen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations


Recently, convolutional neural networks (CNNs) have been proposed as a method for deformable image registration, offering a variety of potential advantages compared to physical model-based methods, including faster runtime and ability to learn complicated functions without explicit models. A persistent question for CNNs is the uncertainty in their behavior when the image statistics (e.g., noise and resolution) of the test data deviate from those of the training data. In this work we investigated the influence of statistical properties of image noise (in CT, for example, related to radiation dose) and deformation magnitude, trained registration networks over a range of dose and deformation levels, and evaluated registration performance (target registration error, TRE) as the statistics of the test data deviated from that of the training data. Generally, registration performance was optimal when the statistics of the test data matched that of the training data, except in cases of very low-dose data, where networks trained on a combination of high- and low-dose images achieved best TRE. Furthermore, TRE was found to be limited by the highest dose training data, with no improvement in TRE for test images of higher dose than that in the training data. Understanding and quantifying the relationship between statistical aspects of the training and test data - and the failure modes caused by statistical mismatch - is an important step in the development of CNN-based registration methods. This work provided new insight on the optima and tradeoffs with respect to image noise (dose) and deformation magnitude, providing important guidance in building training sets that are bestsuited to particular imaging conditions and applications.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2019
Subtitle of host publicationImage Processing
EditorsElsa D. Angelini, Elsa D. Angelini, Elsa D. Angelini, Bennett A. Landman
ISBN (Electronic)9781510625457
StatePublished - 2019
EventMedical Imaging 2019: Image Processing - San Diego, United States
Duration: Feb 19 2019Feb 21 2019

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


ConferenceMedical Imaging 2019: Image Processing
Country/TerritoryUnited States
CitySan Diego


  • Convolutional Neural Networks
  • Deformable Image Registration
  • Image Statistics

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Effect of statistical mismatch between training and test images for CNN-based deformable registration'. Together they form a unique fingerprint.

Cite this