Interrater and intermethod reliability of default mode network selection

Alexandre R. Franco, Aaron Pritchard, Vince D. Calhoun, Andrew R. Mayer

Research output: Contribution to journalArticlepeer-review

92 Scopus citations


There has been a growing interest in the neuroimaging community regarding resting state data (i.e., passive mental activity) and the subsequent activation of the so-called default mode network (DMN). Although this network was originally characterized by a pattern of deactivation during active cognitive states, more recent applications of data-driven techniques such as independent component analysis (ICA) have permitted the analysis of brain activation during extended periods of truly passive mental activity. However, ICA requires the resultant components to be evaluated for "goodness of fit" via either human raters or more automated techniques. To our knowledge, an investigation on the reliability of either technique in determining the component that best corresponds to default-mode activity has not been performed. Moreover, it is not clear how automated techniques, which are necessarily dependent upon a template mask, are affected by the structures used to compose the mask. The current study investigated both interrater (human-human) reliability and intermethod (human-machine) reliability for determining DMN activation in 42 healthy controls. Results indicated that near perfect interrater reliability was achieved, whereas intermethod reliability was only within the moderate range. The latter was significantly improved via a weighted combination of the anterior and posterior cingulate nodes of the DMN. Implications for fully automating the component selection process are discussed.

Original languageEnglish (US)
Pages (from-to)2293-2303
Number of pages11
JournalHuman Brain Mapping
Issue number7
StatePublished - Jul 2009
Externally publishedYes


  • Default mode network
  • Independent component analysis
  • Reliability
  • fMRI

ASJC Scopus subject areas

  • Anatomy
  • Radiological and Ultrasound Technology
  • Radiology Nuclear Medicine and imaging
  • Neurology
  • Clinical Neurology


Dive into the research topics of 'Interrater and intermethod reliability of default mode network selection'. Together they form a unique fingerprint.

Cite this