Lexicon for standardized interpretation of gamma camera molecular breast imaging

Observer agreement and diagnostic accuracy

Amy Lynn Conners, Carrie B Hruska, Cindy L. Tortorelli, Robert W. Maxwell, Deborah Rhodes, Judy C Boughey, Wendie A. Berg

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

Purpose: To determine interobserver agreement and diagnostic accuracy using a lexicon for standardized interpretation of molecular breast imaging (MBI) studies by breast radiologists. Methods: An MBI lexicon was developed, including descriptors of lesion type, background uptake, and associated findings by a consensus of experts. In an institutional review board-exempted protocol, six breast imaging radiologist observers without prior MBI experience attended a 2-h MBI interpretation training session, including definitions of lexicon terminology, case examples, and ten unknown cases with expert feedback. Following training, each radiologist observer interpreted an independent set of MBI images of 50 breasts, including 20 (40%) with malignancies with a median invasive tumor size of 1.7 cm (range 1.0 to 6.3 cm). The findings were described using the lexicon and each breast was given a final assessment of 1 to 5, paralleling BI-RADS assessment categories. Sensitivity, specificity, positive and negative predictive values were determined with core or surgical pathology results or 1-year imaging follow-up as the reference standard. Interobserver agreement for lesion-type classification, lesion and background uptake intensity, and final assessments were determined using Cohen's kappa. Results: For the six observers, median sensitivity was 1.0 (range 0.90-1.0), specificity 0.88 (range 0.83-0.97), and AUC 0.94 (range 0.93-0.98). Fair interobserver agreement was shown for background uptake (κ=0.31). Agreement was substantial for lesion type (κ=0.79) and non-mass distribution (κ=0.63), and near-perfect for final assessment (κ=0.84). Conclusion: Dedicated breast imaging radiologists, newly trained to interpret MBI with the proposed lexicon, achieved high agreement and diagnostic accuracy.

Original languageEnglish (US)
Pages (from-to)971-982
Number of pages12
JournalEuropean Journal of Nuclear Medicine and Molecular Imaging
Volume39
Issue number6
DOIs
StatePublished - Jun 2012

Fingerprint

Gamma Cameras
Molecular Imaging
Breast
Surgical Pathology
Research Ethics Committees
Terminology
Area Under Curve
Neoplasms

Keywords

  • Gamma camera
  • Lexicon
  • Molecular breast imaging
  • Observer agreement
  • Scintimammography
  • Training

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Lexicon for standardized interpretation of gamma camera molecular breast imaging : Observer agreement and diagnostic accuracy. / Conners, Amy Lynn; Hruska, Carrie B; Tortorelli, Cindy L.; Maxwell, Robert W.; Rhodes, Deborah; Boughey, Judy C; Berg, Wendie A.

In: European Journal of Nuclear Medicine and Molecular Imaging, Vol. 39, No. 6, 06.2012, p. 971-982.

Research output: Contribution to journalArticle

@article{152e9ed42ef04ac0b528a190586055fb,
title = "Lexicon for standardized interpretation of gamma camera molecular breast imaging: Observer agreement and diagnostic accuracy",
abstract = "Purpose: To determine interobserver agreement and diagnostic accuracy using a lexicon for standardized interpretation of molecular breast imaging (MBI) studies by breast radiologists. Methods: An MBI lexicon was developed, including descriptors of lesion type, background uptake, and associated findings by a consensus of experts. In an institutional review board-exempted protocol, six breast imaging radiologist observers without prior MBI experience attended a 2-h MBI interpretation training session, including definitions of lexicon terminology, case examples, and ten unknown cases with expert feedback. Following training, each radiologist observer interpreted an independent set of MBI images of 50 breasts, including 20 (40{\%}) with malignancies with a median invasive tumor size of 1.7 cm (range 1.0 to 6.3 cm). The findings were described using the lexicon and each breast was given a final assessment of 1 to 5, paralleling BI-RADS assessment categories. Sensitivity, specificity, positive and negative predictive values were determined with core or surgical pathology results or 1-year imaging follow-up as the reference standard. Interobserver agreement for lesion-type classification, lesion and background uptake intensity, and final assessments were determined using Cohen's kappa. Results: For the six observers, median sensitivity was 1.0 (range 0.90-1.0), specificity 0.88 (range 0.83-0.97), and AUC 0.94 (range 0.93-0.98). Fair interobserver agreement was shown for background uptake (κ=0.31). Agreement was substantial for lesion type (κ=0.79) and non-mass distribution (κ=0.63), and near-perfect for final assessment (κ=0.84). Conclusion: Dedicated breast imaging radiologists, newly trained to interpret MBI with the proposed lexicon, achieved high agreement and diagnostic accuracy.",
keywords = "Gamma camera, Lexicon, Molecular breast imaging, Observer agreement, Scintimammography, Training",
author = "Conners, {Amy Lynn} and Hruska, {Carrie B} and Tortorelli, {Cindy L.} and Maxwell, {Robert W.} and Deborah Rhodes and Boughey, {Judy C} and Berg, {Wendie A.}",
year = "2012",
month = "6",
doi = "10.1007/s00259-011-2054-z",
language = "English (US)",
volume = "39",
pages = "971--982",
journal = "European Journal of Nuclear Medicine and Molecular Imaging",
issn = "1619-7070",
publisher = "Springer Verlag",
number = "6",

}

TY - JOUR

T1 - Lexicon for standardized interpretation of gamma camera molecular breast imaging

T2 - Observer agreement and diagnostic accuracy

AU - Conners, Amy Lynn

AU - Hruska, Carrie B

AU - Tortorelli, Cindy L.

AU - Maxwell, Robert W.

AU - Rhodes, Deborah

AU - Boughey, Judy C

AU - Berg, Wendie A.

PY - 2012/6

Y1 - 2012/6

N2 - Purpose: To determine interobserver agreement and diagnostic accuracy using a lexicon for standardized interpretation of molecular breast imaging (MBI) studies by breast radiologists. Methods: An MBI lexicon was developed, including descriptors of lesion type, background uptake, and associated findings by a consensus of experts. In an institutional review board-exempted protocol, six breast imaging radiologist observers without prior MBI experience attended a 2-h MBI interpretation training session, including definitions of lexicon terminology, case examples, and ten unknown cases with expert feedback. Following training, each radiologist observer interpreted an independent set of MBI images of 50 breasts, including 20 (40%) with malignancies with a median invasive tumor size of 1.7 cm (range 1.0 to 6.3 cm). The findings were described using the lexicon and each breast was given a final assessment of 1 to 5, paralleling BI-RADS assessment categories. Sensitivity, specificity, positive and negative predictive values were determined with core or surgical pathology results or 1-year imaging follow-up as the reference standard. Interobserver agreement for lesion-type classification, lesion and background uptake intensity, and final assessments were determined using Cohen's kappa. Results: For the six observers, median sensitivity was 1.0 (range 0.90-1.0), specificity 0.88 (range 0.83-0.97), and AUC 0.94 (range 0.93-0.98). Fair interobserver agreement was shown for background uptake (κ=0.31). Agreement was substantial for lesion type (κ=0.79) and non-mass distribution (κ=0.63), and near-perfect for final assessment (κ=0.84). Conclusion: Dedicated breast imaging radiologists, newly trained to interpret MBI with the proposed lexicon, achieved high agreement and diagnostic accuracy.

AB - Purpose: To determine interobserver agreement and diagnostic accuracy using a lexicon for standardized interpretation of molecular breast imaging (MBI) studies by breast radiologists. Methods: An MBI lexicon was developed, including descriptors of lesion type, background uptake, and associated findings by a consensus of experts. In an institutional review board-exempted protocol, six breast imaging radiologist observers without prior MBI experience attended a 2-h MBI interpretation training session, including definitions of lexicon terminology, case examples, and ten unknown cases with expert feedback. Following training, each radiologist observer interpreted an independent set of MBI images of 50 breasts, including 20 (40%) with malignancies with a median invasive tumor size of 1.7 cm (range 1.0 to 6.3 cm). The findings were described using the lexicon and each breast was given a final assessment of 1 to 5, paralleling BI-RADS assessment categories. Sensitivity, specificity, positive and negative predictive values were determined with core or surgical pathology results or 1-year imaging follow-up as the reference standard. Interobserver agreement for lesion-type classification, lesion and background uptake intensity, and final assessments were determined using Cohen's kappa. Results: For the six observers, median sensitivity was 1.0 (range 0.90-1.0), specificity 0.88 (range 0.83-0.97), and AUC 0.94 (range 0.93-0.98). Fair interobserver agreement was shown for background uptake (κ=0.31). Agreement was substantial for lesion type (κ=0.79) and non-mass distribution (κ=0.63), and near-perfect for final assessment (κ=0.84). Conclusion: Dedicated breast imaging radiologists, newly trained to interpret MBI with the proposed lexicon, achieved high agreement and diagnostic accuracy.

KW - Gamma camera

KW - Lexicon

KW - Molecular breast imaging

KW - Observer agreement

KW - Scintimammography

KW - Training

UR - http://www.scopus.com/inward/record.url?scp=84862659019&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862659019&partnerID=8YFLogxK

U2 - 10.1007/s00259-011-2054-z

DO - 10.1007/s00259-011-2054-z

M3 - Article

VL - 39

SP - 971

EP - 982

JO - European Journal of Nuclear Medicine and Molecular Imaging

JF - European Journal of Nuclear Medicine and Molecular Imaging

SN - 1619-7070

IS - 6

ER -