Estimation of Observer Performance for Reduced Radiation Dose Levels in CT. Eliminating Reduced Dose Levels That Are Too Low Is the First Step

Joel Garland Fletcher, Lifeng Yu, Jeff L. Fidler, David L. Levin, David R. DeLone, David M. Hough, Naoki Takahashi, Sudhakar K Venkatesh, Anne-Marie Gisele Sykes, Darin White, Rebecca M. Lindell, Amy L. Kotsenas, Norbert G Campeau, Vance T Lehman, Adam C. Bartley, Shuai Leng, David R. Holmes III, Alicia Y. Toledano, Rickey E. Carter, Cynthia H McCollough

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Rationale and Objectives: This study aims to estimate observer performance for a range of dose levels for common computed tomography (CT) examinations (detection of liver metastases or pulmonary nodules, and cause of neurologic deficit) to prioritize noninferior dose levels for further analysis. Materials and Methods: Using CT data from 131 examinations (abdominal CT, 44; chest CT, 44; head CT, 43), CT images corresponding to 4%-100% of the routine clinical dose were reconstructed with filtered back projection or iterative reconstruction. Radiologists evaluated CT images, marking specified targets, providing confidence scores, and grading image quality. Noninferiority was assessed using reference standards, reader agreement rules, and jackknife alternative free-response receiver operating characteristic figures of merit. Reader agreement required that a majority of readers at lower dose identify target lesions seen by the majority of readers at routine dose. Results: Reader agreement identified dose levels lower than 50% and 4% to have inadequate performance for detection of hepatic metastases and pulmonary nodules, respectively, but could not exclude any low dose levels for head CT. Estimated differences in jackknife alternative free-response receiver operating characteristic figures of merit between routine and lower dose configurations found that only the lowest dose configurations tested (ie, 30%, 4%, and 10% of routine dose levels for abdominal, chest, and head CT examinations, respectively) did not meet criteria for noninferiority. At lower doses, subjective image quality declined before observer performance. Iterative reconstruction was only beneficial when filtered back projection did not result in noninferior performance. Conclusion: Opportunity exists for substantial radiation dose reduction using existing CT technology for common diagnostic tasks.

Original languageEnglish (US)
JournalAcademic Radiology
DOIs
StateAccepted/In press - Aug 30 2016

Fingerprint

Tomography
Radiation
Head
ROC Curve
Thorax
Neoplasm Metastasis
Lung
Liver
Neurologic Manifestations
Technology

Keywords

  • CT
  • Iterative reconstruction
  • Observer performance
  • Radiation dose
  • Radiation dose reduction

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Estimation of Observer Performance for Reduced Radiation Dose Levels in CT. Eliminating Reduced Dose Levels That Are Too Low Is the First Step. / Fletcher, Joel Garland; Yu, Lifeng; Fidler, Jeff L.; Levin, David L.; DeLone, David R.; Hough, David M.; Takahashi, Naoki; Venkatesh, Sudhakar K; Sykes, Anne-Marie Gisele; White, Darin; Lindell, Rebecca M.; Kotsenas, Amy L.; Campeau, Norbert G; Lehman, Vance T; Bartley, Adam C.; Leng, Shuai; Holmes III, David R.; Toledano, Alicia Y.; Carter, Rickey E.; McCollough, Cynthia H.

In: Academic Radiology, 30.08.2016.

Research output: Contribution to journalArticle

@article{18c91ff4612f428aabad3dc1938db2ea,
title = "Estimation of Observer Performance for Reduced Radiation Dose Levels in CT. Eliminating Reduced Dose Levels That Are Too Low Is the First Step",
abstract = "Rationale and Objectives: This study aims to estimate observer performance for a range of dose levels for common computed tomography (CT) examinations (detection of liver metastases or pulmonary nodules, and cause of neurologic deficit) to prioritize noninferior dose levels for further analysis. Materials and Methods: Using CT data from 131 examinations (abdominal CT, 44; chest CT, 44; head CT, 43), CT images corresponding to 4{\%}-100{\%} of the routine clinical dose were reconstructed with filtered back projection or iterative reconstruction. Radiologists evaluated CT images, marking specified targets, providing confidence scores, and grading image quality. Noninferiority was assessed using reference standards, reader agreement rules, and jackknife alternative free-response receiver operating characteristic figures of merit. Reader agreement required that a majority of readers at lower dose identify target lesions seen by the majority of readers at routine dose. Results: Reader agreement identified dose levels lower than 50{\%} and 4{\%} to have inadequate performance for detection of hepatic metastases and pulmonary nodules, respectively, but could not exclude any low dose levels for head CT. Estimated differences in jackknife alternative free-response receiver operating characteristic figures of merit between routine and lower dose configurations found that only the lowest dose configurations tested (ie, 30{\%}, 4{\%}, and 10{\%} of routine dose levels for abdominal, chest, and head CT examinations, respectively) did not meet criteria for noninferiority. At lower doses, subjective image quality declined before observer performance. Iterative reconstruction was only beneficial when filtered back projection did not result in noninferior performance. Conclusion: Opportunity exists for substantial radiation dose reduction using existing CT technology for common diagnostic tasks.",
keywords = "CT, Iterative reconstruction, Observer performance, Radiation dose, Radiation dose reduction",
author = "Fletcher, {Joel Garland} and Lifeng Yu and Fidler, {Jeff L.} and Levin, {David L.} and DeLone, {David R.} and Hough, {David M.} and Naoki Takahashi and Venkatesh, {Sudhakar K} and Sykes, {Anne-Marie Gisele} and Darin White and Lindell, {Rebecca M.} and Kotsenas, {Amy L.} and Campeau, {Norbert G} and Lehman, {Vance T} and Bartley, {Adam C.} and Shuai Leng and {Holmes III}, {David R.} and Toledano, {Alicia Y.} and Carter, {Rickey E.} and McCollough, {Cynthia H}",
year = "2016",
month = "8",
day = "30",
doi = "10.1016/j.acra.2016.12.017",
language = "English (US)",
journal = "Academic Radiology",
issn = "1076-6332",
publisher = "Elsevier USA",

}

TY - JOUR

T1 - Estimation of Observer Performance for Reduced Radiation Dose Levels in CT. Eliminating Reduced Dose Levels That Are Too Low Is the First Step

AU - Fletcher, Joel Garland

AU - Yu, Lifeng

AU - Fidler, Jeff L.

AU - Levin, David L.

AU - DeLone, David R.

AU - Hough, David M.

AU - Takahashi, Naoki

AU - Venkatesh, Sudhakar K

AU - Sykes, Anne-Marie Gisele

AU - White, Darin

AU - Lindell, Rebecca M.

AU - Kotsenas, Amy L.

AU - Campeau, Norbert G

AU - Lehman, Vance T

AU - Bartley, Adam C.

AU - Leng, Shuai

AU - Holmes III, David R.

AU - Toledano, Alicia Y.

AU - Carter, Rickey E.

AU - McCollough, Cynthia H

PY - 2016/8/30

Y1 - 2016/8/30

N2 - Rationale and Objectives: This study aims to estimate observer performance for a range of dose levels for common computed tomography (CT) examinations (detection of liver metastases or pulmonary nodules, and cause of neurologic deficit) to prioritize noninferior dose levels for further analysis. Materials and Methods: Using CT data from 131 examinations (abdominal CT, 44; chest CT, 44; head CT, 43), CT images corresponding to 4%-100% of the routine clinical dose were reconstructed with filtered back projection or iterative reconstruction. Radiologists evaluated CT images, marking specified targets, providing confidence scores, and grading image quality. Noninferiority was assessed using reference standards, reader agreement rules, and jackknife alternative free-response receiver operating characteristic figures of merit. Reader agreement required that a majority of readers at lower dose identify target lesions seen by the majority of readers at routine dose. Results: Reader agreement identified dose levels lower than 50% and 4% to have inadequate performance for detection of hepatic metastases and pulmonary nodules, respectively, but could not exclude any low dose levels for head CT. Estimated differences in jackknife alternative free-response receiver operating characteristic figures of merit between routine and lower dose configurations found that only the lowest dose configurations tested (ie, 30%, 4%, and 10% of routine dose levels for abdominal, chest, and head CT examinations, respectively) did not meet criteria for noninferiority. At lower doses, subjective image quality declined before observer performance. Iterative reconstruction was only beneficial when filtered back projection did not result in noninferior performance. Conclusion: Opportunity exists for substantial radiation dose reduction using existing CT technology for common diagnostic tasks.

AB - Rationale and Objectives: This study aims to estimate observer performance for a range of dose levels for common computed tomography (CT) examinations (detection of liver metastases or pulmonary nodules, and cause of neurologic deficit) to prioritize noninferior dose levels for further analysis. Materials and Methods: Using CT data from 131 examinations (abdominal CT, 44; chest CT, 44; head CT, 43), CT images corresponding to 4%-100% of the routine clinical dose were reconstructed with filtered back projection or iterative reconstruction. Radiologists evaluated CT images, marking specified targets, providing confidence scores, and grading image quality. Noninferiority was assessed using reference standards, reader agreement rules, and jackknife alternative free-response receiver operating characteristic figures of merit. Reader agreement required that a majority of readers at lower dose identify target lesions seen by the majority of readers at routine dose. Results: Reader agreement identified dose levels lower than 50% and 4% to have inadequate performance for detection of hepatic metastases and pulmonary nodules, respectively, but could not exclude any low dose levels for head CT. Estimated differences in jackknife alternative free-response receiver operating characteristic figures of merit between routine and lower dose configurations found that only the lowest dose configurations tested (ie, 30%, 4%, and 10% of routine dose levels for abdominal, chest, and head CT examinations, respectively) did not meet criteria for noninferiority. At lower doses, subjective image quality declined before observer performance. Iterative reconstruction was only beneficial when filtered back projection did not result in noninferior performance. Conclusion: Opportunity exists for substantial radiation dose reduction using existing CT technology for common diagnostic tasks.

KW - CT

KW - Iterative reconstruction

KW - Observer performance

KW - Radiation dose

KW - Radiation dose reduction

UR - http://www.scopus.com/inward/record.url?scp=85014106027&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85014106027&partnerID=8YFLogxK

U2 - 10.1016/j.acra.2016.12.017

DO - 10.1016/j.acra.2016.12.017

M3 - Article

C2 - 28262519

AN - SCOPUS:85014106027

JO - Academic Radiology

JF - Academic Radiology

SN - 1076-6332

ER -