Evaluation of a projection-domain lung nodule insertion technique in thoracic computed tomography

Chi Ma, Lifeng Yu, Baiyu Chen, Chi Wan Koo, Edwin A. Takahashi, Joel Garland Fletcher, David L. Levin, Ronald S Kuzo, Lyndsay D. Viers, Stephanie A. Vincent-Sheldon, Shuai Leng, Cynthia H McCollough

Research output: Contribution to journalArticle

Abstract

Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Prospective case acquisition can be time-consuming. Inserting lesions into existing cases to simulate positive cases is a promising alternative. The aim was to evaluate a recently developed projection-based lesion insertion technique in thoracic CT. In total, 32 lung nodules of various attenuations were segmented from 21 patient cases, forward projected, inserted into projections, and reconstructed. Two experienced radiologists and two residents independently evaluated these nodules in two substudies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a score from 1 to 10 (1 = absolutely artificial to 10 = absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader. For the randomized evaluation, discrimination of real versus inserted nodules was poor with areas under the receiver operative characteristic curves being 0.57 [95% confidence interval (CI): 0.46 to 0.68], 0.69 (95% CI: 0.58 to 0.78), and 0.62 (95% CI: 0.54 to 0.69) for the two residents, two radiologists, and all four readers, respectively. Our projection-based lung nodule insertion technique provides a robust method to artificially generate positive cases that prove to be difficult to differentiate from real cases.

Original languageEnglish (US)
Article number013510
JournalJournal of Medical Imaging
Volume4
Issue number1
DOIs
StatePublished - Jan 1 2017

Fingerprint

Tomography
Thorax
Confidence Intervals
Lung
Image quality
Radiologists

Keywords

  • Image quality assessment
  • Lesion insertion
  • Lesion simulation
  • Lung nodule
  • Observer study
  • Radiation dose reduction
  • Thoracic computed tomography

ASJC Scopus subject areas

  • Bioengineering
  • Radiology Nuclear Medicine and imaging

Cite this

Evaluation of a projection-domain lung nodule insertion technique in thoracic computed tomography. / Ma, Chi; Yu, Lifeng; Chen, Baiyu; Koo, Chi Wan; Takahashi, Edwin A.; Fletcher, Joel Garland; Levin, David L.; Kuzo, Ronald S; Viers, Lyndsay D.; Vincent-Sheldon, Stephanie A.; Leng, Shuai; McCollough, Cynthia H.

In: Journal of Medical Imaging, Vol. 4, No. 1, 013510, 01.01.2017.

Research output: Contribution to journalArticle

Ma, Chi ; Yu, Lifeng ; Chen, Baiyu ; Koo, Chi Wan ; Takahashi, Edwin A. ; Fletcher, Joel Garland ; Levin, David L. ; Kuzo, Ronald S ; Viers, Lyndsay D. ; Vincent-Sheldon, Stephanie A. ; Leng, Shuai ; McCollough, Cynthia H. / Evaluation of a projection-domain lung nodule insertion technique in thoracic computed tomography. In: Journal of Medical Imaging. 2017 ; Vol. 4, No. 1.
@article{9924c90cfcf54468baffd8c2954fd643,
title = "Evaluation of a projection-domain lung nodule insertion technique in thoracic computed tomography",
abstract = "Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Prospective case acquisition can be time-consuming. Inserting lesions into existing cases to simulate positive cases is a promising alternative. The aim was to evaluate a recently developed projection-based lesion insertion technique in thoracic CT. In total, 32 lung nodules of various attenuations were segmented from 21 patient cases, forward projected, inserted into projections, and reconstructed. Two experienced radiologists and two residents independently evaluated these nodules in two substudies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a score from 1 to 10 (1 = absolutely artificial to 10 = absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader. For the randomized evaluation, discrimination of real versus inserted nodules was poor with areas under the receiver operative characteristic curves being 0.57 [95{\%} confidence interval (CI): 0.46 to 0.68], 0.69 (95{\%} CI: 0.58 to 0.78), and 0.62 (95{\%} CI: 0.54 to 0.69) for the two residents, two radiologists, and all four readers, respectively. Our projection-based lung nodule insertion technique provides a robust method to artificially generate positive cases that prove to be difficult to differentiate from real cases.",
keywords = "Image quality assessment, Lesion insertion, Lesion simulation, Lung nodule, Observer study, Radiation dose reduction, Thoracic computed tomography",
author = "Chi Ma and Lifeng Yu and Baiyu Chen and Koo, {Chi Wan} and Takahashi, {Edwin A.} and Fletcher, {Joel Garland} and Levin, {David L.} and Kuzo, {Ronald S} and Viers, {Lyndsay D.} and Vincent-Sheldon, {Stephanie A.} and Shuai Leng and McCollough, {Cynthia H}",
year = "2017",
month = "1",
day = "1",
doi = "10.1117/1.JMI.4.1.013510",
language = "English (US)",
volume = "4",
journal = "Journal of Medical Imaging",
issn = "0720-048X",
publisher = "Elsevier Ireland Ltd",
number = "1",

}

TY - JOUR

T1 - Evaluation of a projection-domain lung nodule insertion technique in thoracic computed tomography

AU - Ma, Chi

AU - Yu, Lifeng

AU - Chen, Baiyu

AU - Koo, Chi Wan

AU - Takahashi, Edwin A.

AU - Fletcher, Joel Garland

AU - Levin, David L.

AU - Kuzo, Ronald S

AU - Viers, Lyndsay D.

AU - Vincent-Sheldon, Stephanie A.

AU - Leng, Shuai

AU - McCollough, Cynthia H

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Prospective case acquisition can be time-consuming. Inserting lesions into existing cases to simulate positive cases is a promising alternative. The aim was to evaluate a recently developed projection-based lesion insertion technique in thoracic CT. In total, 32 lung nodules of various attenuations were segmented from 21 patient cases, forward projected, inserted into projections, and reconstructed. Two experienced radiologists and two residents independently evaluated these nodules in two substudies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a score from 1 to 10 (1 = absolutely artificial to 10 = absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader. For the randomized evaluation, discrimination of real versus inserted nodules was poor with areas under the receiver operative characteristic curves being 0.57 [95% confidence interval (CI): 0.46 to 0.68], 0.69 (95% CI: 0.58 to 0.78), and 0.62 (95% CI: 0.54 to 0.69) for the two residents, two radiologists, and all four readers, respectively. Our projection-based lung nodule insertion technique provides a robust method to artificially generate positive cases that prove to be difficult to differentiate from real cases.

AB - Task-based assessment of computed tomography (CT) image quality requires a large number of cases with ground truth. Prospective case acquisition can be time-consuming. Inserting lesions into existing cases to simulate positive cases is a promising alternative. The aim was to evaluate a recently developed projection-based lesion insertion technique in thoracic CT. In total, 32 lung nodules of various attenuations were segmented from 21 patient cases, forward projected, inserted into projections, and reconstructed. Two experienced radiologists and two residents independently evaluated these nodules in two substudies. First, the 32 inserted and the 32 original nodules were presented in a randomized order and each received a score from 1 to 10 (1 = absolutely artificial to 10 = absolutely realistic). Second, the inserted and the corresponding original lesions were presented side-by-side to each reader. For the randomized evaluation, discrimination of real versus inserted nodules was poor with areas under the receiver operative characteristic curves being 0.57 [95% confidence interval (CI): 0.46 to 0.68], 0.69 (95% CI: 0.58 to 0.78), and 0.62 (95% CI: 0.54 to 0.69) for the two residents, two radiologists, and all four readers, respectively. Our projection-based lung nodule insertion technique provides a robust method to artificially generate positive cases that prove to be difficult to differentiate from real cases.

KW - Image quality assessment

KW - Lesion insertion

KW - Lesion simulation

KW - Lung nodule

KW - Observer study

KW - Radiation dose reduction

KW - Thoracic computed tomography

UR - http://www.scopus.com/inward/record.url?scp=85016600371&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016600371&partnerID=8YFLogxK

U2 - 10.1117/1.JMI.4.1.013510

DO - 10.1117/1.JMI.4.1.013510

M3 - Article

AN - SCOPUS:85016600371

VL - 4

JO - Journal of Medical Imaging

JF - Journal of Medical Imaging

SN - 0720-048X

IS - 1

M1 - 013510

ER -