Random search as a neural network optimization strategy for Convolutional-Neural-Network (CNN)-based noise reduction in CT

Nathan R. Huber, Andrew D. Missert, Hao Gong, Scott S. Hsieh, Shuai Leng, Lifeng Yu, Cynthia H. McCollough

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this study, we describe a systematic approach to optimize deep-learning-based image processing algorithms using random search. The optimization technique is demonstrated on a phantom-based noise reduction training framework; however, the techniques described can be applied generally for other deep learning image processing applications. The parameter space explored included number of convolutional layers, number of filters, kernel size, loss function, and network architecture (either U-Net or ResNet). A total of 100 network models were examined (50 random search, 50 ablation experiments). Following the random search, ablation experiments resulted in a very minor performance improvement indicating near optimal settings were found during the random search. The top performing network architecture was a U-Net with 4 pooling layers, 64 filters, 3x3 kernel size, ELU activation, and a weighted feature reconstruction loss (0.2×VGG + 0.8×MSE). Relative to the low-dose input image, the CNN reduced noise by 90%, reduced RMSE by 34%, and increased SSIM by 76% on six patient exams reserved for testing. The visualization of hepatic and bone lesions was greatly improved following noise reduction.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2021
Subtitle of host publicationImage Processing
EditorsIvana Isgum, Bennett A. Landman
PublisherSPIE
ISBN (Electronic)9781510640214
DOIs
StatePublished - 2021
EventMedical Imaging 2021: Image Processing - Virtual, Online, United States
Duration: Feb 15 2021Feb 19 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume11596
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2021: Image Processing
CountryUnited States
CityVirtual, Online
Period2/15/212/19/21

Keywords

  • Deep learning
  • Hyper-parameter optimization
  • Noise reduction
  • Random search

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Random search as a neural network optimization strategy for Convolutional-Neural-Network (CNN)-based noise reduction in CT'. Together they form a unique fingerprint.

Cite this