Deep multi-modal classification of intraductal papillary mucinous neoplasms (IPMN) with canonical correlation analysis

Sarfaraz Hussein, Pujan Kandel, Juan E. Corral, Candice W. Bolan, Michael B. Wallace, Ulas Bagci

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Pancreatic cancer has the poorest prognosis among all cancer types. Intraductal Papillary Mucinous Neoplasms (IPMNs) are radiographically identifiable precursors to pancreatic cancer; hence, early detection and precise risk assessment of IPMN are vital. In this work, we propose a Convolutional Neural Network (CNN) based computer aided diagnosis (CAD) system to perform IPMN diagnosis and risk assessment by utilizing multi-modal MRI. In our proposed approach, we use minimum and maximum intensity projections to ease the annotation variations among different slices and type of MRIs. Then, we present a CNN to obtain deep feature representation corresponding to each MRI modality (T1-weighted and T2-weighted). At the final step, we employ canonical correlation analysis (CCA) to perform a fusion operation at the feature level, leading to discriminative canonical correlation features. Extracted features are used for classification. Our results indicate significant improvements over other potential approaches to solve this important problem. The proposed approach doesn't require explicit sample balancing in cases of imbalance between positive and negative examples. To the best of our knowledge, our study is the first to automatically diagnose IPMN using multi-modal MRI.

Original languageEnglish (US)
Title of host publication2018 IEEE 15th International Symposium on Biomedical Imaging, ISBI 2018
PublisherIEEE Computer Society
Pages800-804
Number of pages5
ISBN (Electronic)9781538636367
DOIs
StatePublished - May 23 2018
Event15th IEEE International Symposium on Biomedical Imaging, ISBI 2018 - Washington, United States
Duration: Apr 4 2018Apr 7 2018

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2018-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Other

Other15th IEEE International Symposium on Biomedical Imaging, ISBI 2018
CountryUnited States
CityWashington
Period4/4/184/7/18

Keywords

  • Canonical Correlation Analysis (CCA)
  • Deep learning
  • IPMN
  • Magnetic Resonance Imaging (MRI)
  • Pancreatic cancer

ASJC Scopus subject areas

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Deep multi-modal classification of intraductal papillary mucinous neoplasms (IPMN) with canonical correlation analysis'. Together they form a unique fingerprint.

Cite this