Radiology report annotation using intelligent word embeddings: Applied to multi-institutional chest CT cohort

Imon Banerjee, Matthew C. Chen, Matthew P. Lungren, Daniel L. Rubin

Research output: Contribution to journalArticlepeer-review

Abstract

We proposed an unsupervised hybrid method – Intelligent Word Embedding (IWE) that combines neural embedding method with a semantic dictionary mapping technique for creating a dense vector representation of unstructured radiology reports. We applied IWE to generate embedding of chest CT radiology reports from two healthcare organizations and utilized the vector representations to semi-automate report categorization based on clinically relevant categorization related to the diagnosis of pulmonary embolism (PE). We benchmark the performance against a state-of-the-art rule-based tool, PeFinder and out-of-the-box word2vec. On the Stanford test set, the IWE model achieved average F1 score 0.97, whereas the PeFinder scored 0.9 and the original word2vec scored 0.94. On UPMC dataset, the IWE model's average F1 score was 0.94, when the PeFinder scored 0.92 and word2vec scored 0.85. The IWE model had lowest generalization error with highest F1 scores. Of particular interest, the IWE model (trained on the Stanford dataset) outperformed PeFinder on the UPMC dataset which was used originally to tailor the PeFinder model.

Original languageEnglish (US)
Pages (from-to)11-20
Number of pages10
JournalJournal of Biomedical Informatics
Volume77
DOIs
StatePublished - Jan 2018

Keywords

  • Information extraction
  • Pulmonary embolism
  • Report annotation
  • Word embedding

ASJC Scopus subject areas

  • Computer Science Applications
  • Health Informatics

Fingerprint

Dive into the research topics of 'Radiology report annotation using intelligent word embeddings: Applied to multi-institutional chest CT cohort'. Together they form a unique fingerprint.

Cite this