Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints

Peter L. Elkin, Steven H. Brown, Andrew Balas, Zelalem Temesgen, Dietlind Wahner-Roedler, David Froehling, Mark Liebow, Brett Trusko, S. Trent Rosenbloom, Greg Poland

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7% for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4%, the negative predictive value was 89.5%, the specificity was 81.0%, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.

Original languageEnglish (US)
Title of host publicationStudies in Health Technology and Informatics
Pages797-802
Number of pages6
Volume136
StatePublished - 2008

Fingerprint

Biosurveillance
Systematized Nomenclature of Medicine
Terminology
Interoperability
Information technology
Ontology
Health
Engines
Specifications
Medical Informatics
Influenza in Birds
Human Influenza
Communicable Diseases
Primary Health Care
Language
Experiments

Keywords

  • Concept representation
  • Epidemiological Research
  • Standards

ASJC Scopus subject areas

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Cite this

Elkin, P. L., Brown, S. H., Balas, A., Temesgen, Z., Wahner-Roedler, D., Froehling, D., ... Poland, G. (2008). Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints. In Studies in Health Technology and Informatics (Vol. 136, pp. 797-802)

Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial) : Coverage of chief complaints. / Elkin, Peter L.; Brown, Steven H.; Balas, Andrew; Temesgen, Zelalem; Wahner-Roedler, Dietlind; Froehling, David; Liebow, Mark; Trusko, Brett; Rosenbloom, S. Trent; Poland, Greg.

Studies in Health Technology and Informatics. Vol. 136 2008. p. 797-802.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Elkin, PL, Brown, SH, Balas, A, Temesgen, Z, Wahner-Roedler, D, Froehling, D, Liebow, M, Trusko, B, Rosenbloom, ST & Poland, G 2008, Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints. in Studies in Health Technology and Informatics. vol. 136, pp. 797-802.
Elkin PL, Brown SH, Balas A, Temesgen Z, Wahner-Roedler D, Froehling D et al. Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints. In Studies in Health Technology and Informatics. Vol. 136. 2008. p. 797-802
Elkin, Peter L. ; Brown, Steven H. ; Balas, Andrew ; Temesgen, Zelalem ; Wahner-Roedler, Dietlind ; Froehling, David ; Liebow, Mark ; Trusko, Brett ; Rosenbloom, S. Trent ; Poland, Greg. / Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial) : Coverage of chief complaints. Studies in Health Technology and Informatics. Vol. 136 2008. pp. 797-802
@inproceedings{2b7cc719d53e4271b00c26506d7390ee,
title = "Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): Coverage of chief complaints",
abstract = "The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7{\%} for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4{\%}, the negative predictive value was 89.5{\%}, the specificity was 81.0{\%}, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.",
keywords = "Concept representation, Epidemiological Research, Standards",
author = "Elkin, {Peter L.} and Brown, {Steven H.} and Andrew Balas and Zelalem Temesgen and Dietlind Wahner-Roedler and David Froehling and Mark Liebow and Brett Trusko and Rosenbloom, {S. Trent} and Greg Poland",
year = "2008",
language = "English (US)",
volume = "136",
pages = "797--802",
booktitle = "Studies in Health Technology and Informatics",

}

TY - GEN

T1 - Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial)

T2 - Coverage of chief complaints

AU - Elkin, Peter L.

AU - Brown, Steven H.

AU - Balas, Andrew

AU - Temesgen, Zelalem

AU - Wahner-Roedler, Dietlind

AU - Froehling, David

AU - Liebow, Mark

AU - Trusko, Brett

AU - Rosenbloom, S. Trent

AU - Poland, Greg

PY - 2008

Y1 - 2008

N2 - The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7% for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4%, the negative predictive value was 89.5%, the specificity was 81.0%, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.

AB - The current United States Health Information Technology Standards Panel's interoperability specification for biosurveillance relies heavily on chief complaint data for tracking rates of cases compatible with a case definition for diseases of interest (e.g. Avian Flu). We looked at SNOMED CT to determine how well this large general medical ontology could represent data held in chief complaints. In this experiment we took 50,000 records (Comprehensive Examinations or Limited Examinations from primary care areas at the Mayo Clinic) from December 2003 through February 2005 (Influenza Season). Of these records, 36,097 had non-null Chief Complaints. We randomly selected 1,035 non-null Chief Complaints and two Board-certified internists (one Infectious Diseases specialist and one general internist) reviewed the mappings of the 1,035 chief complaints. Where the reviewers disagreed, a third internist adjudicated. SNOMED CT had a sensitivity of 98.7% for matching clinical terms found in the chief complaint section of the clinical record. The positive predictive value was 97.4%, the negative predictive value was 89.5%, the specificity was 81.0%, the positive likelihood ratio was 5.181 and the negative likelihood ratio was 0.016. We conclude that SNOMED CT and natural language parsing engines can well represent the clinical content of chief complaint fields. Future research should focus on how well the information contained in the chief complaints can be relied upon to provide the basis of a national strategy for biosurveillance. The authors recommend that efforts be made to examine the entire clinical record to determine the level of improvement in the accuracy of biosurveillance that can be achieved if we were to incorporate the entire clinical record into our biosurveillance strategy.

KW - Concept representation

KW - Epidemiological Research

KW - Standards

UR - http://www.scopus.com/inward/record.url?scp=44349134517&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44349134517&partnerID=8YFLogxK

M3 - Conference contribution

C2 - 18487829

AN - SCOPUS:44349134517

VL - 136

SP - 797

EP - 802

BT - Studies in Health Technology and Informatics

ER -