Evaluation of the content coverage of SNOMED CT: Ability of SNOMED clinical terms to represent clinical problem lists

Peter L. Elkin, Steven H. Brown, Casey S. Husser, Brent A Bauer, Dietlind Wahner-Roedler, S. Trent Rosenbloom, Ted Speroff

Research output: Contribution to journalArticle

111 Citations (Scopus)

Abstract

OBJECTIVE: To evaluate the ability of SNOMED CT (Systematized Nomenclature of Medicine Clinical Terms) version 1.0 to represent the most common problems seen at the Mayo Clinic in Rochester, Minn. MATERIAL AND METHODS: We selected the 4996 most common nonduplicated text strings from the Mayo Master Sheet Index that describe patient problems associated with inpatient and outpatient episodes of care. From July 2003 through January 2004, 2 physician reviewers compared the Master Sheet Index text with the SNOMED CT terms that were automatically mapped by a vocabulary server or that they Identified using a vocabulary browser and rated the "correctness" of the match. If the 2 reviewers disagreed, a third reviewer adjudicated. We evaluated the specificity, sensitivity, and positive predictive value of SNOMED CT. RESULTS: Of the 4996 problems in the test set, SNOMED CT correctly Identified 4568 terms (true-positive results); 36 terms were true negatives, 9 terms were false positives, and 383 terms were false negatives. SNOMED CT had a sensitivity of 92.3%, a specificity of 80.0%, and a positive predictive value of 99.8%. CONCLUSION: SNOMED CT, when used as a compositional terminology, can exactly represent most (92.3%) of the terms used commonly in medical problem lists. Improvements to synonymy and adding missing modifiers would lead to greater coverage of common problem statements. Health care organizations should be encouraged and provided incentives to begin adopting SNOMED CT to drive their decision-support applications.

Original languageEnglish (US)
Pages (from-to)741-748
Number of pages8
JournalMayo Clinic Proceedings
Volume81
Issue number6
DOIs
StatePublished - 2006

Fingerprint

Systematized Nomenclature of Medicine
Vocabulary
Episode of Care
Aptitude
Ambulatory Care
Terminology
Motivation
Inpatients
Delivery of Health Care
Physicians
Sensitivity and Specificity

Keywords

  • FN = false-negative
  • FP = false-positive
  • HHS = Health and Human Services
  • ICD9-CM = International Classification of Diseases, Ninth Revision, Clinical Modification
  • MCVS = Mayo Clinic Vocabulary Server
  • MSI = Mayo Master Sheet Index

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Elkin, P. L., Brown, S. H., Husser, C. S., Bauer, B. A., Wahner-Roedler, D., Trent Rosenbloom, S., & Speroff, T. (2006). Evaluation of the content coverage of SNOMED CT: Ability of SNOMED clinical terms to represent clinical problem lists. Mayo Clinic Proceedings, 81(6), 741-748. https://doi.org/10.4065/81.6.741

Evaluation of the content coverage of SNOMED CT : Ability of SNOMED clinical terms to represent clinical problem lists. / Elkin, Peter L.; Brown, Steven H.; Husser, Casey S.; Bauer, Brent A; Wahner-Roedler, Dietlind; Trent Rosenbloom, S.; Speroff, Ted.

In: Mayo Clinic Proceedings, Vol. 81, No. 6, 2006, p. 741-748.

Research output: Contribution to journalArticle

Elkin, PL, Brown, SH, Husser, CS, Bauer, BA, Wahner-Roedler, D, Trent Rosenbloom, S & Speroff, T 2006, 'Evaluation of the content coverage of SNOMED CT: Ability of SNOMED clinical terms to represent clinical problem lists', Mayo Clinic Proceedings, vol. 81, no. 6, pp. 741-748. https://doi.org/10.4065/81.6.741
Elkin, Peter L. ; Brown, Steven H. ; Husser, Casey S. ; Bauer, Brent A ; Wahner-Roedler, Dietlind ; Trent Rosenbloom, S. ; Speroff, Ted. / Evaluation of the content coverage of SNOMED CT : Ability of SNOMED clinical terms to represent clinical problem lists. In: Mayo Clinic Proceedings. 2006 ; Vol. 81, No. 6. pp. 741-748.
@article{59df762706fb444384fb11139f1a01ee,
title = "Evaluation of the content coverage of SNOMED CT: Ability of SNOMED clinical terms to represent clinical problem lists",
abstract = "OBJECTIVE: To evaluate the ability of SNOMED CT (Systematized Nomenclature of Medicine Clinical Terms) version 1.0 to represent the most common problems seen at the Mayo Clinic in Rochester, Minn. MATERIAL AND METHODS: We selected the 4996 most common nonduplicated text strings from the Mayo Master Sheet Index that describe patient problems associated with inpatient and outpatient episodes of care. From July 2003 through January 2004, 2 physician reviewers compared the Master Sheet Index text with the SNOMED CT terms that were automatically mapped by a vocabulary server or that they Identified using a vocabulary browser and rated the {"}correctness{"} of the match. If the 2 reviewers disagreed, a third reviewer adjudicated. We evaluated the specificity, sensitivity, and positive predictive value of SNOMED CT. RESULTS: Of the 4996 problems in the test set, SNOMED CT correctly Identified 4568 terms (true-positive results); 36 terms were true negatives, 9 terms were false positives, and 383 terms were false negatives. SNOMED CT had a sensitivity of 92.3{\%}, a specificity of 80.0{\%}, and a positive predictive value of 99.8{\%}. CONCLUSION: SNOMED CT, when used as a compositional terminology, can exactly represent most (92.3{\%}) of the terms used commonly in medical problem lists. Improvements to synonymy and adding missing modifiers would lead to greater coverage of common problem statements. Health care organizations should be encouraged and provided incentives to begin adopting SNOMED CT to drive their decision-support applications.",
keywords = "FN = false-negative, FP = false-positive, HHS = Health and Human Services, ICD9-CM = International Classification of Diseases, Ninth Revision, Clinical Modification, MCVS = Mayo Clinic Vocabulary Server, MSI = Mayo Master Sheet Index",
author = "Elkin, {Peter L.} and Brown, {Steven H.} and Husser, {Casey S.} and Bauer, {Brent A} and Dietlind Wahner-Roedler and {Trent Rosenbloom}, S. and Ted Speroff",
year = "2006",
doi = "10.4065/81.6.741",
language = "English (US)",
volume = "81",
pages = "741--748",
journal = "Mayo Clinic Proceedings",
issn = "0025-6196",
publisher = "Elsevier Science",
number = "6",

}

TY - JOUR

T1 - Evaluation of the content coverage of SNOMED CT

T2 - Ability of SNOMED clinical terms to represent clinical problem lists

AU - Elkin, Peter L.

AU - Brown, Steven H.

AU - Husser, Casey S.

AU - Bauer, Brent A

AU - Wahner-Roedler, Dietlind

AU - Trent Rosenbloom, S.

AU - Speroff, Ted

PY - 2006

Y1 - 2006

N2 - OBJECTIVE: To evaluate the ability of SNOMED CT (Systematized Nomenclature of Medicine Clinical Terms) version 1.0 to represent the most common problems seen at the Mayo Clinic in Rochester, Minn. MATERIAL AND METHODS: We selected the 4996 most common nonduplicated text strings from the Mayo Master Sheet Index that describe patient problems associated with inpatient and outpatient episodes of care. From July 2003 through January 2004, 2 physician reviewers compared the Master Sheet Index text with the SNOMED CT terms that were automatically mapped by a vocabulary server or that they Identified using a vocabulary browser and rated the "correctness" of the match. If the 2 reviewers disagreed, a third reviewer adjudicated. We evaluated the specificity, sensitivity, and positive predictive value of SNOMED CT. RESULTS: Of the 4996 problems in the test set, SNOMED CT correctly Identified 4568 terms (true-positive results); 36 terms were true negatives, 9 terms were false positives, and 383 terms were false negatives. SNOMED CT had a sensitivity of 92.3%, a specificity of 80.0%, and a positive predictive value of 99.8%. CONCLUSION: SNOMED CT, when used as a compositional terminology, can exactly represent most (92.3%) of the terms used commonly in medical problem lists. Improvements to synonymy and adding missing modifiers would lead to greater coverage of common problem statements. Health care organizations should be encouraged and provided incentives to begin adopting SNOMED CT to drive their decision-support applications.

AB - OBJECTIVE: To evaluate the ability of SNOMED CT (Systematized Nomenclature of Medicine Clinical Terms) version 1.0 to represent the most common problems seen at the Mayo Clinic in Rochester, Minn. MATERIAL AND METHODS: We selected the 4996 most common nonduplicated text strings from the Mayo Master Sheet Index that describe patient problems associated with inpatient and outpatient episodes of care. From July 2003 through January 2004, 2 physician reviewers compared the Master Sheet Index text with the SNOMED CT terms that were automatically mapped by a vocabulary server or that they Identified using a vocabulary browser and rated the "correctness" of the match. If the 2 reviewers disagreed, a third reviewer adjudicated. We evaluated the specificity, sensitivity, and positive predictive value of SNOMED CT. RESULTS: Of the 4996 problems in the test set, SNOMED CT correctly Identified 4568 terms (true-positive results); 36 terms were true negatives, 9 terms were false positives, and 383 terms were false negatives. SNOMED CT had a sensitivity of 92.3%, a specificity of 80.0%, and a positive predictive value of 99.8%. CONCLUSION: SNOMED CT, when used as a compositional terminology, can exactly represent most (92.3%) of the terms used commonly in medical problem lists. Improvements to synonymy and adding missing modifiers would lead to greater coverage of common problem statements. Health care organizations should be encouraged and provided incentives to begin adopting SNOMED CT to drive their decision-support applications.

KW - FN = false-negative

KW - FP = false-positive

KW - HHS = Health and Human Services

KW - ICD9-CM = International Classification of Diseases, Ninth Revision, Clinical Modification

KW - MCVS = Mayo Clinic Vocabulary Server

KW - MSI = Mayo Master Sheet Index

UR - http://www.scopus.com/inward/record.url?scp=33744793443&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33744793443&partnerID=8YFLogxK

U2 - 10.4065/81.6.741

DO - 10.4065/81.6.741

M3 - Article

C2 - 16770974

AN - SCOPUS:33744793443

VL - 81

SP - 741

EP - 748

JO - Mayo Clinic Proceedings

JF - Mayo Clinic Proceedings

SN - 0025-6196

IS - 6

ER -