A review of auditing methods applied to the content of controlled biomedical terminologies

Xinxin Zhu, Jung Wei Fan, David M. Baorto, Chunhua Weng, James J. Cimino

Research output: Contribution to journalArticle

64 Citations (Scopus)

Abstract

Although controlled biomedical terminologies have been with us for centuries, it is only in the last couple of decades that close attention has been paid to the quality of these terminologies. The result of this attention has been the development of auditing methods that apply formal methods to assessing whether terminologies are complete and accurate. We have performed an extensive literature review to identify published descriptions of these methods and have created a framework for characterizing them. The framework considers manual, systematic and heuristic methods that use knowledge (within or external to the terminology) to measure quality factors of different aspects of the terminology content (terms, semantic classification, and semantic relationships). The quality factors examined included concept orientation, consistency, non-redundancy, soundness and comprehensive coverage. We reviewed 130 studies that were retrieved based on keyword search on publications in PubMed, and present our assessment of how they fit into our framework. We also identify which terminologies have been audited with the methods and provide examples to illustrate each part of the framework.

Original languageEnglish (US)
Pages (from-to)413-425
Number of pages13
JournalJournal of Biomedical Informatics
Volume42
Issue number3
DOIs
StatePublished - Jun 1 2009
Externally publishedYes

Fingerprint

Terminology
Semantics
Heuristic methods
Formal methods
PubMed
Publications

Keywords

  • Auditing method
  • Automated
  • Heuristic
  • Knowledge source
  • Manual
  • Quality factor
  • Systematic
  • Terminology

ASJC Scopus subject areas

  • Computer Science Applications
  • Health Informatics

Cite this

A review of auditing methods applied to the content of controlled biomedical terminologies. / Zhu, Xinxin; Fan, Jung Wei; Baorto, David M.; Weng, Chunhua; Cimino, James J.

In: Journal of Biomedical Informatics, Vol. 42, No. 3, 01.06.2009, p. 413-425.

Research output: Contribution to journalArticle

Zhu, Xinxin ; Fan, Jung Wei ; Baorto, David M. ; Weng, Chunhua ; Cimino, James J. / A review of auditing methods applied to the content of controlled biomedical terminologies. In: Journal of Biomedical Informatics. 2009 ; Vol. 42, No. 3. pp. 413-425.
@article{ecfcdbed7aeb488ca74c6649afa14e6d,
title = "A review of auditing methods applied to the content of controlled biomedical terminologies",
abstract = "Although controlled biomedical terminologies have been with us for centuries, it is only in the last couple of decades that close attention has been paid to the quality of these terminologies. The result of this attention has been the development of auditing methods that apply formal methods to assessing whether terminologies are complete and accurate. We have performed an extensive literature review to identify published descriptions of these methods and have created a framework for characterizing them. The framework considers manual, systematic and heuristic methods that use knowledge (within or external to the terminology) to measure quality factors of different aspects of the terminology content (terms, semantic classification, and semantic relationships). The quality factors examined included concept orientation, consistency, non-redundancy, soundness and comprehensive coverage. We reviewed 130 studies that were retrieved based on keyword search on publications in PubMed, and present our assessment of how they fit into our framework. We also identify which terminologies have been audited with the methods and provide examples to illustrate each part of the framework.",
keywords = "Auditing method, Automated, Heuristic, Knowledge source, Manual, Quality factor, Systematic, Terminology",
author = "Xinxin Zhu and Fan, {Jung Wei} and Baorto, {David M.} and Chunhua Weng and Cimino, {James J.}",
year = "2009",
month = "6",
day = "1",
doi = "10.1016/j.jbi.2009.03.003",
language = "English (US)",
volume = "42",
pages = "413--425",
journal = "Journal of Biomedical Informatics",
issn = "1532-0464",
publisher = "Academic Press Inc.",
number = "3",

}

TY - JOUR

T1 - A review of auditing methods applied to the content of controlled biomedical terminologies

AU - Zhu, Xinxin

AU - Fan, Jung Wei

AU - Baorto, David M.

AU - Weng, Chunhua

AU - Cimino, James J.

PY - 2009/6/1

Y1 - 2009/6/1

N2 - Although controlled biomedical terminologies have been with us for centuries, it is only in the last couple of decades that close attention has been paid to the quality of these terminologies. The result of this attention has been the development of auditing methods that apply formal methods to assessing whether terminologies are complete and accurate. We have performed an extensive literature review to identify published descriptions of these methods and have created a framework for characterizing them. The framework considers manual, systematic and heuristic methods that use knowledge (within or external to the terminology) to measure quality factors of different aspects of the terminology content (terms, semantic classification, and semantic relationships). The quality factors examined included concept orientation, consistency, non-redundancy, soundness and comprehensive coverage. We reviewed 130 studies that were retrieved based on keyword search on publications in PubMed, and present our assessment of how they fit into our framework. We also identify which terminologies have been audited with the methods and provide examples to illustrate each part of the framework.

AB - Although controlled biomedical terminologies have been with us for centuries, it is only in the last couple of decades that close attention has been paid to the quality of these terminologies. The result of this attention has been the development of auditing methods that apply formal methods to assessing whether terminologies are complete and accurate. We have performed an extensive literature review to identify published descriptions of these methods and have created a framework for characterizing them. The framework considers manual, systematic and heuristic methods that use knowledge (within or external to the terminology) to measure quality factors of different aspects of the terminology content (terms, semantic classification, and semantic relationships). The quality factors examined included concept orientation, consistency, non-redundancy, soundness and comprehensive coverage. We reviewed 130 studies that were retrieved based on keyword search on publications in PubMed, and present our assessment of how they fit into our framework. We also identify which terminologies have been audited with the methods and provide examples to illustrate each part of the framework.

KW - Auditing method

KW - Automated

KW - Heuristic

KW - Knowledge source

KW - Manual

KW - Quality factor

KW - Systematic

KW - Terminology

UR - http://www.scopus.com/inward/record.url?scp=65649154390&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=65649154390&partnerID=8YFLogxK

U2 - 10.1016/j.jbi.2009.03.003

DO - 10.1016/j.jbi.2009.03.003

M3 - Article

C2 - 19285571

AN - SCOPUS:65649154390

VL - 42

SP - 413

EP - 425

JO - Journal of Biomedical Informatics

JF - Journal of Biomedical Informatics

SN - 1532-0464

IS - 3

ER -