TY - JOUR
T1 - The Health Archetype Language (HAL-42)
T2 - Interface considerations
AU - Elkin, Peter L.
AU - Froehling, David
AU - Wahner-Roedler, Dietlind
AU - Trusko, Brett
AU - Welsh, Gail
AU - Rosenbloom, S. Trent
AU - Speroff, Theodore
AU - Brown, Steven H.
N1 - Funding Information:
This work has been supported in part by grants from the Centers for Disease Control and Prevention (PH00022 & HK00014; ple) and from the Veterans Administration (249PO266; ple). This work has also been supported by a grant from the National Library of Medicine (5K22LM8576-3; STR).
PY - 2010/4
Y1 - 2010/4
N2 - In this manuscript we report an evaluation of the reliability of clinical research rules creation by multiple clinicians using the Health Archetype Language (HAL-42) and user interface. HAL-42 is a language which allows real time epidemiological inquiry using automatically derived clinical encodings with any health Ontology. This evaluation used SNOMED CT as the underlying Ontology. The inquiries were performed on a population of 17,731 patients whose 50,000 clinical records have all been fully encoded in SNOMED CT. Four subject matter experts (SMEs) were asked independently to encode and run 10 rules/studies. The inter-rater agreement was 74.8% (p = 0.6526) with a Kappa statistic of 0.49217 (p = 0.5722). The ten rules were divided into three easy rules, four moderate and three complex rules. There was no significant difference in the SME's agreement when representing easy and complex rules (p = 0.6243). We conclude that although the usability of the HAL-42 language is usable enough to achieve reasonable inter-rater reliability, some training will be necessary to reach high levels of reliability for ad hoc queries. We also conclude that SMEs are just as competent to perform complex queries as easy queries of ontologically indexed clinical data.
AB - In this manuscript we report an evaluation of the reliability of clinical research rules creation by multiple clinicians using the Health Archetype Language (HAL-42) and user interface. HAL-42 is a language which allows real time epidemiological inquiry using automatically derived clinical encodings with any health Ontology. This evaluation used SNOMED CT as the underlying Ontology. The inquiries were performed on a population of 17,731 patients whose 50,000 clinical records have all been fully encoded in SNOMED CT. Four subject matter experts (SMEs) were asked independently to encode and run 10 rules/studies. The inter-rater agreement was 74.8% (p = 0.6526) with a Kappa statistic of 0.49217 (p = 0.5722). The ten rules were divided into three easy rules, four moderate and three complex rules. There was no significant difference in the SME's agreement when representing easy and complex rules (p = 0.6243). We conclude that although the usability of the HAL-42 language is usable enough to achieve reasonable inter-rater reliability, some training will be necessary to reach high levels of reliability for ad hoc queries. We also conclude that SMEs are just as competent to perform complex queries as easy queries of ontologically indexed clinical data.
KW - Expert systems
KW - Human factors engineering
KW - Usability
KW - Vocabulary
UR - http://www.scopus.com/inward/record.url?scp=77549087457&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77549087457&partnerID=8YFLogxK
U2 - 10.1016/j.ijmedinf.2008.07.009
DO - 10.1016/j.ijmedinf.2008.07.009
M3 - Article
C2 - 18922738
AN - SCOPUS:77549087457
SN - 1386-5056
VL - 79
SP - e71-e75
JO - International Journal of Medical Informatics
JF - International Journal of Medical Informatics
IS - 4
ER -