The Health Archetype Language (HAL-42)

Interface considerations

Peter L. Elkin, David Froehling, Dietlind Wahner-Roedler, Brett Trusko, Gail Welsh, S. Trent Rosenbloom, Theodore Speroff, Steven H. Brown

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

In this manuscript we report an evaluation of the reliability of clinical research rules creation by multiple clinicians using the Health Archetype Language (HAL-42) and user interface. HAL-42 is a language which allows real time epidemiological inquiry using automatically derived clinical encodings with any health Ontology. This evaluation used SNOMED CT as the underlying Ontology. The inquiries were performed on a population of 17,731 patients whose 50,000 clinical records have all been fully encoded in SNOMED CT. Four subject matter experts (SMEs) were asked independently to encode and run 10 rules/studies. The inter-rater agreement was 74.8% (p = 0.6526) with a Kappa statistic of 0.49217 (p = 0.5722). The ten rules were divided into three easy rules, four moderate and three complex rules. There was no significant difference in the SME's agreement when representing easy and complex rules (p = 0.6243). We conclude that although the usability of the HAL-42 language is usable enough to achieve reasonable inter-rater reliability, some training will be necessary to reach high levels of reliability for ad hoc queries. We also conclude that SMEs are just as competent to perform complex queries as easy queries of ontologically indexed clinical data.

Original languageEnglish (US)
JournalInternational Journal of Medical Informatics
Volume79
Issue number4
DOIs
StatePublished - Apr 2010

Fingerprint

Systematized Nomenclature of Medicine
Language
Health
Research
Population

Keywords

  • Expert systems
  • Human factors engineering
  • Usability
  • Vocabulary

ASJC Scopus subject areas

  • Health Informatics

Cite this

Elkin, P. L., Froehling, D., Wahner-Roedler, D., Trusko, B., Welsh, G., Rosenbloom, S. T., ... Brown, S. H. (2010). The Health Archetype Language (HAL-42): Interface considerations. International Journal of Medical Informatics, 79(4). https://doi.org/10.1016/j.ijmedinf.2008.07.009

The Health Archetype Language (HAL-42) : Interface considerations. / Elkin, Peter L.; Froehling, David; Wahner-Roedler, Dietlind; Trusko, Brett; Welsh, Gail; Rosenbloom, S. Trent; Speroff, Theodore; Brown, Steven H.

In: International Journal of Medical Informatics, Vol. 79, No. 4, 04.2010.

Research output: Contribution to journalArticle

Elkin, PL, Froehling, D, Wahner-Roedler, D, Trusko, B, Welsh, G, Rosenbloom, ST, Speroff, T & Brown, SH 2010, 'The Health Archetype Language (HAL-42): Interface considerations', International Journal of Medical Informatics, vol. 79, no. 4. https://doi.org/10.1016/j.ijmedinf.2008.07.009
Elkin, Peter L. ; Froehling, David ; Wahner-Roedler, Dietlind ; Trusko, Brett ; Welsh, Gail ; Rosenbloom, S. Trent ; Speroff, Theodore ; Brown, Steven H. / The Health Archetype Language (HAL-42) : Interface considerations. In: International Journal of Medical Informatics. 2010 ; Vol. 79, No. 4.
@article{539a76b3da064242a2335d292a99061c,
title = "The Health Archetype Language (HAL-42): Interface considerations",
abstract = "In this manuscript we report an evaluation of the reliability of clinical research rules creation by multiple clinicians using the Health Archetype Language (HAL-42) and user interface. HAL-42 is a language which allows real time epidemiological inquiry using automatically derived clinical encodings with any health Ontology. This evaluation used SNOMED CT as the underlying Ontology. The inquiries were performed on a population of 17,731 patients whose 50,000 clinical records have all been fully encoded in SNOMED CT. Four subject matter experts (SMEs) were asked independently to encode and run 10 rules/studies. The inter-rater agreement was 74.8{\%} (p = 0.6526) with a Kappa statistic of 0.49217 (p = 0.5722). The ten rules were divided into three easy rules, four moderate and three complex rules. There was no significant difference in the SME's agreement when representing easy and complex rules (p = 0.6243). We conclude that although the usability of the HAL-42 language is usable enough to achieve reasonable inter-rater reliability, some training will be necessary to reach high levels of reliability for ad hoc queries. We also conclude that SMEs are just as competent to perform complex queries as easy queries of ontologically indexed clinical data.",
keywords = "Expert systems, Human factors engineering, Usability, Vocabulary",
author = "Elkin, {Peter L.} and David Froehling and Dietlind Wahner-Roedler and Brett Trusko and Gail Welsh and Rosenbloom, {S. Trent} and Theodore Speroff and Brown, {Steven H.}",
year = "2010",
month = "4",
doi = "10.1016/j.ijmedinf.2008.07.009",
language = "English (US)",
volume = "79",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "Elsevier Ireland Ltd",
number = "4",

}

TY - JOUR

T1 - The Health Archetype Language (HAL-42)

T2 - Interface considerations

AU - Elkin, Peter L.

AU - Froehling, David

AU - Wahner-Roedler, Dietlind

AU - Trusko, Brett

AU - Welsh, Gail

AU - Rosenbloom, S. Trent

AU - Speroff, Theodore

AU - Brown, Steven H.

PY - 2010/4

Y1 - 2010/4

N2 - In this manuscript we report an evaluation of the reliability of clinical research rules creation by multiple clinicians using the Health Archetype Language (HAL-42) and user interface. HAL-42 is a language which allows real time epidemiological inquiry using automatically derived clinical encodings with any health Ontology. This evaluation used SNOMED CT as the underlying Ontology. The inquiries were performed on a population of 17,731 patients whose 50,000 clinical records have all been fully encoded in SNOMED CT. Four subject matter experts (SMEs) were asked independently to encode and run 10 rules/studies. The inter-rater agreement was 74.8% (p = 0.6526) with a Kappa statistic of 0.49217 (p = 0.5722). The ten rules were divided into three easy rules, four moderate and three complex rules. There was no significant difference in the SME's agreement when representing easy and complex rules (p = 0.6243). We conclude that although the usability of the HAL-42 language is usable enough to achieve reasonable inter-rater reliability, some training will be necessary to reach high levels of reliability for ad hoc queries. We also conclude that SMEs are just as competent to perform complex queries as easy queries of ontologically indexed clinical data.

AB - In this manuscript we report an evaluation of the reliability of clinical research rules creation by multiple clinicians using the Health Archetype Language (HAL-42) and user interface. HAL-42 is a language which allows real time epidemiological inquiry using automatically derived clinical encodings with any health Ontology. This evaluation used SNOMED CT as the underlying Ontology. The inquiries were performed on a population of 17,731 patients whose 50,000 clinical records have all been fully encoded in SNOMED CT. Four subject matter experts (SMEs) were asked independently to encode and run 10 rules/studies. The inter-rater agreement was 74.8% (p = 0.6526) with a Kappa statistic of 0.49217 (p = 0.5722). The ten rules were divided into three easy rules, four moderate and three complex rules. There was no significant difference in the SME's agreement when representing easy and complex rules (p = 0.6243). We conclude that although the usability of the HAL-42 language is usable enough to achieve reasonable inter-rater reliability, some training will be necessary to reach high levels of reliability for ad hoc queries. We also conclude that SMEs are just as competent to perform complex queries as easy queries of ontologically indexed clinical data.

KW - Expert systems

KW - Human factors engineering

KW - Usability

KW - Vocabulary

UR - http://www.scopus.com/inward/record.url?scp=77549087457&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77549087457&partnerID=8YFLogxK

U2 - 10.1016/j.ijmedinf.2008.07.009

DO - 10.1016/j.ijmedinf.2008.07.009

M3 - Article

VL - 79

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

IS - 4

ER -