Reliability and validity of the checklist for early recognition and treatment of acute illness and injury as a charting tool in the medical intensive care unit

Alexander Kogan, Kelly M. Pennington, Saraschandra Vallabhajosyula, Mikhail Dziadzko, Courtney Bennett, Jeffrey B. Jensen, Ognjen Gajic, John C. O'Horo

Research output: Contribution to journalArticle

Abstract

Background: Resuscitation of critically ill patients is complex and potentially prone to diagnostic errors and therapeutic harm. The Checklist for early recognition and treatment of acute illness and injury (CERTAIN) is an electronic tool that aims to provide decision-support, charting, and prompting for standardization. This study sought to evaluate the validity and reliability of CERTAIN in a real-time Intensive Care Unit (ICU). Materials and Methods: This was a prospective pilot study in the medical ICU of a tertiary care medical center. A total of thirty patient encounters over 2 months period were charted independently by two CERTAIN investigators. The inter-observer recordings and comparison to the electronic medical records (EMR) were used to evaluate reliability and validity, respectively. The primary outcome was reliability and validity measured using Cohen's Kappa statistic. Secondary outcomes included time to completion, user satisfaction, and learning curve. Results: A total of 30 patients with a median age of 59 (42-78) years and median acute physiology and chronic health evaluation III score of 38 (23-50) were included in this study. Inter-observer agreement was very good (κ = 0.79) in this study and agreement between CERTAIN and the EMR was good (κ = 0.5). CERTAIN charting was completed in real-time that was 121 (92-150) min before completion of EMR charting. The subjective learning curve was 3.5 patients without differences in providers with different levels of training. Conclusions: CERTAIN provides a reliable and valid method to evaluate resuscitation events in real time. CERTAIN provided the ability to complete data in real-time.

Original languageEnglish (US)
Pages (from-to)746-750
Number of pages5
JournalIndian Journal of Critical Care Medicine
Volume21
Issue number11
DOIs
StatePublished - Nov 1 2017

Fingerprint

Checklist
Reproducibility of Results
Intensive Care Units
Wounds and Injuries
Electronic Health Records
Learning Curve
Therapeutics
Resuscitation
APACHE
Aptitude
Recognition (Psychology)
Diagnostic Errors
Tertiary Care Centers
Critical Illness
Research Personnel
Prospective Studies

Keywords

  • Checklist for early recognition and treatment of acute illness and injury
  • checklists
  • critical care
  • reliability
  • resuscitation

ASJC Scopus subject areas

  • Critical Care and Intensive Care Medicine

Cite this

Reliability and validity of the checklist for early recognition and treatment of acute illness and injury as a charting tool in the medical intensive care unit. / Kogan, Alexander; Pennington, Kelly M.; Vallabhajosyula, Saraschandra; Dziadzko, Mikhail; Bennett, Courtney; Jensen, Jeffrey B.; Gajic, Ognjen; O'Horo, John C.

In: Indian Journal of Critical Care Medicine, Vol. 21, No. 11, 01.11.2017, p. 746-750.

Research output: Contribution to journalArticle

Kogan, Alexander ; Pennington, Kelly M. ; Vallabhajosyula, Saraschandra ; Dziadzko, Mikhail ; Bennett, Courtney ; Jensen, Jeffrey B. ; Gajic, Ognjen ; O'Horo, John C. / Reliability and validity of the checklist for early recognition and treatment of acute illness and injury as a charting tool in the medical intensive care unit. In: Indian Journal of Critical Care Medicine. 2017 ; Vol. 21, No. 11. pp. 746-750.
@article{c7baf5bc887a4975bb77b317ba05372b,
title = "Reliability and validity of the checklist for early recognition and treatment of acute illness and injury as a charting tool in the medical intensive care unit",
abstract = "Background: Resuscitation of critically ill patients is complex and potentially prone to diagnostic errors and therapeutic harm. The Checklist for early recognition and treatment of acute illness and injury (CERTAIN) is an electronic tool that aims to provide decision-support, charting, and prompting for standardization. This study sought to evaluate the validity and reliability of CERTAIN in a real-time Intensive Care Unit (ICU). Materials and Methods: This was a prospective pilot study in the medical ICU of a tertiary care medical center. A total of thirty patient encounters over 2 months period were charted independently by two CERTAIN investigators. The inter-observer recordings and comparison to the electronic medical records (EMR) were used to evaluate reliability and validity, respectively. The primary outcome was reliability and validity measured using Cohen's Kappa statistic. Secondary outcomes included time to completion, user satisfaction, and learning curve. Results: A total of 30 patients with a median age of 59 (42-78) years and median acute physiology and chronic health evaluation III score of 38 (23-50) were included in this study. Inter-observer agreement was very good (κ = 0.79) in this study and agreement between CERTAIN and the EMR was good (κ = 0.5). CERTAIN charting was completed in real-time that was 121 (92-150) min before completion of EMR charting. The subjective learning curve was 3.5 patients without differences in providers with different levels of training. Conclusions: CERTAIN provides a reliable and valid method to evaluate resuscitation events in real time. CERTAIN provided the ability to complete data in real-time.",
keywords = "Checklist for early recognition and treatment of acute illness and injury, checklists, critical care, reliability, resuscitation",
author = "Alexander Kogan and Pennington, {Kelly M.} and Saraschandra Vallabhajosyula and Mikhail Dziadzko and Courtney Bennett and Jensen, {Jeffrey B.} and Ognjen Gajic and O'Horo, {John C.}",
year = "2017",
month = "11",
day = "1",
doi = "10.4103/ijccm.IJCCM_209_17",
language = "English (US)",
volume = "21",
pages = "746--750",
journal = "Indian Journal of Critical Care Medicine",
issn = "0972-5229",
publisher = "Medknow Publications and Media Pvt. Ltd",
number = "11",

}

TY - JOUR

T1 - Reliability and validity of the checklist for early recognition and treatment of acute illness and injury as a charting tool in the medical intensive care unit

AU - Kogan, Alexander

AU - Pennington, Kelly M.

AU - Vallabhajosyula, Saraschandra

AU - Dziadzko, Mikhail

AU - Bennett, Courtney

AU - Jensen, Jeffrey B.

AU - Gajic, Ognjen

AU - O'Horo, John C.

PY - 2017/11/1

Y1 - 2017/11/1

N2 - Background: Resuscitation of critically ill patients is complex and potentially prone to diagnostic errors and therapeutic harm. The Checklist for early recognition and treatment of acute illness and injury (CERTAIN) is an electronic tool that aims to provide decision-support, charting, and prompting for standardization. This study sought to evaluate the validity and reliability of CERTAIN in a real-time Intensive Care Unit (ICU). Materials and Methods: This was a prospective pilot study in the medical ICU of a tertiary care medical center. A total of thirty patient encounters over 2 months period were charted independently by two CERTAIN investigators. The inter-observer recordings and comparison to the electronic medical records (EMR) were used to evaluate reliability and validity, respectively. The primary outcome was reliability and validity measured using Cohen's Kappa statistic. Secondary outcomes included time to completion, user satisfaction, and learning curve. Results: A total of 30 patients with a median age of 59 (42-78) years and median acute physiology and chronic health evaluation III score of 38 (23-50) were included in this study. Inter-observer agreement was very good (κ = 0.79) in this study and agreement between CERTAIN and the EMR was good (κ = 0.5). CERTAIN charting was completed in real-time that was 121 (92-150) min before completion of EMR charting. The subjective learning curve was 3.5 patients without differences in providers with different levels of training. Conclusions: CERTAIN provides a reliable and valid method to evaluate resuscitation events in real time. CERTAIN provided the ability to complete data in real-time.

AB - Background: Resuscitation of critically ill patients is complex and potentially prone to diagnostic errors and therapeutic harm. The Checklist for early recognition and treatment of acute illness and injury (CERTAIN) is an electronic tool that aims to provide decision-support, charting, and prompting for standardization. This study sought to evaluate the validity and reliability of CERTAIN in a real-time Intensive Care Unit (ICU). Materials and Methods: This was a prospective pilot study in the medical ICU of a tertiary care medical center. A total of thirty patient encounters over 2 months period were charted independently by two CERTAIN investigators. The inter-observer recordings and comparison to the electronic medical records (EMR) were used to evaluate reliability and validity, respectively. The primary outcome was reliability and validity measured using Cohen's Kappa statistic. Secondary outcomes included time to completion, user satisfaction, and learning curve. Results: A total of 30 patients with a median age of 59 (42-78) years and median acute physiology and chronic health evaluation III score of 38 (23-50) were included in this study. Inter-observer agreement was very good (κ = 0.79) in this study and agreement between CERTAIN and the EMR was good (κ = 0.5). CERTAIN charting was completed in real-time that was 121 (92-150) min before completion of EMR charting. The subjective learning curve was 3.5 patients without differences in providers with different levels of training. Conclusions: CERTAIN provides a reliable and valid method to evaluate resuscitation events in real time. CERTAIN provided the ability to complete data in real-time.

KW - Checklist for early recognition and treatment of acute illness and injury

KW - checklists

KW - critical care

KW - reliability

KW - resuscitation

UR - http://www.scopus.com/inward/record.url?scp=85034593589&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85034593589&partnerID=8YFLogxK

U2 - 10.4103/ijccm.IJCCM_209_17

DO - 10.4103/ijccm.IJCCM_209_17

M3 - Article

VL - 21

SP - 746

EP - 750

JO - Indian Journal of Critical Care Medicine

JF - Indian Journal of Critical Care Medicine

SN - 0972-5229

IS - 11

ER -