Evaluating automated rules for rapid response system alarm triggers in medical and surgical patients

Santiago Romero-Brufau, Bruce W. Morlan, Matthew Johnson, Joel Hickman, Lisa L. Kirkland, James M Naessens, Jeanne Huddleston

Research output: Contribution to journalArticle

Abstract

BACKGROUND: The use of rapid response systems (RRS), which were designed to bring clinicians with critical care expertise to the bedside to prevent unnecessary deaths, has increased. RRS rely on accurate detection of acute deterioration events. Early warning scores (EWS) have been used for this purpose but were developed using heterogeneous populations. Predictive performance may differ in medical vs surgical patients. OBJECTIVE: To evaluate the performance of published EWS in medical vs surgical patient populations. DESIGN: Retrospective cohort study. SETTING: Two tertiary care academic medical center hospitals in the Midwest totaling more than 1500 beds. PATIENTS: All patients discharged from January to December 2011. INTERVENTION: None. MEASUREMENTS: Time-stamped longitudinal database of patient variables and outcomes, categorized as surgical or medical. Outcomes included unscheduled transfers to the intensive care unit, activation of the RRS, and calls for cardiorespiratory resuscitation (“resuscitation call”). The EWS were calculated and updated with every new patient variable entry over time. Scores were considered accurate if they predicted an outcome in the following 24 hours. RESULTS: All EWS demonstrated higher performance within the medical population as compared to surgical: higher positive predictive value (P <.0001 for all scores) and sensitivity (P <.0001 for all scores). All EWS had positive predictive values below 25%. CONCLUSIONS: The overall poor performance of the evaluated EWS was marginally better in medical patients when compared to surgical patients.

Original languageEnglish (US)
Pages (from-to)217-223
Number of pages7
JournalJournal of Hospital Medicine
Volume12
Issue number4
DOIs
StatePublished - Apr 1 2017

Fingerprint

Resuscitation
Population
Tertiary Healthcare
Critical Care
Intensive Care Units
Cohort Studies
Retrospective Studies
Databases

ASJC Scopus subject areas

  • Leadership and Management
  • Fundamentals and skills
  • Health Policy
  • Care Planning
  • Assessment and Diagnosis

Cite this

Romero-Brufau, S., Morlan, B. W., Johnson, M., Hickman, J., Kirkland, L. L., Naessens, J. M., & Huddleston, J. (2017). Evaluating automated rules for rapid response system alarm triggers in medical and surgical patients. Journal of Hospital Medicine, 12(4), 217-223. https://doi.org/10.12788/jhm.2712

Evaluating automated rules for rapid response system alarm triggers in medical and surgical patients. / Romero-Brufau, Santiago; Morlan, Bruce W.; Johnson, Matthew; Hickman, Joel; Kirkland, Lisa L.; Naessens, James M; Huddleston, Jeanne.

In: Journal of Hospital Medicine, Vol. 12, No. 4, 01.04.2017, p. 217-223.

Research output: Contribution to journalArticle

Romero-Brufau, S, Morlan, BW, Johnson, M, Hickman, J, Kirkland, LL, Naessens, JM & Huddleston, J 2017, 'Evaluating automated rules for rapid response system alarm triggers in medical and surgical patients', Journal of Hospital Medicine, vol. 12, no. 4, pp. 217-223. https://doi.org/10.12788/jhm.2712
Romero-Brufau, Santiago ; Morlan, Bruce W. ; Johnson, Matthew ; Hickman, Joel ; Kirkland, Lisa L. ; Naessens, James M ; Huddleston, Jeanne. / Evaluating automated rules for rapid response system alarm triggers in medical and surgical patients. In: Journal of Hospital Medicine. 2017 ; Vol. 12, No. 4. pp. 217-223.
@article{e113deaaaf454fa38e52c692d72a1f8d,
title = "Evaluating automated rules for rapid response system alarm triggers in medical and surgical patients",
abstract = "BACKGROUND: The use of rapid response systems (RRS), which were designed to bring clinicians with critical care expertise to the bedside to prevent unnecessary deaths, has increased. RRS rely on accurate detection of acute deterioration events. Early warning scores (EWS) have been used for this purpose but were developed using heterogeneous populations. Predictive performance may differ in medical vs surgical patients. OBJECTIVE: To evaluate the performance of published EWS in medical vs surgical patient populations. DESIGN: Retrospective cohort study. SETTING: Two tertiary care academic medical center hospitals in the Midwest totaling more than 1500 beds. PATIENTS: All patients discharged from January to December 2011. INTERVENTION: None. MEASUREMENTS: Time-stamped longitudinal database of patient variables and outcomes, categorized as surgical or medical. Outcomes included unscheduled transfers to the intensive care unit, activation of the RRS, and calls for cardiorespiratory resuscitation (“resuscitation call”). The EWS were calculated and updated with every new patient variable entry over time. Scores were considered accurate if they predicted an outcome in the following 24 hours. RESULTS: All EWS demonstrated higher performance within the medical population as compared to surgical: higher positive predictive value (P <.0001 for all scores) and sensitivity (P <.0001 for all scores). All EWS had positive predictive values below 25{\%}. CONCLUSIONS: The overall poor performance of the evaluated EWS was marginally better in medical patients when compared to surgical patients.",
author = "Santiago Romero-Brufau and Morlan, {Bruce W.} and Matthew Johnson and Joel Hickman and Kirkland, {Lisa L.} and Naessens, {James M} and Jeanne Huddleston",
year = "2017",
month = "4",
day = "1",
doi = "10.12788/jhm.2712",
language = "English (US)",
volume = "12",
pages = "217--223",
journal = "Journal of Hospital Medicine",
issn = "1553-5606",
publisher = "Frontline Medical Communications",
number = "4",

}

TY - JOUR

T1 - Evaluating automated rules for rapid response system alarm triggers in medical and surgical patients

AU - Romero-Brufau, Santiago

AU - Morlan, Bruce W.

AU - Johnson, Matthew

AU - Hickman, Joel

AU - Kirkland, Lisa L.

AU - Naessens, James M

AU - Huddleston, Jeanne

PY - 2017/4/1

Y1 - 2017/4/1

N2 - BACKGROUND: The use of rapid response systems (RRS), which were designed to bring clinicians with critical care expertise to the bedside to prevent unnecessary deaths, has increased. RRS rely on accurate detection of acute deterioration events. Early warning scores (EWS) have been used for this purpose but were developed using heterogeneous populations. Predictive performance may differ in medical vs surgical patients. OBJECTIVE: To evaluate the performance of published EWS in medical vs surgical patient populations. DESIGN: Retrospective cohort study. SETTING: Two tertiary care academic medical center hospitals in the Midwest totaling more than 1500 beds. PATIENTS: All patients discharged from January to December 2011. INTERVENTION: None. MEASUREMENTS: Time-stamped longitudinal database of patient variables and outcomes, categorized as surgical or medical. Outcomes included unscheduled transfers to the intensive care unit, activation of the RRS, and calls for cardiorespiratory resuscitation (“resuscitation call”). The EWS were calculated and updated with every new patient variable entry over time. Scores were considered accurate if they predicted an outcome in the following 24 hours. RESULTS: All EWS demonstrated higher performance within the medical population as compared to surgical: higher positive predictive value (P <.0001 for all scores) and sensitivity (P <.0001 for all scores). All EWS had positive predictive values below 25%. CONCLUSIONS: The overall poor performance of the evaluated EWS was marginally better in medical patients when compared to surgical patients.

AB - BACKGROUND: The use of rapid response systems (RRS), which were designed to bring clinicians with critical care expertise to the bedside to prevent unnecessary deaths, has increased. RRS rely on accurate detection of acute deterioration events. Early warning scores (EWS) have been used for this purpose but were developed using heterogeneous populations. Predictive performance may differ in medical vs surgical patients. OBJECTIVE: To evaluate the performance of published EWS in medical vs surgical patient populations. DESIGN: Retrospective cohort study. SETTING: Two tertiary care academic medical center hospitals in the Midwest totaling more than 1500 beds. PATIENTS: All patients discharged from January to December 2011. INTERVENTION: None. MEASUREMENTS: Time-stamped longitudinal database of patient variables and outcomes, categorized as surgical or medical. Outcomes included unscheduled transfers to the intensive care unit, activation of the RRS, and calls for cardiorespiratory resuscitation (“resuscitation call”). The EWS were calculated and updated with every new patient variable entry over time. Scores were considered accurate if they predicted an outcome in the following 24 hours. RESULTS: All EWS demonstrated higher performance within the medical population as compared to surgical: higher positive predictive value (P <.0001 for all scores) and sensitivity (P <.0001 for all scores). All EWS had positive predictive values below 25%. CONCLUSIONS: The overall poor performance of the evaluated EWS was marginally better in medical patients when compared to surgical patients.

UR - http://www.scopus.com/inward/record.url?scp=85037567015&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85037567015&partnerID=8YFLogxK

U2 - 10.12788/jhm.2712

DO - 10.12788/jhm.2712

M3 - Article

C2 - 28411289

AN - SCOPUS:85037567015

VL - 12

SP - 217

EP - 223

JO - Journal of Hospital Medicine

JF - Journal of Hospital Medicine

SN - 1553-5606

IS - 4

ER -