Development and validation of electronic surveillance tool for acute kidney injury: A retrospective analysis

Adil Ahmed, Srinivasan Vairavan, Abbasali Akhoundi, Gregory Wilson, Caitlyn Chiofolo, Nicolas Chbat, Rodrigo Cartin-Ceba, Guangxi Li, Kianoush Kashani

Research output: Contribution to journalArticle

29 Citations (Scopus)

Abstract

Introduction: Timely detection of acute kidney injury (AKI) facilitates prevention of its progress and potentially therapeutic interventions. The study objective is to develop and validate an electronic surveillance tool (AKI sniffer) to detect AKI in 2 independent retrospective cohorts of intensive care unit (ICU) patients. The primary aim is to compare the sensitivity, specificity, and positive and negative predictive values of AKI sniffer performance against a reference standard. Methods: This study is conducted in the ICUs of a tertiary care center. The derivation cohort study subjects were Olmsted County, MN, residents admitted to all Mayo Clinic ICUs from July 1, 2010, through December 31, 2010, and the validation cohort study subjects were all patients admitted to a Mayo Clinic, Rochester, campus medical/surgical ICU on January 12, 2010, through March 23, 2010. All included records were reviewed by 2 independent investigators who adjudicated AKI using the Acute Kidney Injury Network criteria; disagreements were resolved by a third reviewer. This constituted the reference standard. An electronic algorithm was developed; its precision and reliability were assessed in comparison with the reference standard in 2 separate cohorts, derivation and validation. Results: Of 1466 screened patients, a total of 944 patients were included in the study: 482 for derivation and 462 for validation. Compared with the reference standard in the validation cohort, the sensitivity and specificity of the AKI sniffer were 88% and 96%, respectively. The Cohen κ (95% confidence interval) agreement between the electronic and the reference standard was 0.84 (0.78-0.89) and 0.85 (0.80-0.90) in the derivation and validation cohorts. Conclusion: Acute kidney injury can reliably and accurately be detected electronically in ICU patients. The presented method is applicable for both clinical (decision support) and research (enrollment for clinical trials) settings. Prospective validation is required.

Original languageEnglish (US)
Pages (from-to)988-993
Number of pages6
JournalJournal of Critical Care
Volume30
Issue number5
DOIs
StatePublished - Oct 1 2015

Fingerprint

Acute Kidney Injury
Intensive Care Units
Cohort Studies
Clinical Decision Support Systems
Sensitivity and Specificity
Validation Studies
Critical Care
Tertiary Care Centers
Research Personnel
Clinical Trials
Confidence Intervals
Research

Keywords

  • Acute kidney injury
  • Electronic medical records
  • Electronic surveillance

ASJC Scopus subject areas

  • Critical Care and Intensive Care Medicine

Cite this

Ahmed, A., Vairavan, S., Akhoundi, A., Wilson, G., Chiofolo, C., Chbat, N., ... Kashani, K. (2015). Development and validation of electronic surveillance tool for acute kidney injury: A retrospective analysis. Journal of Critical Care, 30(5), 988-993. https://doi.org/10.1016/j.jcrc.2015.05.007

Development and validation of electronic surveillance tool for acute kidney injury : A retrospective analysis. / Ahmed, Adil; Vairavan, Srinivasan; Akhoundi, Abbasali; Wilson, Gregory; Chiofolo, Caitlyn; Chbat, Nicolas; Cartin-Ceba, Rodrigo; Li, Guangxi; Kashani, Kianoush.

In: Journal of Critical Care, Vol. 30, No. 5, 01.10.2015, p. 988-993.

Research output: Contribution to journalArticle

Ahmed, A, Vairavan, S, Akhoundi, A, Wilson, G, Chiofolo, C, Chbat, N, Cartin-Ceba, R, Li, G & Kashani, K 2015, 'Development and validation of electronic surveillance tool for acute kidney injury: A retrospective analysis', Journal of Critical Care, vol. 30, no. 5, pp. 988-993. https://doi.org/10.1016/j.jcrc.2015.05.007
Ahmed, Adil ; Vairavan, Srinivasan ; Akhoundi, Abbasali ; Wilson, Gregory ; Chiofolo, Caitlyn ; Chbat, Nicolas ; Cartin-Ceba, Rodrigo ; Li, Guangxi ; Kashani, Kianoush. / Development and validation of electronic surveillance tool for acute kidney injury : A retrospective analysis. In: Journal of Critical Care. 2015 ; Vol. 30, No. 5. pp. 988-993.
@article{b404955f90594b1d86bccdabad6985b3,
title = "Development and validation of electronic surveillance tool for acute kidney injury: A retrospective analysis",
abstract = "Introduction: Timely detection of acute kidney injury (AKI) facilitates prevention of its progress and potentially therapeutic interventions. The study objective is to develop and validate an electronic surveillance tool (AKI sniffer) to detect AKI in 2 independent retrospective cohorts of intensive care unit (ICU) patients. The primary aim is to compare the sensitivity, specificity, and positive and negative predictive values of AKI sniffer performance against a reference standard. Methods: This study is conducted in the ICUs of a tertiary care center. The derivation cohort study subjects were Olmsted County, MN, residents admitted to all Mayo Clinic ICUs from July 1, 2010, through December 31, 2010, and the validation cohort study subjects were all patients admitted to a Mayo Clinic, Rochester, campus medical/surgical ICU on January 12, 2010, through March 23, 2010. All included records were reviewed by 2 independent investigators who adjudicated AKI using the Acute Kidney Injury Network criteria; disagreements were resolved by a third reviewer. This constituted the reference standard. An electronic algorithm was developed; its precision and reliability were assessed in comparison with the reference standard in 2 separate cohorts, derivation and validation. Results: Of 1466 screened patients, a total of 944 patients were included in the study: 482 for derivation and 462 for validation. Compared with the reference standard in the validation cohort, the sensitivity and specificity of the AKI sniffer were 88{\%} and 96{\%}, respectively. The Cohen κ (95{\%} confidence interval) agreement between the electronic and the reference standard was 0.84 (0.78-0.89) and 0.85 (0.80-0.90) in the derivation and validation cohorts. Conclusion: Acute kidney injury can reliably and accurately be detected electronically in ICU patients. The presented method is applicable for both clinical (decision support) and research (enrollment for clinical trials) settings. Prospective validation is required.",
keywords = "Acute kidney injury, Electronic medical records, Electronic surveillance",
author = "Adil Ahmed and Srinivasan Vairavan and Abbasali Akhoundi and Gregory Wilson and Caitlyn Chiofolo and Nicolas Chbat and Rodrigo Cartin-Ceba and Guangxi Li and Kianoush Kashani",
year = "2015",
month = "10",
day = "1",
doi = "10.1016/j.jcrc.2015.05.007",
language = "English (US)",
volume = "30",
pages = "988--993",
journal = "Journal of Critical Care",
issn = "0883-9441",
publisher = "Elsevier BV",
number = "5",

}

TY - JOUR

T1 - Development and validation of electronic surveillance tool for acute kidney injury

T2 - A retrospective analysis

AU - Ahmed, Adil

AU - Vairavan, Srinivasan

AU - Akhoundi, Abbasali

AU - Wilson, Gregory

AU - Chiofolo, Caitlyn

AU - Chbat, Nicolas

AU - Cartin-Ceba, Rodrigo

AU - Li, Guangxi

AU - Kashani, Kianoush

PY - 2015/10/1

Y1 - 2015/10/1

N2 - Introduction: Timely detection of acute kidney injury (AKI) facilitates prevention of its progress and potentially therapeutic interventions. The study objective is to develop and validate an electronic surveillance tool (AKI sniffer) to detect AKI in 2 independent retrospective cohorts of intensive care unit (ICU) patients. The primary aim is to compare the sensitivity, specificity, and positive and negative predictive values of AKI sniffer performance against a reference standard. Methods: This study is conducted in the ICUs of a tertiary care center. The derivation cohort study subjects were Olmsted County, MN, residents admitted to all Mayo Clinic ICUs from July 1, 2010, through December 31, 2010, and the validation cohort study subjects were all patients admitted to a Mayo Clinic, Rochester, campus medical/surgical ICU on January 12, 2010, through March 23, 2010. All included records were reviewed by 2 independent investigators who adjudicated AKI using the Acute Kidney Injury Network criteria; disagreements were resolved by a third reviewer. This constituted the reference standard. An electronic algorithm was developed; its precision and reliability were assessed in comparison with the reference standard in 2 separate cohorts, derivation and validation. Results: Of 1466 screened patients, a total of 944 patients were included in the study: 482 for derivation and 462 for validation. Compared with the reference standard in the validation cohort, the sensitivity and specificity of the AKI sniffer were 88% and 96%, respectively. The Cohen κ (95% confidence interval) agreement between the electronic and the reference standard was 0.84 (0.78-0.89) and 0.85 (0.80-0.90) in the derivation and validation cohorts. Conclusion: Acute kidney injury can reliably and accurately be detected electronically in ICU patients. The presented method is applicable for both clinical (decision support) and research (enrollment for clinical trials) settings. Prospective validation is required.

AB - Introduction: Timely detection of acute kidney injury (AKI) facilitates prevention of its progress and potentially therapeutic interventions. The study objective is to develop and validate an electronic surveillance tool (AKI sniffer) to detect AKI in 2 independent retrospective cohorts of intensive care unit (ICU) patients. The primary aim is to compare the sensitivity, specificity, and positive and negative predictive values of AKI sniffer performance against a reference standard. Methods: This study is conducted in the ICUs of a tertiary care center. The derivation cohort study subjects were Olmsted County, MN, residents admitted to all Mayo Clinic ICUs from July 1, 2010, through December 31, 2010, and the validation cohort study subjects were all patients admitted to a Mayo Clinic, Rochester, campus medical/surgical ICU on January 12, 2010, through March 23, 2010. All included records were reviewed by 2 independent investigators who adjudicated AKI using the Acute Kidney Injury Network criteria; disagreements were resolved by a third reviewer. This constituted the reference standard. An electronic algorithm was developed; its precision and reliability were assessed in comparison with the reference standard in 2 separate cohorts, derivation and validation. Results: Of 1466 screened patients, a total of 944 patients were included in the study: 482 for derivation and 462 for validation. Compared with the reference standard in the validation cohort, the sensitivity and specificity of the AKI sniffer were 88% and 96%, respectively. The Cohen κ (95% confidence interval) agreement between the electronic and the reference standard was 0.84 (0.78-0.89) and 0.85 (0.80-0.90) in the derivation and validation cohorts. Conclusion: Acute kidney injury can reliably and accurately be detected electronically in ICU patients. The presented method is applicable for both clinical (decision support) and research (enrollment for clinical trials) settings. Prospective validation is required.

KW - Acute kidney injury

KW - Electronic medical records

KW - Electronic surveillance

UR - http://www.scopus.com/inward/record.url?scp=84941315637&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84941315637&partnerID=8YFLogxK

U2 - 10.1016/j.jcrc.2015.05.007

DO - 10.1016/j.jcrc.2015.05.007

M3 - Article

C2 - 26070247

AN - SCOPUS:84941315637

VL - 30

SP - 988

EP - 993

JO - Journal of Critical Care

JF - Journal of Critical Care

SN - 0883-9441

IS - 5

ER -