TY - JOUR
T1 - Prospective validation of a near real-time EHR-integrated automated SOFA score calculator
AU - Aakre, Christopher
AU - Franco, Pablo Moreno
AU - Ferreyra, Micaela
AU - Kitson, Jaben
AU - Li, Man
AU - Herasevich, Vitaly
N1 - Publisher Copyright:
© 2017 Elsevier B.V.
PY - 2017/7/1
Y1 - 2017/7/1
N2 - Objectives We created an algorithm for automated Sequential Organ Failure Assessment (SOFA) score calculation within the Electronic Health Record (EHR) to facilitate detection of sepsis based on the Third International Consensus Definitions for Sepsis and Septic Shock (SEPSIS-3) clinical definition. We evaluated the accuracy of near real-time and daily automated SOFA score calculation compared with manual score calculation. Methods Automated SOFA scoring computer programs were developed using available EHR data sources and integrated into a critical care focused patient care dashboard at Mayo Clinic in Rochester, Minnesota. We prospectively compared the accuracy of automated versus manual calculation for a sample of patients admitted to the medical intensive care unit at Mayo Clinic Hospitals in Rochester, Minnesota and Jacksonville, Florida. Agreement was calculated with Cohen's kappa statistic. Reason for discrepancy was tabulated during manual review. Results Random spot check comparisons were performed 134 times on 27 unique patients, and daily SOFA score comparisons were performed for 215 patients over a total of 1206 patient days. Agreement between automatically scored and manually scored SOFA components for both random spot checks (696 pairs, κ = 0.89) and daily calculation (5972 pairs, κ = 0.89) was high. The most common discrepancies were in the respiratory component (inaccurate fraction of inspired oxygen retrieval; 200/1206) and creatinine (normal creatinine in patients with no urine output on dialysis; 128/1094). 147 patients were at risk of developing sepsis after intensive care unit admission, 10 later developed sepsis confirmed by chart review. All were identified before onset of sepsis with the ΔSOFA ≥ 2 point criterion and 46 patients were false-positives. Conclusions Near real-time automated SOFA scoring was found to have strong agreement with manual score calculation and may be useful for the detection of sepsis utilizing the new SEPSIS-3 definition.
AB - Objectives We created an algorithm for automated Sequential Organ Failure Assessment (SOFA) score calculation within the Electronic Health Record (EHR) to facilitate detection of sepsis based on the Third International Consensus Definitions for Sepsis and Septic Shock (SEPSIS-3) clinical definition. We evaluated the accuracy of near real-time and daily automated SOFA score calculation compared with manual score calculation. Methods Automated SOFA scoring computer programs were developed using available EHR data sources and integrated into a critical care focused patient care dashboard at Mayo Clinic in Rochester, Minnesota. We prospectively compared the accuracy of automated versus manual calculation for a sample of patients admitted to the medical intensive care unit at Mayo Clinic Hospitals in Rochester, Minnesota and Jacksonville, Florida. Agreement was calculated with Cohen's kappa statistic. Reason for discrepancy was tabulated during manual review. Results Random spot check comparisons were performed 134 times on 27 unique patients, and daily SOFA score comparisons were performed for 215 patients over a total of 1206 patient days. Agreement between automatically scored and manually scored SOFA components for both random spot checks (696 pairs, κ = 0.89) and daily calculation (5972 pairs, κ = 0.89) was high. The most common discrepancies were in the respiratory component (inaccurate fraction of inspired oxygen retrieval; 200/1206) and creatinine (normal creatinine in patients with no urine output on dialysis; 128/1094). 147 patients were at risk of developing sepsis after intensive care unit admission, 10 later developed sepsis confirmed by chart review. All were identified before onset of sepsis with the ΔSOFA ≥ 2 point criterion and 46 patients were false-positives. Conclusions Near real-time automated SOFA scoring was found to have strong agreement with manual score calculation and may be useful for the detection of sepsis utilizing the new SEPSIS-3 definition.
KW - Automation
KW - Clinical decision support
KW - Computer-assisted diagnosis
KW - Early diagnosis
KW - Sepsis
UR - http://www.scopus.com/inward/record.url?scp=85017292044&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85017292044&partnerID=8YFLogxK
U2 - 10.1016/j.ijmedinf.2017.04.001
DO - 10.1016/j.ijmedinf.2017.04.001
M3 - Article
C2 - 28550994
AN - SCOPUS:85017292044
SN - 1386-5056
VL - 103
SP - 1
EP - 6
JO - International Journal of Medical Informatics
JF - International Journal of Medical Informatics
ER -