TY - JOUR
T1 - Real-world performance, long-Term efficacy, and absence of bias in the artificial intelligence enhanced electrocardiogram to detect left ventricular systolic dysfunction
AU - Harmon, David M.
AU - Carter, Rickey E.
AU - Cohen-Shelly, Michal
AU - Svatikova, Anna
AU - Adedinsewo, Demilade A.
AU - Noseworthy, Peter A.
AU - Kapa, Suraj
AU - Lopez-Jimenez, Francisco
AU - Friedman, Paul Andrew
AU - Attia, Zachi I.
N1 - Publisher Copyright:
© 2022 The Author(s).
PY - 2022/6/1
Y1 - 2022/6/1
N2 - Aims: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction with respect to multiple patient and electrocardiogram variables to determine the algorithm's long-Term efficacy and potential bias in the absence of retraining. Methods and results: Electrocardiograms acquired in 2019 at Mayo Clinic in Minnesota, Arizona, and Florida with an echocardiogram performed within 14 days were analyzed (n = 44 986 unique patients). The area under the curve (AUC) was calculated to evaluate performance of the algorithm among age groups, racial and ethnic groups, patient encounter location, electrocardiogram features, and over time. The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction had an AUC of 0.903 for the total cohort. Time series analysis of the model validated its temporal stability. Areas under the curve were similar for all racial and ethnic groups (0.90-0.92) with minimal performance difference between sexes. Patients with a 'normal sinus rhythm' electrocardiogram (n = 37 047) exhibited an AUC of 0.91. All other electrocardiogram features had areas under the curve between 0.79 and 0.91, with the lowest performance occurring in the left bundle branch block group (0.79). Conclusion: The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction is stable over time in the absence of retraining and robust with respect to multiple variables including time, patient race, and electrocardiogram features.
AB - Aims: Some artificial intelligence models applied in medical practice require ongoing retraining, introduce unintended racial bias, or have variable performance among different subgroups of patients. We assessed the real-world performance of the artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction with respect to multiple patient and electrocardiogram variables to determine the algorithm's long-Term efficacy and potential bias in the absence of retraining. Methods and results: Electrocardiograms acquired in 2019 at Mayo Clinic in Minnesota, Arizona, and Florida with an echocardiogram performed within 14 days were analyzed (n = 44 986 unique patients). The area under the curve (AUC) was calculated to evaluate performance of the algorithm among age groups, racial and ethnic groups, patient encounter location, electrocardiogram features, and over time. The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction had an AUC of 0.903 for the total cohort. Time series analysis of the model validated its temporal stability. Areas under the curve were similar for all racial and ethnic groups (0.90-0.92) with minimal performance difference between sexes. Patients with a 'normal sinus rhythm' electrocardiogram (n = 37 047) exhibited an AUC of 0.91. All other electrocardiogram features had areas under the curve between 0.79 and 0.91, with the lowest performance occurring in the left bundle branch block group (0.79). Conclusion: The artificial intelligence-enhanced electrocardiogram to detect left ventricular systolic dysfunction is stable over time in the absence of retraining and robust with respect to multiple variables including time, patient race, and electrocardiogram features.
KW - Arrhythmia
KW - Artificial intelligence
KW - Deep learning
KW - Digital medicine
KW - ECG
KW - Heart failure
UR - http://www.scopus.com/inward/record.url?scp=85145228090&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85145228090&partnerID=8YFLogxK
U2 - 10.1093/ehjdh/ztac028
DO - 10.1093/ehjdh/ztac028
M3 - Article
AN - SCOPUS:85145228090
SN - 2634-3916
VL - 3
SP - 238
EP - 244
JO - European Heart Journal - Digital Health
JF - European Heart Journal - Digital Health
IS - 2
ER -