TY - JOUR
T1 - Automated chart review for asthma cohort identification using natural language processing
T2 - An exploratory study
AU - Wu, Stephen T.
AU - Sohn, Sunghwan
AU - Ravikumar, K. E.
AU - Wagholikar, Kavishwar
AU - Jonnalagadda, Siddhartha R.
AU - Liu, Hongfang
AU - Juhn, Young J.
PY - 2013/11
Y1 - 2013/11
N2 - Background A significant proportion of children with asthma have delayed diagnosis of asthma by health care providers. Manual chart review according to established criteria is more accurate than directly using diagnosis codes, which tend to under-identify asthmatics, but chart reviews are more costly and less timely. Objective To evaluate the accuracy of a computational approach to asthma ascertainment, characterizing its utility and feasibility toward large-scale deployment in electronic medical records. Methods A natural language processing (NLP) system was developed for extracting predetermined criteria for asthma from unstructured text in electronic medical records and then inferring asthma status based on these criteria. Using manual chart reviews as a gold standard, asthma status (yes vs no) and identification date (first date of a "yes" asthma status) were determined by the NLP system. Results Patients were a group of children (n = 112, 84% Caucasian, 49% girls) younger than 4 years (mean 2.0 years, standard deviation 1.03 years) who participated in previous studies. The NLP approach to asthma ascertainment showed sensitivity, specificity, positive predictive value, negative predictive value, and median delay in diagnosis of 84.6%, 96.5%, 88.0%, 95.4%, and 0 months, respectively; this compared favorably with diagnosis codes, at 30.8%, 93.2%, 57.1%, 82.2%, and 2.3 months, respectively. Conclusion Automated asthma ascertainment from electronic medical records using NLP is feasible and more accurate than traditional approaches such as diagnosis codes. Considering the difficulty of labor-intensive manual record review, NLP approaches for asthma ascertainment should be considered for improving clinical care and research, especially in large-scale efforts.
AB - Background A significant proportion of children with asthma have delayed diagnosis of asthma by health care providers. Manual chart review according to established criteria is more accurate than directly using diagnosis codes, which tend to under-identify asthmatics, but chart reviews are more costly and less timely. Objective To evaluate the accuracy of a computational approach to asthma ascertainment, characterizing its utility and feasibility toward large-scale deployment in electronic medical records. Methods A natural language processing (NLP) system was developed for extracting predetermined criteria for asthma from unstructured text in electronic medical records and then inferring asthma status based on these criteria. Using manual chart reviews as a gold standard, asthma status (yes vs no) and identification date (first date of a "yes" asthma status) were determined by the NLP system. Results Patients were a group of children (n = 112, 84% Caucasian, 49% girls) younger than 4 years (mean 2.0 years, standard deviation 1.03 years) who participated in previous studies. The NLP approach to asthma ascertainment showed sensitivity, specificity, positive predictive value, negative predictive value, and median delay in diagnosis of 84.6%, 96.5%, 88.0%, 95.4%, and 0 months, respectively; this compared favorably with diagnosis codes, at 30.8%, 93.2%, 57.1%, 82.2%, and 2.3 months, respectively. Conclusion Automated asthma ascertainment from electronic medical records using NLP is feasible and more accurate than traditional approaches such as diagnosis codes. Considering the difficulty of labor-intensive manual record review, NLP approaches for asthma ascertainment should be considered for improving clinical care and research, especially in large-scale efforts.
UR - http://www.scopus.com/inward/record.url?scp=84885960018&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84885960018&partnerID=8YFLogxK
U2 - 10.1016/j.anai.2013.07.022
DO - 10.1016/j.anai.2013.07.022
M3 - Article
C2 - 24125142
AN - SCOPUS:84885960018
SN - 1081-1206
VL - 111
SP - 364
EP - 369
JO - Annals of Allergy, Asthma and Immunology
JF - Annals of Allergy, Asthma and Immunology
IS - 5
ER -