Derivation and multicenter validation of the drug resistance in pneumonia clinical prediction score

Brandon J. Webb, Kristin Dascomb, Edward Stenehjem, Holenarasipur R. Vikram, Neera Agrwal, Kenneth Sakata, Kathryn Williams, Bruno Bockorny, Kavitha Bagavathy, Shireen Mirza, Mark Metersky, Nathan C. Deanh

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

The health care-associated pneumonia (HCAP) criteria have a limited ability to predict pneumonia caused by drug-resistant bacteria and favor the overutilization of broad-spectrum antibiotics. We aimed to derive and validate a clinical prediction score with an improved ability to predict the risk of pneumonia due to drug-resistant pathogens compared to that of HCAP criteria. A derivation cohort of 200 microbiologically confirmed pneumonia cases in 2011 and 2012 was identified retrospectively. Risk factors for pneumonia due to drug-resistant pathogens were evaluated by logistic regression, and a novel prediction score (the drug resistance in pneumonia [DRIP] score) was derived. The score was then validated in a prospective, observational cohort of 200 microbiologically confirmed cases of pneumonia at four U.S. centers in 2013 and 2014. The DRIP score (area under the receiver operator curve [AUROC], 0.88 [95% confidence interval {CI}, 0.82 to 0.93]) performed significantly better (P0.02) than the HCAP criteria (AUROC, 0.72 [95% CI, 0.64 to 0.79]). At a threshold of ≥4 points, the DRIP score demonstrated a sensitivity of 0.82 (95% CI, 0.67 to 0.88), a specificity of 0.81 (95% CI, 0.73 to 0.87), a positive predictive value (PPV) of 0.68 (95% CI, 0.56 to 0.78), and a negative predictive value (NPV) of 0.90 (95% CI, 0.81 to 0.93). By comparison, the performance of HCAP criteria was less favorable: sensitivity was 0.79 (95% CI, 0.67 to 0.88), specificity was 0.65 (95% CI, 0.56 to 0.73), PPV was 0.53 (95% CI, 0.42 to 0.63), and NPV was 0.86 (95% CI, 0.77 to 0.92). The overall accuracy of the HCAP criteria was 69.5% (95% CI, 62.5 to 75.7%), whereas that of the DRIP score was 81.5% (95% CI, 74.2 to 85.6%) (P0.005). Unnecessary extended-spectrum antibiotics were recommended 46% less frequently by applying the DRIP score (25/200, 12.5%) than by use of HCAP criteria (47/200, 23.5%) (P0.004), without increasing the rate at which inadequate treatment recommendations were made. The DRIP score was more predictive of the risk of pneumonia due to drug-resistant pathogens than HCAP criteria and may have the potential to decrease antibiotic overutilization in patients with pneumonia. Validation in larger cohorts of patients with pneumonia due to all causes is necessary.

Original languageEnglish (US)
Pages (from-to)2652-2663
Number of pages12
JournalAntimicrobial Agents and Chemotherapy
Volume60
Issue number5
DOIs
StatePublished - May 1 2016

Fingerprint

Drug Resistance
Pneumonia
Confidence Intervals
Delivery of Health Care
Anti-Bacterial Agents
Pharmaceutical Preparations

ASJC Scopus subject areas

  • Pharmacology (medical)
  • Pharmacology
  • Infectious Diseases

Cite this

Webb, B. J., Dascomb, K., Stenehjem, E., Vikram, H. R., Agrwal, N., Sakata, K., ... Deanh, N. C. (2016). Derivation and multicenter validation of the drug resistance in pneumonia clinical prediction score. Antimicrobial Agents and Chemotherapy, 60(5), 2652-2663. https://doi.org/10.1128/AAC.03071-15

Derivation and multicenter validation of the drug resistance in pneumonia clinical prediction score. / Webb, Brandon J.; Dascomb, Kristin; Stenehjem, Edward; Vikram, Holenarasipur R.; Agrwal, Neera; Sakata, Kenneth; Williams, Kathryn; Bockorny, Bruno; Bagavathy, Kavitha; Mirza, Shireen; Metersky, Mark; Deanh, Nathan C.

In: Antimicrobial Agents and Chemotherapy, Vol. 60, No. 5, 01.05.2016, p. 2652-2663.

Research output: Contribution to journalArticle

Webb, BJ, Dascomb, K, Stenehjem, E, Vikram, HR, Agrwal, N, Sakata, K, Williams, K, Bockorny, B, Bagavathy, K, Mirza, S, Metersky, M & Deanh, NC 2016, 'Derivation and multicenter validation of the drug resistance in pneumonia clinical prediction score', Antimicrobial Agents and Chemotherapy, vol. 60, no. 5, pp. 2652-2663. https://doi.org/10.1128/AAC.03071-15
Webb, Brandon J. ; Dascomb, Kristin ; Stenehjem, Edward ; Vikram, Holenarasipur R. ; Agrwal, Neera ; Sakata, Kenneth ; Williams, Kathryn ; Bockorny, Bruno ; Bagavathy, Kavitha ; Mirza, Shireen ; Metersky, Mark ; Deanh, Nathan C. / Derivation and multicenter validation of the drug resistance in pneumonia clinical prediction score. In: Antimicrobial Agents and Chemotherapy. 2016 ; Vol. 60, No. 5. pp. 2652-2663.
@article{6f8c9c9785264e0ebb9af40ff4e07f00,
title = "Derivation and multicenter validation of the drug resistance in pneumonia clinical prediction score",
abstract = "The health care-associated pneumonia (HCAP) criteria have a limited ability to predict pneumonia caused by drug-resistant bacteria and favor the overutilization of broad-spectrum antibiotics. We aimed to derive and validate a clinical prediction score with an improved ability to predict the risk of pneumonia due to drug-resistant pathogens compared to that of HCAP criteria. A derivation cohort of 200 microbiologically confirmed pneumonia cases in 2011 and 2012 was identified retrospectively. Risk factors for pneumonia due to drug-resistant pathogens were evaluated by logistic regression, and a novel prediction score (the drug resistance in pneumonia [DRIP] score) was derived. The score was then validated in a prospective, observational cohort of 200 microbiologically confirmed cases of pneumonia at four U.S. centers in 2013 and 2014. The DRIP score (area under the receiver operator curve [AUROC], 0.88 [95{\%} confidence interval {CI}, 0.82 to 0.93]) performed significantly better (P0.02) than the HCAP criteria (AUROC, 0.72 [95{\%} CI, 0.64 to 0.79]). At a threshold of ≥4 points, the DRIP score demonstrated a sensitivity of 0.82 (95{\%} CI, 0.67 to 0.88), a specificity of 0.81 (95{\%} CI, 0.73 to 0.87), a positive predictive value (PPV) of 0.68 (95{\%} CI, 0.56 to 0.78), and a negative predictive value (NPV) of 0.90 (95{\%} CI, 0.81 to 0.93). By comparison, the performance of HCAP criteria was less favorable: sensitivity was 0.79 (95{\%} CI, 0.67 to 0.88), specificity was 0.65 (95{\%} CI, 0.56 to 0.73), PPV was 0.53 (95{\%} CI, 0.42 to 0.63), and NPV was 0.86 (95{\%} CI, 0.77 to 0.92). The overall accuracy of the HCAP criteria was 69.5{\%} (95{\%} CI, 62.5 to 75.7{\%}), whereas that of the DRIP score was 81.5{\%} (95{\%} CI, 74.2 to 85.6{\%}) (P0.005). Unnecessary extended-spectrum antibiotics were recommended 46{\%} less frequently by applying the DRIP score (25/200, 12.5{\%}) than by use of HCAP criteria (47/200, 23.5{\%}) (P0.004), without increasing the rate at which inadequate treatment recommendations were made. The DRIP score was more predictive of the risk of pneumonia due to drug-resistant pathogens than HCAP criteria and may have the potential to decrease antibiotic overutilization in patients with pneumonia. Validation in larger cohorts of patients with pneumonia due to all causes is necessary.",
author = "Webb, {Brandon J.} and Kristin Dascomb and Edward Stenehjem and Vikram, {Holenarasipur R.} and Neera Agrwal and Kenneth Sakata and Kathryn Williams and Bruno Bockorny and Kavitha Bagavathy and Shireen Mirza and Mark Metersky and Deanh, {Nathan C.}",
year = "2016",
month = "5",
day = "1",
doi = "10.1128/AAC.03071-15",
language = "English (US)",
volume = "60",
pages = "2652--2663",
journal = "Antimicrobial Agents and Chemotherapy",
issn = "0066-4804",
publisher = "American Society for Microbiology",
number = "5",

}

TY - JOUR

T1 - Derivation and multicenter validation of the drug resistance in pneumonia clinical prediction score

AU - Webb, Brandon J.

AU - Dascomb, Kristin

AU - Stenehjem, Edward

AU - Vikram, Holenarasipur R.

AU - Agrwal, Neera

AU - Sakata, Kenneth

AU - Williams, Kathryn

AU - Bockorny, Bruno

AU - Bagavathy, Kavitha

AU - Mirza, Shireen

AU - Metersky, Mark

AU - Deanh, Nathan C.

PY - 2016/5/1

Y1 - 2016/5/1

N2 - The health care-associated pneumonia (HCAP) criteria have a limited ability to predict pneumonia caused by drug-resistant bacteria and favor the overutilization of broad-spectrum antibiotics. We aimed to derive and validate a clinical prediction score with an improved ability to predict the risk of pneumonia due to drug-resistant pathogens compared to that of HCAP criteria. A derivation cohort of 200 microbiologically confirmed pneumonia cases in 2011 and 2012 was identified retrospectively. Risk factors for pneumonia due to drug-resistant pathogens were evaluated by logistic regression, and a novel prediction score (the drug resistance in pneumonia [DRIP] score) was derived. The score was then validated in a prospective, observational cohort of 200 microbiologically confirmed cases of pneumonia at four U.S. centers in 2013 and 2014. The DRIP score (area under the receiver operator curve [AUROC], 0.88 [95% confidence interval {CI}, 0.82 to 0.93]) performed significantly better (P0.02) than the HCAP criteria (AUROC, 0.72 [95% CI, 0.64 to 0.79]). At a threshold of ≥4 points, the DRIP score demonstrated a sensitivity of 0.82 (95% CI, 0.67 to 0.88), a specificity of 0.81 (95% CI, 0.73 to 0.87), a positive predictive value (PPV) of 0.68 (95% CI, 0.56 to 0.78), and a negative predictive value (NPV) of 0.90 (95% CI, 0.81 to 0.93). By comparison, the performance of HCAP criteria was less favorable: sensitivity was 0.79 (95% CI, 0.67 to 0.88), specificity was 0.65 (95% CI, 0.56 to 0.73), PPV was 0.53 (95% CI, 0.42 to 0.63), and NPV was 0.86 (95% CI, 0.77 to 0.92). The overall accuracy of the HCAP criteria was 69.5% (95% CI, 62.5 to 75.7%), whereas that of the DRIP score was 81.5% (95% CI, 74.2 to 85.6%) (P0.005). Unnecessary extended-spectrum antibiotics were recommended 46% less frequently by applying the DRIP score (25/200, 12.5%) than by use of HCAP criteria (47/200, 23.5%) (P0.004), without increasing the rate at which inadequate treatment recommendations were made. The DRIP score was more predictive of the risk of pneumonia due to drug-resistant pathogens than HCAP criteria and may have the potential to decrease antibiotic overutilization in patients with pneumonia. Validation in larger cohorts of patients with pneumonia due to all causes is necessary.

AB - The health care-associated pneumonia (HCAP) criteria have a limited ability to predict pneumonia caused by drug-resistant bacteria and favor the overutilization of broad-spectrum antibiotics. We aimed to derive and validate a clinical prediction score with an improved ability to predict the risk of pneumonia due to drug-resistant pathogens compared to that of HCAP criteria. A derivation cohort of 200 microbiologically confirmed pneumonia cases in 2011 and 2012 was identified retrospectively. Risk factors for pneumonia due to drug-resistant pathogens were evaluated by logistic regression, and a novel prediction score (the drug resistance in pneumonia [DRIP] score) was derived. The score was then validated in a prospective, observational cohort of 200 microbiologically confirmed cases of pneumonia at four U.S. centers in 2013 and 2014. The DRIP score (area under the receiver operator curve [AUROC], 0.88 [95% confidence interval {CI}, 0.82 to 0.93]) performed significantly better (P0.02) than the HCAP criteria (AUROC, 0.72 [95% CI, 0.64 to 0.79]). At a threshold of ≥4 points, the DRIP score demonstrated a sensitivity of 0.82 (95% CI, 0.67 to 0.88), a specificity of 0.81 (95% CI, 0.73 to 0.87), a positive predictive value (PPV) of 0.68 (95% CI, 0.56 to 0.78), and a negative predictive value (NPV) of 0.90 (95% CI, 0.81 to 0.93). By comparison, the performance of HCAP criteria was less favorable: sensitivity was 0.79 (95% CI, 0.67 to 0.88), specificity was 0.65 (95% CI, 0.56 to 0.73), PPV was 0.53 (95% CI, 0.42 to 0.63), and NPV was 0.86 (95% CI, 0.77 to 0.92). The overall accuracy of the HCAP criteria was 69.5% (95% CI, 62.5 to 75.7%), whereas that of the DRIP score was 81.5% (95% CI, 74.2 to 85.6%) (P0.005). Unnecessary extended-spectrum antibiotics were recommended 46% less frequently by applying the DRIP score (25/200, 12.5%) than by use of HCAP criteria (47/200, 23.5%) (P0.004), without increasing the rate at which inadequate treatment recommendations were made. The DRIP score was more predictive of the risk of pneumonia due to drug-resistant pathogens than HCAP criteria and may have the potential to decrease antibiotic overutilization in patients with pneumonia. Validation in larger cohorts of patients with pneumonia due to all causes is necessary.

UR - http://www.scopus.com/inward/record.url?scp=84964978311&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964978311&partnerID=8YFLogxK

U2 - 10.1128/AAC.03071-15

DO - 10.1128/AAC.03071-15

M3 - Article

C2 - 26856838

AN - SCOPUS:84964978311

VL - 60

SP - 2652

EP - 2663

JO - Antimicrobial Agents and Chemotherapy

JF - Antimicrobial Agents and Chemotherapy

SN - 0066-4804

IS - 5

ER -