A number of factors explain why WHO guideline developers make strong recommendations inconsistent with GRADE guidance

Paul E. Alexander, Michael R. Gionfriddo, Shelly Anne Li, Lisa Bero, Rebecca J. Stoltzfus, Ignacio Neumann, Juan P. Brito, Benjamin Djulbegovic, Victor M. Montori, Susan L. Norris, Holger J. Schünemann, Lehana Thabane, Gordon H. Guyatt

Research output: Contribution to journalArticle

25 Scopus citations

Abstract

Objective Many strong recommendations issued by the World Health Organization (WHO) are based on low- or very low-quality (low certainty) evidence (discordant recommendations). Many such discordant recommendations are inconsistent with the Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidance. We sought to understand why WHO makes discordant recommendations inconsistent with GRADE guidance. Study Design and Setting We interviewed panel members involved in guidelines approved by WHO (2007-2012) that included discordant recommendations. Interviews, recorded and transcribed, focused on use of GRADE including the reasoning underlying, and factors contributing to, discordant recommendations. Results Four themes emerged: strengths of GRADE, challenges and barriers to GRADE, strategies to improve GRADE application, and explanations for discordant recommendations. Reasons for discordant recommendations included skepticism about the value of making conditional recommendations; political considerations; high certainty in benefits (sometimes warranted, sometimes not) despite assessing evidence as low certainty; and concerns that conditional recommendations will be ignored. Conclusion WHO panelists make discordant recommendations inconsistent with GRADE guidance for reasons that include limitations in their understanding of GRADE. Ensuring optimal application of GRADE at WHO and elsewhere likely requires selecting panelists who have a commitment to GRADE principles, additional training of panelists, and formal processes to maximize adherence to GRADE principles.

Original languageEnglish (US)
Pages (from-to)111-122
Number of pages12
JournalJournal of Clinical Epidemiology
Volume70
DOIs
StatePublished - Feb 1 2016

Keywords

  • Discordant recommendations
  • GRADE methods
  • Inconsistent with GRADE guidance
  • Interviews
  • Qualitative descriptive study
  • Strong recommendations low-quality evidence
  • World Health Organization

ASJC Scopus subject areas

  • Epidemiology

Fingerprint Dive into the research topics of 'A number of factors explain why WHO guideline developers make strong recommendations inconsistent with GRADE guidance'. Together they form a unique fingerprint.

  • Cite this

    Alexander, P. E., Gionfriddo, M. R., Li, S. A., Bero, L., Stoltzfus, R. J., Neumann, I., Brito, J. P., Djulbegovic, B., Montori, V. M., Norris, S. L., Schünemann, H. J., Thabane, L., & Guyatt, G. H. (2016). A number of factors explain why WHO guideline developers make strong recommendations inconsistent with GRADE guidance. Journal of Clinical Epidemiology, 70, 111-122. https://doi.org/10.1016/j.jclinepi.2015.09.006