World Health Organization strong recommendations based on low-quality evidence (study quality) are frequent and often inconsistent with GRADE guidance

Paul E. Alexander, Juan P. Brito, Ignacio Neumann, Michael R. Gionfriddo, Lisa Bero, Benjamin Djulbegovic, Rebecca Stoltzfus, Victor M. Montori, Susan L. Norris, Holger J. Schünemann, Gordon H. Guyatt

Research output: Contribution to journalArticlepeer-review

40 Scopus citations


Objectives In 2007 the World Health Organization (WHO) adopted the GRADE system for development of public health guidelines. Previously we found that many strong recommendations issued by WHO are based on evidence for which there is only low or very low confidence in the estimates of effect (discordant recommendations). GRADE guidance indicates that such discordant recommendations are rarely appropriate but suggests five paradigmatic situations in which discordant recommendations may be warranted. We sought to provide insight into the many discordant recommendations in WHO guidelines. Study Design and Setting We examined all guidelines that used the GRADE method and were approved by the WHO Guideline Review Committee between 2007 and 2012. Teams of reviewers independently abstracted data from eligible guidelines and classified recommendations either into one of the five paradigms for appropriately-formulated discordant recommendations or into three additional categories in which discordant recommendations were inconsistent with GRADE guidance: 1) the evidence warranted moderate or high confidence (a misclassification of evidence) rather than low or very low confidence; 2) good practice statements; or 3) uncertainty in the estimates of effect would best lead to a conditional (weak) recommendation. Results The 33 eligible guidelines included 160 discordant recommendations, of which 98 (61.3%) addressed drug interventions and 132 (82.5%) provided some rationale (though not entirely explicit at times) for the strong recommendation. Of 160 discordant recommendations, 25 (15.6%) were judged consistent with one of the five paradigms for appropriate recommendations; 33 (21%) were based on evidence warranting moderate or high confidence in the estimates of effect; 29 (18%) were good practice statements; and 73 (46%) warranted a conditional, rather than a strong recommendation. Conclusion WHO discordant recommendations are often inconsistent with GRADE guidance, possibly threatening the integrity of the process. Further training in GRADE methods for WHO guideline development group members may be necessary, along with further research on what motivates the formulation of such recommendations.

Original languageEnglish (US)
Pages (from-to)98-106
Number of pages9
JournalJournal of Clinical Epidemiology
StatePublished - Apr 1 2016


  • Confidence in effect estimates
  • Discordant recommendations
  • Low study quality
  • Public health guidelines
  • Strong recommendations
  • World Health Organization

ASJC Scopus subject areas

  • Epidemiology


Dive into the research topics of 'World Health Organization strong recommendations based on low-quality evidence (study quality) are frequent and often inconsistent with GRADE guidance'. Together they form a unique fingerprint.

Cite this