TY - JOUR
T1 - Prior Choices of Between-Study Heterogeneity in Contemporary Bayesian Network Meta-analyses
T2 - an Empirical Study
AU - Rosenberger, Kristine J.
AU - Xing, Aiwen
AU - Murad, Mohammad Hassan
AU - Chu, Haitao
AU - Lin, Lifeng
N1 - Funding Information:
This research was supported in part by the U.S. National Institutes of Health/National Library of Medicine grant R01 LM012982 (HC and LL) and National Institutes of Health/National Center for Advancing Translational Sciences grant UL1 TR001427 (LL). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Publisher Copyright:
© 2021, Society of General Internal Medicine.
PY - 2021/4
Y1 - 2021/4
N2 - Background: Network meta-analysis (NMA) is a popular tool to compare multiple treatments in medical research. It is frequently implemented via Bayesian methods. The prior choice of between-study heterogeneity is critical in Bayesian NMAs. This study evaluates the impact of different priors for heterogeneity on NMA results. Methods: We identified all NMAs with binary outcomes published in The BMJ, JAMA, and The Lancet during 2010–2018, and extracted information about their prior choices for heterogeneity. Our primary analyses focused on those with publicly available full data. We re-analyzed the NMAs using 3 commonly-used non-informative priors and empirical informative log-normal priors. We obtained the posterior median odds ratios and 95% credible intervals of all comparisons, assessed the correlation among different priors, and used Bland–Altman plots to evaluate their agreement. The kappa statistic was also used to evaluate the agreement among these priors regarding statistical significance. Results: Among the selected Bayesian NMAs, 52.3% did not specify the prior choice for heterogeneity, and 84.1% did not provide rationales. We re-analyzed 19 NMAs with full data available, involving 894 studies, 173 treatments, and 395,429 patients. The correlation among posterior median (log) odds ratios using different priors were generally very strong for NMAs with over 20 studies. The informative priors produced substantially narrower credible intervals than non-informative priors, especially for NMAs with few studies. Bland–Altman plots and kappa statistics indicated strong overall agreement, but this was not always the case for a specific NMA. Conclusions: Priors should be routinely reported in Bayesian NMAs. Sensitivity analyses are recommended to examine the impact of priors, especially for NMAs with relatively small sample sizes. Informative priors may produce substantially narrower credible intervals for such NMAs.
AB - Background: Network meta-analysis (NMA) is a popular tool to compare multiple treatments in medical research. It is frequently implemented via Bayesian methods. The prior choice of between-study heterogeneity is critical in Bayesian NMAs. This study evaluates the impact of different priors for heterogeneity on NMA results. Methods: We identified all NMAs with binary outcomes published in The BMJ, JAMA, and The Lancet during 2010–2018, and extracted information about their prior choices for heterogeneity. Our primary analyses focused on those with publicly available full data. We re-analyzed the NMAs using 3 commonly-used non-informative priors and empirical informative log-normal priors. We obtained the posterior median odds ratios and 95% credible intervals of all comparisons, assessed the correlation among different priors, and used Bland–Altman plots to evaluate their agreement. The kappa statistic was also used to evaluate the agreement among these priors regarding statistical significance. Results: Among the selected Bayesian NMAs, 52.3% did not specify the prior choice for heterogeneity, and 84.1% did not provide rationales. We re-analyzed 19 NMAs with full data available, involving 894 studies, 173 treatments, and 395,429 patients. The correlation among posterior median (log) odds ratios using different priors were generally very strong for NMAs with over 20 studies. The informative priors produced substantially narrower credible intervals than non-informative priors, especially for NMAs with few studies. Bland–Altman plots and kappa statistics indicated strong overall agreement, but this was not always the case for a specific NMA. Conclusions: Priors should be routinely reported in Bayesian NMAs. Sensitivity analyses are recommended to examine the impact of priors, especially for NMAs with relatively small sample sizes. Informative priors may produce substantially narrower credible intervals for such NMAs.
KW - Bayesian analysis
KW - heterogeneity
KW - network meta-analysis
KW - prior distribution
KW - sensitivity analysis
UR - http://www.scopus.com/inward/record.url?scp=85098712442&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85098712442&partnerID=8YFLogxK
U2 - 10.1007/s11606-020-06357-1
DO - 10.1007/s11606-020-06357-1
M3 - Article
C2 - 33403620
AN - SCOPUS:85098712442
SN - 0884-8734
VL - 36
SP - 1049
EP - 1057
JO - Journal of General Internal Medicine
JF - Journal of General Internal Medicine
IS - 4
ER -