Early studies reported extreme findings with large variability: A meta-epidemiologic study in the field of endocrinology

Zhen Wang, Fares Alahdab, Jehad Almasri, Qusay Haydour, Khaled Mohammed, Abd Moain Abu Dabrh, Larry J. Prokop, Wedad Alfarkh, Sumaya Lakis, Victor Manuel Montori, Mohammad H Murad

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Objectives: To evaluate the presence of extreme findings and fluctuation in effect size in endocrinology. Study Design and Settings: We systematically identified all meta-analyses published in 2014 in the field of endocrinology. Within each meta-analysis, the effect size of the primary binary outcome was compared across studies according to their order of publication. We pooled studies using the DerSimonian and Laird random-effects method. Heterogeneity was evaluated using the I 2 and tau2. Results: Twelve percent of the included 100 meta-analyses reported the largest effect size in the very first published study. The largest effect size occurred in the first 2 earliest studies in 31% of meta-analyses. When the effect size was the largest in the first published study, it was three times larger than the final pooled effect (ratio of rates, 3.26; 95% confidence interval: 1.80, 5.90). The largest heterogeneity measured by I 2 was observed in 18% of the included meta-analyses when combining the first 2 studies or 17% when combing the first 3 studies. Conclusions: In endocrinology, early studies reported extreme findings with large variability. This behavior of the evidence needs to be taken into account when used to formulate clinical policies.

Original languageEnglish (US)
JournalJournal of Clinical Epidemiology
DOIs
StateAccepted/In press - 2016

Fingerprint

Endocrinology
Meta-Analysis
Epidemiologic Studies
Publications
Confidence Intervals

Keywords

  • Bias
  • Effect size
  • Meta-analysis
  • Proteus effect
  • Publication bias
  • Systematic review

ASJC Scopus subject areas

  • Epidemiology

Cite this

Early studies reported extreme findings with large variability : A meta-epidemiologic study in the field of endocrinology. / Wang, Zhen; Alahdab, Fares; Almasri, Jehad; Haydour, Qusay; Mohammed, Khaled; Abu Dabrh, Abd Moain; Prokop, Larry J.; Alfarkh, Wedad; Lakis, Sumaya; Montori, Victor Manuel; Murad, Mohammad H.

In: Journal of Clinical Epidemiology, 2016.

Research output: Contribution to journalArticle

@article{6a2a62b7e5b04d7193668dde8a28e92b,
title = "Early studies reported extreme findings with large variability: A meta-epidemiologic study in the field of endocrinology",
abstract = "Objectives: To evaluate the presence of extreme findings and fluctuation in effect size in endocrinology. Study Design and Settings: We systematically identified all meta-analyses published in 2014 in the field of endocrinology. Within each meta-analysis, the effect size of the primary binary outcome was compared across studies according to their order of publication. We pooled studies using the DerSimonian and Laird random-effects method. Heterogeneity was evaluated using the I 2 and tau2. Results: Twelve percent of the included 100 meta-analyses reported the largest effect size in the very first published study. The largest effect size occurred in the first 2 earliest studies in 31{\%} of meta-analyses. When the effect size was the largest in the first published study, it was three times larger than the final pooled effect (ratio of rates, 3.26; 95{\%} confidence interval: 1.80, 5.90). The largest heterogeneity measured by I 2 was observed in 18{\%} of the included meta-analyses when combining the first 2 studies or 17{\%} when combing the first 3 studies. Conclusions: In endocrinology, early studies reported extreme findings with large variability. This behavior of the evidence needs to be taken into account when used to formulate clinical policies.",
keywords = "Bias, Effect size, Meta-analysis, Proteus effect, Publication bias, Systematic review",
author = "Zhen Wang and Fares Alahdab and Jehad Almasri and Qusay Haydour and Khaled Mohammed and {Abu Dabrh}, {Abd Moain} and Prokop, {Larry J.} and Wedad Alfarkh and Sumaya Lakis and Montori, {Victor Manuel} and Murad, {Mohammad H}",
year = "2016",
doi = "10.1016/j.jclinepi.2015.10.015",
language = "English (US)",
journal = "Journal of Clinical Epidemiology",
issn = "0895-4356",
publisher = "Elsevier USA",

}

TY - JOUR

T1 - Early studies reported extreme findings with large variability

T2 - A meta-epidemiologic study in the field of endocrinology

AU - Wang, Zhen

AU - Alahdab, Fares

AU - Almasri, Jehad

AU - Haydour, Qusay

AU - Mohammed, Khaled

AU - Abu Dabrh, Abd Moain

AU - Prokop, Larry J.

AU - Alfarkh, Wedad

AU - Lakis, Sumaya

AU - Montori, Victor Manuel

AU - Murad, Mohammad H

PY - 2016

Y1 - 2016

N2 - Objectives: To evaluate the presence of extreme findings and fluctuation in effect size in endocrinology. Study Design and Settings: We systematically identified all meta-analyses published in 2014 in the field of endocrinology. Within each meta-analysis, the effect size of the primary binary outcome was compared across studies according to their order of publication. We pooled studies using the DerSimonian and Laird random-effects method. Heterogeneity was evaluated using the I 2 and tau2. Results: Twelve percent of the included 100 meta-analyses reported the largest effect size in the very first published study. The largest effect size occurred in the first 2 earliest studies in 31% of meta-analyses. When the effect size was the largest in the first published study, it was three times larger than the final pooled effect (ratio of rates, 3.26; 95% confidence interval: 1.80, 5.90). The largest heterogeneity measured by I 2 was observed in 18% of the included meta-analyses when combining the first 2 studies or 17% when combing the first 3 studies. Conclusions: In endocrinology, early studies reported extreme findings with large variability. This behavior of the evidence needs to be taken into account when used to formulate clinical policies.

AB - Objectives: To evaluate the presence of extreme findings and fluctuation in effect size in endocrinology. Study Design and Settings: We systematically identified all meta-analyses published in 2014 in the field of endocrinology. Within each meta-analysis, the effect size of the primary binary outcome was compared across studies according to their order of publication. We pooled studies using the DerSimonian and Laird random-effects method. Heterogeneity was evaluated using the I 2 and tau2. Results: Twelve percent of the included 100 meta-analyses reported the largest effect size in the very first published study. The largest effect size occurred in the first 2 earliest studies in 31% of meta-analyses. When the effect size was the largest in the first published study, it was three times larger than the final pooled effect (ratio of rates, 3.26; 95% confidence interval: 1.80, 5.90). The largest heterogeneity measured by I 2 was observed in 18% of the included meta-analyses when combining the first 2 studies or 17% when combing the first 3 studies. Conclusions: In endocrinology, early studies reported extreme findings with large variability. This behavior of the evidence needs to be taken into account when used to formulate clinical policies.

KW - Bias

KW - Effect size

KW - Meta-analysis

KW - Proteus effect

KW - Publication bias

KW - Systematic review

UR - http://www.scopus.com/inward/record.url?scp=84955282335&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84955282335&partnerID=8YFLogxK

U2 - 10.1016/j.jclinepi.2015.10.015

DO - 10.1016/j.jclinepi.2015.10.015

M3 - Article

C2 - 26560990

AN - SCOPUS:84961052037

JO - Journal of Clinical Epidemiology

JF - Journal of Clinical Epidemiology

SN - 0895-4356

ER -