Departures from community equipoise may lead to incorrect inference in randomized trials

Jeffrey N. Katz, John Wright, Bruce A. Levy, John A. Baron, Elena Losina

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Objective: To assess the impact of selective enrollment on the results of randomized controlled trials (RCTs). Study Design and Setting: We simulated an RCT of arthroscopic partial meniscectomy vs. nonoperative therapy in patients with meniscal tear and osteoarthritis (OA). We estimated efficacy with the risk ratio (RR) comparing the likelihood of clinically important improvement after surgery with that after nonoperative therapy. We assumed that efficacy differs by extent of OA. We simulated four scenarios: (1) nonselective enrollment; (2) higher likelihood of enrolling subjects with mild OA; (3) higher likelihood of enrolling subjects with severe OA; (4) much higher likelihood of enrolling subjects with severe OA. For each scenario, we simulated 100 trials with sample size 340. Results: With nonselective enrollment, reflecting community equipoise, the results in 100 trials were consistent with those in the underlying population (mean RR: 1.87; 95% confidence interval [95% CI]: 1.57, 2.14). Selective enrollment of subjects with much higher likelihood of severe OA resulted in 28% lower efficacy of surgery (mean RR: 1.34; 95% CI: 0.93, 2.15), with 95% CI containing the true efficacy in just 25% of trials and empirical power of 44%. Conclusion: Selective enrollment with respect to factors associated with efficacy may affect trial results and lead to inaccurate conclusions.

Original languageEnglish (US)
Pages (from-to)280-285
Number of pages6
JournalJournal of Clinical Epidemiology
Volume64
Issue number3
DOIs
StatePublished - Mar 2011

Fingerprint

Osteoarthritis
Odds Ratio
Confidence Intervals
Randomized Controlled Trials
Tears
Sample Size
boldenone undecylenate
Therapeutics
Population

Keywords

  • Arthroscopy
  • Equipoise
  • Generalizability
  • Meniscectomy
  • Randomized controlled trial
  • Selection bias
  • Simulation

ASJC Scopus subject areas

  • Epidemiology

Cite this

Departures from community equipoise may lead to incorrect inference in randomized trials. / Katz, Jeffrey N.; Wright, John; Levy, Bruce A.; Baron, John A.; Losina, Elena.

In: Journal of Clinical Epidemiology, Vol. 64, No. 3, 03.2011, p. 280-285.

Research output: Contribution to journalArticle

Katz, Jeffrey N. ; Wright, John ; Levy, Bruce A. ; Baron, John A. ; Losina, Elena. / Departures from community equipoise may lead to incorrect inference in randomized trials. In: Journal of Clinical Epidemiology. 2011 ; Vol. 64, No. 3. pp. 280-285.
@article{efda94f914d9408c89fb305b4ced43e0,
title = "Departures from community equipoise may lead to incorrect inference in randomized trials",
abstract = "Objective: To assess the impact of selective enrollment on the results of randomized controlled trials (RCTs). Study Design and Setting: We simulated an RCT of arthroscopic partial meniscectomy vs. nonoperative therapy in patients with meniscal tear and osteoarthritis (OA). We estimated efficacy with the risk ratio (RR) comparing the likelihood of clinically important improvement after surgery with that after nonoperative therapy. We assumed that efficacy differs by extent of OA. We simulated four scenarios: (1) nonselective enrollment; (2) higher likelihood of enrolling subjects with mild OA; (3) higher likelihood of enrolling subjects with severe OA; (4) much higher likelihood of enrolling subjects with severe OA. For each scenario, we simulated 100 trials with sample size 340. Results: With nonselective enrollment, reflecting community equipoise, the results in 100 trials were consistent with those in the underlying population (mean RR: 1.87; 95{\%} confidence interval [95{\%} CI]: 1.57, 2.14). Selective enrollment of subjects with much higher likelihood of severe OA resulted in 28{\%} lower efficacy of surgery (mean RR: 1.34; 95{\%} CI: 0.93, 2.15), with 95{\%} CI containing the true efficacy in just 25{\%} of trials and empirical power of 44{\%}. Conclusion: Selective enrollment with respect to factors associated with efficacy may affect trial results and lead to inaccurate conclusions.",
keywords = "Arthroscopy, Equipoise, Generalizability, Meniscectomy, Randomized controlled trial, Selection bias, Simulation",
author = "Katz, {Jeffrey N.} and John Wright and Levy, {Bruce A.} and Baron, {John A.} and Elena Losina",
year = "2011",
month = "3",
doi = "10.1016/j.jclinepi.2010.04.008",
language = "English (US)",
volume = "64",
pages = "280--285",
journal = "Journal of Clinical Epidemiology",
issn = "0895-4356",
publisher = "Elsevier USA",
number = "3",

}

TY - JOUR

T1 - Departures from community equipoise may lead to incorrect inference in randomized trials

AU - Katz, Jeffrey N.

AU - Wright, John

AU - Levy, Bruce A.

AU - Baron, John A.

AU - Losina, Elena

PY - 2011/3

Y1 - 2011/3

N2 - Objective: To assess the impact of selective enrollment on the results of randomized controlled trials (RCTs). Study Design and Setting: We simulated an RCT of arthroscopic partial meniscectomy vs. nonoperative therapy in patients with meniscal tear and osteoarthritis (OA). We estimated efficacy with the risk ratio (RR) comparing the likelihood of clinically important improvement after surgery with that after nonoperative therapy. We assumed that efficacy differs by extent of OA. We simulated four scenarios: (1) nonselective enrollment; (2) higher likelihood of enrolling subjects with mild OA; (3) higher likelihood of enrolling subjects with severe OA; (4) much higher likelihood of enrolling subjects with severe OA. For each scenario, we simulated 100 trials with sample size 340. Results: With nonselective enrollment, reflecting community equipoise, the results in 100 trials were consistent with those in the underlying population (mean RR: 1.87; 95% confidence interval [95% CI]: 1.57, 2.14). Selective enrollment of subjects with much higher likelihood of severe OA resulted in 28% lower efficacy of surgery (mean RR: 1.34; 95% CI: 0.93, 2.15), with 95% CI containing the true efficacy in just 25% of trials and empirical power of 44%. Conclusion: Selective enrollment with respect to factors associated with efficacy may affect trial results and lead to inaccurate conclusions.

AB - Objective: To assess the impact of selective enrollment on the results of randomized controlled trials (RCTs). Study Design and Setting: We simulated an RCT of arthroscopic partial meniscectomy vs. nonoperative therapy in patients with meniscal tear and osteoarthritis (OA). We estimated efficacy with the risk ratio (RR) comparing the likelihood of clinically important improvement after surgery with that after nonoperative therapy. We assumed that efficacy differs by extent of OA. We simulated four scenarios: (1) nonselective enrollment; (2) higher likelihood of enrolling subjects with mild OA; (3) higher likelihood of enrolling subjects with severe OA; (4) much higher likelihood of enrolling subjects with severe OA. For each scenario, we simulated 100 trials with sample size 340. Results: With nonselective enrollment, reflecting community equipoise, the results in 100 trials were consistent with those in the underlying population (mean RR: 1.87; 95% confidence interval [95% CI]: 1.57, 2.14). Selective enrollment of subjects with much higher likelihood of severe OA resulted in 28% lower efficacy of surgery (mean RR: 1.34; 95% CI: 0.93, 2.15), with 95% CI containing the true efficacy in just 25% of trials and empirical power of 44%. Conclusion: Selective enrollment with respect to factors associated with efficacy may affect trial results and lead to inaccurate conclusions.

KW - Arthroscopy

KW - Equipoise

KW - Generalizability

KW - Meniscectomy

KW - Randomized controlled trial

KW - Selection bias

KW - Simulation

UR - http://www.scopus.com/inward/record.url?scp=78751647894&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78751647894&partnerID=8YFLogxK

U2 - 10.1016/j.jclinepi.2010.04.008

DO - 10.1016/j.jclinepi.2010.04.008

M3 - Article

C2 - 20638236

AN - SCOPUS:78751647894

VL - 64

SP - 280

EP - 285

JO - Journal of Clinical Epidemiology

JF - Journal of Clinical Epidemiology

SN - 0895-4356

IS - 3

ER -