Reflections on experimental research in medical education

David Allan Cook, Thomas J. Beckman

Research output: Contribution to journalArticle

56 Citations (Scopus)

Abstract

As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders. Second, the posttest-only design is inherently stronger than the pretest-posttest design, provided the study is randomized and the sample is sufficiently large. Third, demonstrating the superiority of an educational intervention in comparison to no intervention does little to advance the art and science of education. Fourth, comparisons involving multifactorial interventions are hopelessly confounded, have limited application to new settings, and do little to advance our understanding of education. Fifth, single-group pretest-posttest studies are susceptible to numerous validity threats. Finally, educational interventions (including the comparison group) must be described in detail sufficient to allow replication.

Original languageEnglish (US)
Pages (from-to)455-464
Number of pages10
JournalAdvances in Health Sciences Education
Volume15
Issue number3
DOIs
StatePublished - 2010

Fingerprint

Medical Education
Education
Research
education
Art
Random Allocation
Biomedical Research
Research Personnel
Group
threat
science

Keywords

  • Curriculum
  • Experiment
  • Medical education
  • Research design
  • Research methods

ASJC Scopus subject areas

  • Medicine(all)
  • Education

Cite this

Reflections on experimental research in medical education. / Cook, David Allan; Beckman, Thomas J.

In: Advances in Health Sciences Education, Vol. 15, No. 3, 2010, p. 455-464.

Research output: Contribution to journalArticle

@article{003aab3fe284409b8d466174acf3781e,
title = "Reflections on experimental research in medical education",
abstract = "As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders. Second, the posttest-only design is inherently stronger than the pretest-posttest design, provided the study is randomized and the sample is sufficiently large. Third, demonstrating the superiority of an educational intervention in comparison to no intervention does little to advance the art and science of education. Fourth, comparisons involving multifactorial interventions are hopelessly confounded, have limited application to new settings, and do little to advance our understanding of education. Fifth, single-group pretest-posttest studies are susceptible to numerous validity threats. Finally, educational interventions (including the comparison group) must be described in detail sufficient to allow replication.",
keywords = "Curriculum, Experiment, Medical education, Research design, Research methods",
author = "Cook, {David Allan} and Beckman, {Thomas J.}",
year = "2010",
doi = "10.1007/s10459-008-9117-3",
language = "English (US)",
volume = "15",
pages = "455--464",
journal = "Advances in Health Sciences Education",
issn = "1382-4996",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - Reflections on experimental research in medical education

AU - Cook, David Allan

AU - Beckman, Thomas J.

PY - 2010

Y1 - 2010

N2 - As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders. Second, the posttest-only design is inherently stronger than the pretest-posttest design, provided the study is randomized and the sample is sufficiently large. Third, demonstrating the superiority of an educational intervention in comparison to no intervention does little to advance the art and science of education. Fourth, comparisons involving multifactorial interventions are hopelessly confounded, have limited application to new settings, and do little to advance our understanding of education. Fifth, single-group pretest-posttest studies are susceptible to numerous validity threats. Finally, educational interventions (including the comparison group) must be described in detail sufficient to allow replication.

AB - As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders. Second, the posttest-only design is inherently stronger than the pretest-posttest design, provided the study is randomized and the sample is sufficiently large. Third, demonstrating the superiority of an educational intervention in comparison to no intervention does little to advance the art and science of education. Fourth, comparisons involving multifactorial interventions are hopelessly confounded, have limited application to new settings, and do little to advance our understanding of education. Fifth, single-group pretest-posttest studies are susceptible to numerous validity threats. Finally, educational interventions (including the comparison group) must be described in detail sufficient to allow replication.

KW - Curriculum

KW - Experiment

KW - Medical education

KW - Research design

KW - Research methods

UR - http://www.scopus.com/inward/record.url?scp=77956876558&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956876558&partnerID=8YFLogxK

U2 - 10.1007/s10459-008-9117-3

DO - 10.1007/s10459-008-9117-3

M3 - Article

VL - 15

SP - 455

EP - 464

JO - Advances in Health Sciences Education

JF - Advances in Health Sciences Education

SN - 1382-4996

IS - 3

ER -