Validation of a Teaching Effectiveness Assessment in Psychiatry Continuing Medical Education

Brian A. Palmer, Mark A. Frye, Kristin S. Vickers Douglas, Jeffrey P. Staab, Robert P Bright, Cathy D. Schleck, Jayawant N. Mandrekar, Saswati Mahapatra, Thomas J. Beckman, Christopher M. Wittich

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

Objective: Little is known about factors associated with effective continuing medical education (CME) in psychiatry. The authors aimed to validate a method to assess psychiatry CME teaching effectiveness and to determine associations between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Methods: This cross-sectional study was conducted at the Mayo Clinic Psychiatry Clinical Reviews and Psychiatry in Medical Settings. Presentations were evaluated using an eight-item CME teaching effectiveness instrument, its content based on previously published instruments. Factor analysis, internal consistency and interrater reliabilities, and temporal stability reliability were calculated. Associations were determined between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Results: In total, 364 participants returned 246 completed surveys (response rate, 67.6%). Factor analysis revealed a unidimensional model of psychiatry CME teaching effectiveness. Cronbach α for the instrument was excellent at 0.94. Item mean score (SD) ranged from 4.33 (0.92) to 4.71 (0.59) on a 5-point scale. Overall interrater reliability was 0.84 (95% CI, 0.75–0.91), and temporal stability was 0.89 (95% CI, 0.77–0.97). No associations were found between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Conclusions: This study provides a new, validated measure of CME teaching effectiveness that could be used to improve psychiatry CME. In contrast to prior research in other medical specialties, CME teaching effectiveness scores were not associated with use of case-based or interactive presentations. This outcome suggests the need for distinctive considerations regarding psychiatry CME; a singular approach to CME teaching may not apply to all medical specialties.

Original languageEnglish (US)
Pages (from-to)458-463
Number of pages6
JournalAcademic Psychiatry
Volume42
Issue number4
DOIs
StatePublished - Aug 1 2018

Keywords

  • Continuing medical education
  • Continuous professional development
  • Medical education
  • Validation study

ASJC Scopus subject areas

  • Education
  • Psychiatry and Mental health

Fingerprint Dive into the research topics of 'Validation of a Teaching Effectiveness Assessment in Psychiatry Continuing Medical Education'. Together they form a unique fingerprint.

  • Cite this

    Palmer, B. A., Frye, M. A., Vickers Douglas, K. S., Staab, J. P., Bright, R. P., Schleck, C. D., Mandrekar, J. N., Mahapatra, S., Beckman, T. J., & Wittich, C. M. (2018). Validation of a Teaching Effectiveness Assessment in Psychiatry Continuing Medical Education. Academic Psychiatry, 42(4), 458-463. https://doi.org/10.1007/s40596-017-0763-8