TY - JOUR
T1 - Validation of a Teaching Effectiveness Assessment in Psychiatry Continuing Medical Education
AU - Palmer, Brian A.
AU - Frye, Mark A.
AU - Vickers Douglas, Kristin S.
AU - Staab, Jeffrey P.
AU - Bright, Robert P.
AU - Schleck, Cathy D.
AU - Mandrekar, Jayawant N.
AU - Mahapatra, Saswati
AU - Beckman, Thomas J.
AU - Wittich, Christopher M.
N1 - Publisher Copyright:
© 2017, Academic Psychiatry.
PY - 2018/8/1
Y1 - 2018/8/1
N2 - Objective: Little is known about factors associated with effective continuing medical education (CME) in psychiatry. The authors aimed to validate a method to assess psychiatry CME teaching effectiveness and to determine associations between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Methods: This cross-sectional study was conducted at the Mayo Clinic Psychiatry Clinical Reviews and Psychiatry in Medical Settings. Presentations were evaluated using an eight-item CME teaching effectiveness instrument, its content based on previously published instruments. Factor analysis, internal consistency and interrater reliabilities, and temporal stability reliability were calculated. Associations were determined between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Results: In total, 364 participants returned 246 completed surveys (response rate, 67.6%). Factor analysis revealed a unidimensional model of psychiatry CME teaching effectiveness. Cronbach α for the instrument was excellent at 0.94. Item mean score (SD) ranged from 4.33 (0.92) to 4.71 (0.59) on a 5-point scale. Overall interrater reliability was 0.84 (95% CI, 0.75–0.91), and temporal stability was 0.89 (95% CI, 0.77–0.97). No associations were found between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Conclusions: This study provides a new, validated measure of CME teaching effectiveness that could be used to improve psychiatry CME. In contrast to prior research in other medical specialties, CME teaching effectiveness scores were not associated with use of case-based or interactive presentations. This outcome suggests the need for distinctive considerations regarding psychiatry CME; a singular approach to CME teaching may not apply to all medical specialties.
AB - Objective: Little is known about factors associated with effective continuing medical education (CME) in psychiatry. The authors aimed to validate a method to assess psychiatry CME teaching effectiveness and to determine associations between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Methods: This cross-sectional study was conducted at the Mayo Clinic Psychiatry Clinical Reviews and Psychiatry in Medical Settings. Presentations were evaluated using an eight-item CME teaching effectiveness instrument, its content based on previously published instruments. Factor analysis, internal consistency and interrater reliabilities, and temporal stability reliability were calculated. Associations were determined between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Results: In total, 364 participants returned 246 completed surveys (response rate, 67.6%). Factor analysis revealed a unidimensional model of psychiatry CME teaching effectiveness. Cronbach α for the instrument was excellent at 0.94. Item mean score (SD) ranged from 4.33 (0.92) to 4.71 (0.59) on a 5-point scale. Overall interrater reliability was 0.84 (95% CI, 0.75–0.91), and temporal stability was 0.89 (95% CI, 0.77–0.97). No associations were found between teaching effectiveness scores and characteristics of presentations, presenters, and participants. Conclusions: This study provides a new, validated measure of CME teaching effectiveness that could be used to improve psychiatry CME. In contrast to prior research in other medical specialties, CME teaching effectiveness scores were not associated with use of case-based or interactive presentations. This outcome suggests the need for distinctive considerations regarding psychiatry CME; a singular approach to CME teaching may not apply to all medical specialties.
KW - Continuing medical education
KW - Continuous professional development
KW - Medical education
KW - Validation study
UR - http://www.scopus.com/inward/record.url?scp=85051114216&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85051114216&partnerID=8YFLogxK
U2 - 10.1007/s40596-017-0763-8
DO - 10.1007/s40596-017-0763-8
M3 - Article
C2 - 28685348
AN - SCOPUS:85051114216
SN - 1042-9670
VL - 42
SP - 458
EP - 463
JO - Academic Psychiatry
JF - Academic Psychiatry
IS - 4
ER -