Measuring faculty reflection on medical grand rounds at mayo clinic: Associations with teaching experience, clinical exposure, and presenter effectiveness

Christopher M. Wittich, Jason H. Szostek, Darcy A. Reed, Jeanine L. Kiefer, Paul Mueller, Jayawant Mandrekar, Thomas J. Beckman

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Objectives: To develop and validate a new instrument for measuring participant reflection on continuing medical education (CME) and determine associations between the reflection instrument scores and CME presenter, participant, and presentation characteristics. Participants and Methods: This was a prospective validation study of presenters and faculty at the weekly medical grand rounds at Mayo Clinic in Rochester, Minnesota, from January 1, 2011, through June 30, 2011. Eight items (5-point Likert scales) were developed on the basis of 4 reflection levels: habitual action, understanding, reflection, and critical reflection. Factor analysis was performed to account for clustered data. Interrater and internal consistency reliabilities were calculated. Associations between reflection scores and characteristics of presenters, participants, and presentations were determined. Results: Participants completed a total of 1134 reflection forms. Factor analysis revealed a 2-dimensional model (eigenvalue; Cronbach α): minimal reflection (1.19; 0.77) and high reflection (2.51; 0.81). Item mean (SD) scores ranged from 2.97 (1.17) to 4.01 (0.83) on a 5-point scale. Interrater reliability (intraclass correlation coefficient) for individual items ranged from 0.58 (95% CI, 0.31-0.78) to 0.88 (95% CI, 0.80-0.94). Reflection scores were associated with presenters' speaking effectiveness (P<.001) and prior CME teaching experience (P=.02), participants' prior clinical experiences (P<.001), and presentations that were case based (P<.001) and used the audience response system (P<.001). Conclusion: We report the first validated measure of reflection on CME at medical grand rounds. Reflection scores were associated with presenters' effectiveness and prior teaching experience, participants' clinical exposures, and presentations that were interactive and clinically relevant. Future research should determine whether reflection on CME leads to better patient outcomes.

Original languageEnglish (US)
Pages (from-to)277-284
Number of pages8
JournalMayo Clinic Proceedings
Volume88
Issue number3
DOIs
StatePublished - 2013

Fingerprint

Teaching Rounds
Continuing Medical Education
Teaching
Statistical Factor Analysis
Validation Studies
Prospective Studies

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Measuring faculty reflection on medical grand rounds at mayo clinic : Associations with teaching experience, clinical exposure, and presenter effectiveness. / Wittich, Christopher M.; Szostek, Jason H.; Reed, Darcy A.; Kiefer, Jeanine L.; Mueller, Paul; Mandrekar, Jayawant; Beckman, Thomas J.

In: Mayo Clinic Proceedings, Vol. 88, No. 3, 2013, p. 277-284.

Research output: Contribution to journalArticle

Wittich, Christopher M. ; Szostek, Jason H. ; Reed, Darcy A. ; Kiefer, Jeanine L. ; Mueller, Paul ; Mandrekar, Jayawant ; Beckman, Thomas J. / Measuring faculty reflection on medical grand rounds at mayo clinic : Associations with teaching experience, clinical exposure, and presenter effectiveness. In: Mayo Clinic Proceedings. 2013 ; Vol. 88, No. 3. pp. 277-284.
@article{b5d0b97429e84c7e9cc81d0a8d8c208b,
title = "Measuring faculty reflection on medical grand rounds at mayo clinic: Associations with teaching experience, clinical exposure, and presenter effectiveness",
abstract = "Objectives: To develop and validate a new instrument for measuring participant reflection on continuing medical education (CME) and determine associations between the reflection instrument scores and CME presenter, participant, and presentation characteristics. Participants and Methods: This was a prospective validation study of presenters and faculty at the weekly medical grand rounds at Mayo Clinic in Rochester, Minnesota, from January 1, 2011, through June 30, 2011. Eight items (5-point Likert scales) were developed on the basis of 4 reflection levels: habitual action, understanding, reflection, and critical reflection. Factor analysis was performed to account for clustered data. Interrater and internal consistency reliabilities were calculated. Associations between reflection scores and characteristics of presenters, participants, and presentations were determined. Results: Participants completed a total of 1134 reflection forms. Factor analysis revealed a 2-dimensional model (eigenvalue; Cronbach α): minimal reflection (1.19; 0.77) and high reflection (2.51; 0.81). Item mean (SD) scores ranged from 2.97 (1.17) to 4.01 (0.83) on a 5-point scale. Interrater reliability (intraclass correlation coefficient) for individual items ranged from 0.58 (95{\%} CI, 0.31-0.78) to 0.88 (95{\%} CI, 0.80-0.94). Reflection scores were associated with presenters' speaking effectiveness (P<.001) and prior CME teaching experience (P=.02), participants' prior clinical experiences (P<.001), and presentations that were case based (P<.001) and used the audience response system (P<.001). Conclusion: We report the first validated measure of reflection on CME at medical grand rounds. Reflection scores were associated with presenters' effectiveness and prior teaching experience, participants' clinical exposures, and presentations that were interactive and clinically relevant. Future research should determine whether reflection on CME leads to better patient outcomes.",
author = "Wittich, {Christopher M.} and Szostek, {Jason H.} and Reed, {Darcy A.} and Kiefer, {Jeanine L.} and Paul Mueller and Jayawant Mandrekar and Beckman, {Thomas J.}",
year = "2013",
doi = "10.1016/j.mayocp.2012.11.014",
language = "English (US)",
volume = "88",
pages = "277--284",
journal = "Mayo Clinic Proceedings",
issn = "0025-6196",
publisher = "Elsevier Science",
number = "3",

}

TY - JOUR

T1 - Measuring faculty reflection on medical grand rounds at mayo clinic

T2 - Associations with teaching experience, clinical exposure, and presenter effectiveness

AU - Wittich, Christopher M.

AU - Szostek, Jason H.

AU - Reed, Darcy A.

AU - Kiefer, Jeanine L.

AU - Mueller, Paul

AU - Mandrekar, Jayawant

AU - Beckman, Thomas J.

PY - 2013

Y1 - 2013

N2 - Objectives: To develop and validate a new instrument for measuring participant reflection on continuing medical education (CME) and determine associations between the reflection instrument scores and CME presenter, participant, and presentation characteristics. Participants and Methods: This was a prospective validation study of presenters and faculty at the weekly medical grand rounds at Mayo Clinic in Rochester, Minnesota, from January 1, 2011, through June 30, 2011. Eight items (5-point Likert scales) were developed on the basis of 4 reflection levels: habitual action, understanding, reflection, and critical reflection. Factor analysis was performed to account for clustered data. Interrater and internal consistency reliabilities were calculated. Associations between reflection scores and characteristics of presenters, participants, and presentations were determined. Results: Participants completed a total of 1134 reflection forms. Factor analysis revealed a 2-dimensional model (eigenvalue; Cronbach α): minimal reflection (1.19; 0.77) and high reflection (2.51; 0.81). Item mean (SD) scores ranged from 2.97 (1.17) to 4.01 (0.83) on a 5-point scale. Interrater reliability (intraclass correlation coefficient) for individual items ranged from 0.58 (95% CI, 0.31-0.78) to 0.88 (95% CI, 0.80-0.94). Reflection scores were associated with presenters' speaking effectiveness (P<.001) and prior CME teaching experience (P=.02), participants' prior clinical experiences (P<.001), and presentations that were case based (P<.001) and used the audience response system (P<.001). Conclusion: We report the first validated measure of reflection on CME at medical grand rounds. Reflection scores were associated with presenters' effectiveness and prior teaching experience, participants' clinical exposures, and presentations that were interactive and clinically relevant. Future research should determine whether reflection on CME leads to better patient outcomes.

AB - Objectives: To develop and validate a new instrument for measuring participant reflection on continuing medical education (CME) and determine associations between the reflection instrument scores and CME presenter, participant, and presentation characteristics. Participants and Methods: This was a prospective validation study of presenters and faculty at the weekly medical grand rounds at Mayo Clinic in Rochester, Minnesota, from January 1, 2011, through June 30, 2011. Eight items (5-point Likert scales) were developed on the basis of 4 reflection levels: habitual action, understanding, reflection, and critical reflection. Factor analysis was performed to account for clustered data. Interrater and internal consistency reliabilities were calculated. Associations between reflection scores and characteristics of presenters, participants, and presentations were determined. Results: Participants completed a total of 1134 reflection forms. Factor analysis revealed a 2-dimensional model (eigenvalue; Cronbach α): minimal reflection (1.19; 0.77) and high reflection (2.51; 0.81). Item mean (SD) scores ranged from 2.97 (1.17) to 4.01 (0.83) on a 5-point scale. Interrater reliability (intraclass correlation coefficient) for individual items ranged from 0.58 (95% CI, 0.31-0.78) to 0.88 (95% CI, 0.80-0.94). Reflection scores were associated with presenters' speaking effectiveness (P<.001) and prior CME teaching experience (P=.02), participants' prior clinical experiences (P<.001), and presentations that were case based (P<.001) and used the audience response system (P<.001). Conclusion: We report the first validated measure of reflection on CME at medical grand rounds. Reflection scores were associated with presenters' effectiveness and prior teaching experience, participants' clinical exposures, and presentations that were interactive and clinically relevant. Future research should determine whether reflection on CME leads to better patient outcomes.

UR - http://www.scopus.com/inward/record.url?scp=84876519023&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876519023&partnerID=8YFLogxK

U2 - 10.1016/j.mayocp.2012.11.014

DO - 10.1016/j.mayocp.2012.11.014

M3 - Article

C2 - 23489452

AN - SCOPUS:84876519023

VL - 88

SP - 277

EP - 284

JO - Mayo Clinic Proceedings

JF - Mayo Clinic Proceedings

SN - 0025-6196

IS - 3

ER -