Measuring faculty reflection on adverse patient events: Development and initial validation of a case-based learning system

Christopher M. Wittich, Francisco Lopez-Jimenez, Lindsay K. Decker, Jason H. Szostek, Jayawant N. Mandrekar, Timothy I. Morgenthaler, Thomas J. Beckman

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

Background: Critical reflection by faculty physicians on adverse patient events is important for changing physician's behaviors. However, there is little research regarding physician reflection on quality improvement (QI). OBJECTIVE: To develop and validate a computerized case-based learning system (CBLS) to measure faculty physicians' reflections on adverse patient events. DESIGN: Prospective validation study. PARTICIPANTS: Staff physicians in the Department of Medicine at Mayo Clinic Rochester. MAIN MEASURES: The CBLS was developed by Mayo Clinic information technology, medical education, and QI specialists. The reflection questionnaire, adapted from a previously validated instrument, contained eight items structured on five-point scales. Three cases, representing actual adverse events, were developed based on the most common error types: systems, medication, and diagnostic. In 2009, all Mayo Clinic hospital medicine, non-interventional cardiology, and pulmonary faculty were invited to participate. Faculty reviewed each case, determined the next management step, rated case generalizability and relevance, and completed the reflection questionnaire. Factor analysis and internal consistency reliability were calculated. Associations between reflection scores and characteristics of faculty and patient cases were determined. KEY RESULTS: Forty-four faculty completed 107 case reflections. The CBLS was rated as average to excellent in 95 of 104 (91.3%) completed satisfaction surveys. Factor analysis revealed two levels of reflection: Minimal and High. Internal consistency reliability was very good (overall Cronbach's α = 0.77). Item mean scores ranged from 2.89 to 3.73 on a five-point scale. The overall reflection score was 3.41 (standard deviation 0.64). Reflection scores were positively associated with case generalizability (p = 0.001), and case relevance (p = 0.02). CONCLUSIONS: The CBLS is a valid method for stratifying faculty physicians' levels of reflection on adverse patient events. Reflection scores are associated with case generalizability and relevance, indicating that reflection improves with pertinent patient encounters. We anticipate that this instrument will be useful in future research on QI among low versus high-reflecting physicians.

Original languageEnglish (US)
Pages (from-to)293-298
Number of pages6
JournalJournal of general internal medicine
Volume26
Issue number3
DOIs
StatePublished - Mar 2011

Keywords

  • adverse events
  • assessment
  • medical education
  • quality improvement
  • reflection
  • validation study

ASJC Scopus subject areas

  • Internal Medicine

Fingerprint

Dive into the research topics of 'Measuring faculty reflection on adverse patient events: Development and initial validation of a case-based learning system'. Together they form a unique fingerprint.

Cite this