The American Board of Anesthesiology's Standardized Oral Examination for Initial Board Certification

Huaping Sun, David O. Warner, Andrew J. Patterson, Ann E. Harman, James P. Rathmell, Mark T. Keegan, Rupa J. Dainer, Thomas M. McLoughlin, Brenda G. Fahy, Alex Macario

Research output: Contribution to journalArticle

Abstract

The American Board of Anesthesiology (ABA) has been administering an oral examination as part of its initial certification process since 1939. Among the 24 member boards of the American Board of Medical Specialties, 13 other boards also require passing an oral examination for physicians to become certified in their specialties. However, the methods used to develop, administer, and score these examinations have not been published. The purpose of this report is to describe the history and evolution of the anesthesiology Standardized Oral Examination, its current examination development and administration, the psychometric model and scoring, physician examiner training and auditing, and validity evidence. The many-facet Rasch model is the analytic method used to convert examiner ratings into scaled scores for candidates and takes into account how difficult grader examiners are and the difficulty of the examination tasks. Validity evidence of the oral examination includes that it measures aspects of clinical performance not accounted for by written certifying examinations, and that passing the oral examination is associated with a decreased risk of subsequent license actions against the anesthesiologist. Explaining the details of the Standardized Oral Examination provides transparency about this component of initial certification in anesthesiology.

Original languageEnglish (US)
Pages (from-to)1394-1400
Number of pages7
JournalAnesthesia and analgesia
Volume129
Issue number5
DOIs
StatePublished - Nov 1 2019

Fingerprint

Oral Diagnosis
Anesthesiology
Certification
Physicians
Licensure
Psychometrics
History
Medicine

ASJC Scopus subject areas

  • Anesthesiology and Pain Medicine

Cite this

The American Board of Anesthesiology's Standardized Oral Examination for Initial Board Certification. / Sun, Huaping; Warner, David O.; Patterson, Andrew J.; Harman, Ann E.; Rathmell, James P.; Keegan, Mark T.; Dainer, Rupa J.; McLoughlin, Thomas M.; Fahy, Brenda G.; Macario, Alex.

In: Anesthesia and analgesia, Vol. 129, No. 5, 01.11.2019, p. 1394-1400.

Research output: Contribution to journalArticle

Sun, H, Warner, DO, Patterson, AJ, Harman, AE, Rathmell, JP, Keegan, MT, Dainer, RJ, McLoughlin, TM, Fahy, BG & Macario, A 2019, 'The American Board of Anesthesiology's Standardized Oral Examination for Initial Board Certification', Anesthesia and analgesia, vol. 129, no. 5, pp. 1394-1400. https://doi.org/10.1213/ANE.0000000000004263
Sun, Huaping ; Warner, David O. ; Patterson, Andrew J. ; Harman, Ann E. ; Rathmell, James P. ; Keegan, Mark T. ; Dainer, Rupa J. ; McLoughlin, Thomas M. ; Fahy, Brenda G. ; Macario, Alex. / The American Board of Anesthesiology's Standardized Oral Examination for Initial Board Certification. In: Anesthesia and analgesia. 2019 ; Vol. 129, No. 5. pp. 1394-1400.
@article{031b14d93cc64b0ea08c1191883371f5,
title = "The American Board of Anesthesiology's Standardized Oral Examination for Initial Board Certification",
abstract = "The American Board of Anesthesiology (ABA) has been administering an oral examination as part of its initial certification process since 1939. Among the 24 member boards of the American Board of Medical Specialties, 13 other boards also require passing an oral examination for physicians to become certified in their specialties. However, the methods used to develop, administer, and score these examinations have not been published. The purpose of this report is to describe the history and evolution of the anesthesiology Standardized Oral Examination, its current examination development and administration, the psychometric model and scoring, physician examiner training and auditing, and validity evidence. The many-facet Rasch model is the analytic method used to convert examiner ratings into scaled scores for candidates and takes into account how difficult grader examiners are and the difficulty of the examination tasks. Validity evidence of the oral examination includes that it measures aspects of clinical performance not accounted for by written certifying examinations, and that passing the oral examination is associated with a decreased risk of subsequent license actions against the anesthesiologist. Explaining the details of the Standardized Oral Examination provides transparency about this component of initial certification in anesthesiology.",
author = "Huaping Sun and Warner, {David O.} and Patterson, {Andrew J.} and Harman, {Ann E.} and Rathmell, {James P.} and Keegan, {Mark T.} and Dainer, {Rupa J.} and McLoughlin, {Thomas M.} and Fahy, {Brenda G.} and Alex Macario",
year = "2019",
month = "11",
day = "1",
doi = "10.1213/ANE.0000000000004263",
language = "English (US)",
volume = "129",
pages = "1394--1400",
journal = "Anesthesia and Analgesia",
issn = "0003-2999",
publisher = "Lippincott Williams and Wilkins",
number = "5",

}

TY - JOUR

T1 - The American Board of Anesthesiology's Standardized Oral Examination for Initial Board Certification

AU - Sun, Huaping

AU - Warner, David O.

AU - Patterson, Andrew J.

AU - Harman, Ann E.

AU - Rathmell, James P.

AU - Keegan, Mark T.

AU - Dainer, Rupa J.

AU - McLoughlin, Thomas M.

AU - Fahy, Brenda G.

AU - Macario, Alex

PY - 2019/11/1

Y1 - 2019/11/1

N2 - The American Board of Anesthesiology (ABA) has been administering an oral examination as part of its initial certification process since 1939. Among the 24 member boards of the American Board of Medical Specialties, 13 other boards also require passing an oral examination for physicians to become certified in their specialties. However, the methods used to develop, administer, and score these examinations have not been published. The purpose of this report is to describe the history and evolution of the anesthesiology Standardized Oral Examination, its current examination development and administration, the psychometric model and scoring, physician examiner training and auditing, and validity evidence. The many-facet Rasch model is the analytic method used to convert examiner ratings into scaled scores for candidates and takes into account how difficult grader examiners are and the difficulty of the examination tasks. Validity evidence of the oral examination includes that it measures aspects of clinical performance not accounted for by written certifying examinations, and that passing the oral examination is associated with a decreased risk of subsequent license actions against the anesthesiologist. Explaining the details of the Standardized Oral Examination provides transparency about this component of initial certification in anesthesiology.

AB - The American Board of Anesthesiology (ABA) has been administering an oral examination as part of its initial certification process since 1939. Among the 24 member boards of the American Board of Medical Specialties, 13 other boards also require passing an oral examination for physicians to become certified in their specialties. However, the methods used to develop, administer, and score these examinations have not been published. The purpose of this report is to describe the history and evolution of the anesthesiology Standardized Oral Examination, its current examination development and administration, the psychometric model and scoring, physician examiner training and auditing, and validity evidence. The many-facet Rasch model is the analytic method used to convert examiner ratings into scaled scores for candidates and takes into account how difficult grader examiners are and the difficulty of the examination tasks. Validity evidence of the oral examination includes that it measures aspects of clinical performance not accounted for by written certifying examinations, and that passing the oral examination is associated with a decreased risk of subsequent license actions against the anesthesiologist. Explaining the details of the Standardized Oral Examination provides transparency about this component of initial certification in anesthesiology.

UR - http://www.scopus.com/inward/record.url?scp=85073314698&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073314698&partnerID=8YFLogxK

U2 - 10.1213/ANE.0000000000004263

DO - 10.1213/ANE.0000000000004263

M3 - Article

C2 - 31219924

AN - SCOPUS:85073314698

VL - 129

SP - 1394

EP - 1400

JO - Anesthesia and Analgesia

JF - Anesthesia and Analgesia

SN - 0003-2999

IS - 5

ER -