Online resources for assessment and evaluation

Sheldon Benjamin, Lisa I. Robbins, Simon Kung

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Objective: The Accreditation Council for Graduate Medical Education and the Liaison Committee on Medical Education have mandated the transition from written global evaluation methods to competency-based assessments in resident and medical student training. Assessment of competency requires analysis of performance data from numerous sources. This article reviews characteristics of Web-based evaluation and assessment systems and recommends areas for further development. Method: The authors review functions common to a variety of online evaluation and curriculum management systems with attention to their adaptation for competency documentation and assessment. Details of online global assessments, examination methods, electronic portfolios, procedure/case logs, and survey systems are provided along with a list of Internet resources. Results: Online evaluation and assessment systems not only provide data on trainee competence but can provide valuable feedback on faculty teaching, curriculum quality, and the learning environment. Suggestions for future development, legal ambiguities that could become obstacles, and the need to clarify the responsibility for funding this work are discussed. Web-based performance assessment and evaluation are seen in the larger context of moving toward competency assessment of practicing physicians. Conclusions: Online assessment systems offer advantages over paper systems in allowing robust data analysis, reporting, and flexibility. A national online procedure/case log tracking system would facilitate gathering data that could provide one type of experiential benchmark for determining competency.

Original languageEnglish (US)
Pages (from-to)498-504
Number of pages7
JournalAcademic Psychiatry
Volume30
Issue number6
DOIs
StatePublished - Dec 1 2006

Fingerprint

evaluation
resources
Curriculum
Online Systems
Graduate Medical Education
Benchmarking
Accreditation
Information Storage and Retrieval
Medical Education
Medical Students
Documentation
Internet
examination method
Mental Competency
Teaching
Research Design
curriculum
Learning
performance assessment
Physicians

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Education

Cite this

Online resources for assessment and evaluation. / Benjamin, Sheldon; Robbins, Lisa I.; Kung, Simon.

In: Academic Psychiatry, Vol. 30, No. 6, 01.12.2006, p. 498-504.

Research output: Contribution to journalArticle

Benjamin, S, Robbins, LI & Kung, S 2006, 'Online resources for assessment and evaluation', Academic Psychiatry, vol. 30, no. 6, pp. 498-504. https://doi.org/10.1176/appi.ap.30.6.498
Benjamin, Sheldon ; Robbins, Lisa I. ; Kung, Simon. / Online resources for assessment and evaluation. In: Academic Psychiatry. 2006 ; Vol. 30, No. 6. pp. 498-504.
@article{bf14f8625e2843e7819b06b4e3610392,
title = "Online resources for assessment and evaluation",
abstract = "Objective: The Accreditation Council for Graduate Medical Education and the Liaison Committee on Medical Education have mandated the transition from written global evaluation methods to competency-based assessments in resident and medical student training. Assessment of competency requires analysis of performance data from numerous sources. This article reviews characteristics of Web-based evaluation and assessment systems and recommends areas for further development. Method: The authors review functions common to a variety of online evaluation and curriculum management systems with attention to their adaptation for competency documentation and assessment. Details of online global assessments, examination methods, electronic portfolios, procedure/case logs, and survey systems are provided along with a list of Internet resources. Results: Online evaluation and assessment systems not only provide data on trainee competence but can provide valuable feedback on faculty teaching, curriculum quality, and the learning environment. Suggestions for future development, legal ambiguities that could become obstacles, and the need to clarify the responsibility for funding this work are discussed. Web-based performance assessment and evaluation are seen in the larger context of moving toward competency assessment of practicing physicians. Conclusions: Online assessment systems offer advantages over paper systems in allowing robust data analysis, reporting, and flexibility. A national online procedure/case log tracking system would facilitate gathering data that could provide one type of experiential benchmark for determining competency.",
author = "Sheldon Benjamin and Robbins, {Lisa I.} and Simon Kung",
year = "2006",
month = "12",
day = "1",
doi = "10.1176/appi.ap.30.6.498",
language = "English (US)",
volume = "30",
pages = "498--504",
journal = "Academic Psychiatry",
issn = "1042-9670",
publisher = "American Psychiatric Publishing Inc.",
number = "6",

}

TY - JOUR

T1 - Online resources for assessment and evaluation

AU - Benjamin, Sheldon

AU - Robbins, Lisa I.

AU - Kung, Simon

PY - 2006/12/1

Y1 - 2006/12/1

N2 - Objective: The Accreditation Council for Graduate Medical Education and the Liaison Committee on Medical Education have mandated the transition from written global evaluation methods to competency-based assessments in resident and medical student training. Assessment of competency requires analysis of performance data from numerous sources. This article reviews characteristics of Web-based evaluation and assessment systems and recommends areas for further development. Method: The authors review functions common to a variety of online evaluation and curriculum management systems with attention to their adaptation for competency documentation and assessment. Details of online global assessments, examination methods, electronic portfolios, procedure/case logs, and survey systems are provided along with a list of Internet resources. Results: Online evaluation and assessment systems not only provide data on trainee competence but can provide valuable feedback on faculty teaching, curriculum quality, and the learning environment. Suggestions for future development, legal ambiguities that could become obstacles, and the need to clarify the responsibility for funding this work are discussed. Web-based performance assessment and evaluation are seen in the larger context of moving toward competency assessment of practicing physicians. Conclusions: Online assessment systems offer advantages over paper systems in allowing robust data analysis, reporting, and flexibility. A national online procedure/case log tracking system would facilitate gathering data that could provide one type of experiential benchmark for determining competency.

AB - Objective: The Accreditation Council for Graduate Medical Education and the Liaison Committee on Medical Education have mandated the transition from written global evaluation methods to competency-based assessments in resident and medical student training. Assessment of competency requires analysis of performance data from numerous sources. This article reviews characteristics of Web-based evaluation and assessment systems and recommends areas for further development. Method: The authors review functions common to a variety of online evaluation and curriculum management systems with attention to their adaptation for competency documentation and assessment. Details of online global assessments, examination methods, electronic portfolios, procedure/case logs, and survey systems are provided along with a list of Internet resources. Results: Online evaluation and assessment systems not only provide data on trainee competence but can provide valuable feedback on faculty teaching, curriculum quality, and the learning environment. Suggestions for future development, legal ambiguities that could become obstacles, and the need to clarify the responsibility for funding this work are discussed. Web-based performance assessment and evaluation are seen in the larger context of moving toward competency assessment of practicing physicians. Conclusions: Online assessment systems offer advantages over paper systems in allowing robust data analysis, reporting, and flexibility. A national online procedure/case log tracking system would facilitate gathering data that could provide one type of experiential benchmark for determining competency.

UR - http://www.scopus.com/inward/record.url?scp=39049178336&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=39049178336&partnerID=8YFLogxK

U2 - 10.1176/appi.ap.30.6.498

DO - 10.1176/appi.ap.30.6.498

M3 - Article

VL - 30

SP - 498

EP - 504

JO - Academic Psychiatry

JF - Academic Psychiatry

SN - 1042-9670

IS - 6

ER -