Making the case for mastery learning assessments: Key issues in validation and justification

Matthew Lineberry, Yoon Soo Park, David Allan Cook, Rachel Yudkowsky

Research output: Contribution to journalArticle

17 Citations (Scopus)

Abstract

Theoretical and empirical support is increasing for mastery learning, in which learners must demonstrate a minimum level of proficiency before completing a given educational unit. Mastery learning approaches aim for uniform achievement of key objectives by allowing learning time to vary and as such are a course-level analogue to broader competency-based curricular strategies. Sound assessment is the cornerstone of mastery learning systems, yet the nature of assessment validity and justification for mastery learning differs in important ways from standard assessment models. Specific validity issues include (1) the need for careful definition of what is meant by "mastery" in terms of learners' achievement or readiness to proceed, the expected retention of mastery over time, and the completeness of content mastery required in a particular unit; (2) validity threats associated with increased retesting; (3) the need for reliability estimates that account for the specific measurement error at the mastery versus nonmastery cut score; and (4) changes in item- and test-level score variance over retesting, which complicate the analysis of evidence related to reliability, internal structure, and relationships to other variables. The positive and negative consequences for learners, educational systems, and patients resulting from the use of mastery learning assessments must be explored to determine whether a given mastery assessment and pass/fail cut score are valid and justified. In this article, the authors outline key considerations for the validation and justification of mastery learning assessments, with the goal of supporting insightful research and sound practice as the mastery model becomes more widespread.

Original languageEnglish (US)
Pages (from-to)1445-1450
Number of pages6
JournalAcademic Medicine
Volume90
Issue number11
DOIs
StatePublished - Nov 1 2015

Fingerprint

Learning
learning
educational system
threat
Research
evidence
time

ASJC Scopus subject areas

  • Medicine(all)
  • Education

Cite this

Making the case for mastery learning assessments : Key issues in validation and justification. / Lineberry, Matthew; Soo Park, Yoon; Cook, David Allan; Yudkowsky, Rachel.

In: Academic Medicine, Vol. 90, No. 11, 01.11.2015, p. 1445-1450.

Research output: Contribution to journalArticle

Lineberry, Matthew ; Soo Park, Yoon ; Cook, David Allan ; Yudkowsky, Rachel. / Making the case for mastery learning assessments : Key issues in validation and justification. In: Academic Medicine. 2015 ; Vol. 90, No. 11. pp. 1445-1450.
@article{11bce9fb25e3405795dae24a38f18226,
title = "Making the case for mastery learning assessments: Key issues in validation and justification",
abstract = "Theoretical and empirical support is increasing for mastery learning, in which learners must demonstrate a minimum level of proficiency before completing a given educational unit. Mastery learning approaches aim for uniform achievement of key objectives by allowing learning time to vary and as such are a course-level analogue to broader competency-based curricular strategies. Sound assessment is the cornerstone of mastery learning systems, yet the nature of assessment validity and justification for mastery learning differs in important ways from standard assessment models. Specific validity issues include (1) the need for careful definition of what is meant by {"}mastery{"} in terms of learners' achievement or readiness to proceed, the expected retention of mastery over time, and the completeness of content mastery required in a particular unit; (2) validity threats associated with increased retesting; (3) the need for reliability estimates that account for the specific measurement error at the mastery versus nonmastery cut score; and (4) changes in item- and test-level score variance over retesting, which complicate the analysis of evidence related to reliability, internal structure, and relationships to other variables. The positive and negative consequences for learners, educational systems, and patients resulting from the use of mastery learning assessments must be explored to determine whether a given mastery assessment and pass/fail cut score are valid and justified. In this article, the authors outline key considerations for the validation and justification of mastery learning assessments, with the goal of supporting insightful research and sound practice as the mastery model becomes more widespread.",
author = "Matthew Lineberry and {Soo Park}, Yoon and Cook, {David Allan} and Rachel Yudkowsky",
year = "2015",
month = "11",
day = "1",
doi = "10.1097/ACM.0000000000000860",
language = "English (US)",
volume = "90",
pages = "1445--1450",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "11",

}

TY - JOUR

T1 - Making the case for mastery learning assessments

T2 - Key issues in validation and justification

AU - Lineberry, Matthew

AU - Soo Park, Yoon

AU - Cook, David Allan

AU - Yudkowsky, Rachel

PY - 2015/11/1

Y1 - 2015/11/1

N2 - Theoretical and empirical support is increasing for mastery learning, in which learners must demonstrate a minimum level of proficiency before completing a given educational unit. Mastery learning approaches aim for uniform achievement of key objectives by allowing learning time to vary and as such are a course-level analogue to broader competency-based curricular strategies. Sound assessment is the cornerstone of mastery learning systems, yet the nature of assessment validity and justification for mastery learning differs in important ways from standard assessment models. Specific validity issues include (1) the need for careful definition of what is meant by "mastery" in terms of learners' achievement or readiness to proceed, the expected retention of mastery over time, and the completeness of content mastery required in a particular unit; (2) validity threats associated with increased retesting; (3) the need for reliability estimates that account for the specific measurement error at the mastery versus nonmastery cut score; and (4) changes in item- and test-level score variance over retesting, which complicate the analysis of evidence related to reliability, internal structure, and relationships to other variables. The positive and negative consequences for learners, educational systems, and patients resulting from the use of mastery learning assessments must be explored to determine whether a given mastery assessment and pass/fail cut score are valid and justified. In this article, the authors outline key considerations for the validation and justification of mastery learning assessments, with the goal of supporting insightful research and sound practice as the mastery model becomes more widespread.

AB - Theoretical and empirical support is increasing for mastery learning, in which learners must demonstrate a minimum level of proficiency before completing a given educational unit. Mastery learning approaches aim for uniform achievement of key objectives by allowing learning time to vary and as such are a course-level analogue to broader competency-based curricular strategies. Sound assessment is the cornerstone of mastery learning systems, yet the nature of assessment validity and justification for mastery learning differs in important ways from standard assessment models. Specific validity issues include (1) the need for careful definition of what is meant by "mastery" in terms of learners' achievement or readiness to proceed, the expected retention of mastery over time, and the completeness of content mastery required in a particular unit; (2) validity threats associated with increased retesting; (3) the need for reliability estimates that account for the specific measurement error at the mastery versus nonmastery cut score; and (4) changes in item- and test-level score variance over retesting, which complicate the analysis of evidence related to reliability, internal structure, and relationships to other variables. The positive and negative consequences for learners, educational systems, and patients resulting from the use of mastery learning assessments must be explored to determine whether a given mastery assessment and pass/fail cut score are valid and justified. In this article, the authors outline key considerations for the validation and justification of mastery learning assessments, with the goal of supporting insightful research and sound practice as the mastery model becomes more widespread.

UR - http://www.scopus.com/inward/record.url?scp=84945366802&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84945366802&partnerID=8YFLogxK

U2 - 10.1097/ACM.0000000000000860

DO - 10.1097/ACM.0000000000000860

M3 - Article

C2 - 26287919

AN - SCOPUS:84945366802

VL - 90

SP - 1445

EP - 1450

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 11

ER -