TY - JOUR
T1 - Test Assembly Implications for Providing Reliable and Valid Subscores
AU - Lee, Minji K.
AU - Sweeney, Kevin
AU - Melican, Gerald J.
N1 - Publisher Copyright:
© 2017 Taylor & Francis.
PY - 2017/10/2
Y1 - 2017/10/2
N2 - This study investigates the relationships among factor correlations, inter-item correlations, and the reliability estimates of subscores, providing a guideline with respect to psychometric properties of useful subscores. In addition, it compares subscore estimation methods with respect to reliability and distinctness. The subscore estimation methods explored in the current study include augmentation based on classical test theory and multidimensional item response theory (MIRT). The study shows that there is no estimation method that is optimal according to both criteria. Augmented subscores show the most improvement in reliability compared to observed subscores but are the least distinct.
AB - This study investigates the relationships among factor correlations, inter-item correlations, and the reliability estimates of subscores, providing a guideline with respect to psychometric properties of useful subscores. In addition, it compares subscore estimation methods with respect to reliability and distinctness. The subscore estimation methods explored in the current study include augmentation based on classical test theory and multidimensional item response theory (MIRT). The study shows that there is no estimation method that is optimal according to both criteria. Augmented subscores show the most improvement in reliability compared to observed subscores but are the least distinct.
UR - http://www.scopus.com/inward/record.url?scp=85031098837&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85031098837&partnerID=8YFLogxK
U2 - 10.1080/10627197.2017.1381552
DO - 10.1080/10627197.2017.1381552
M3 - Article
AN - SCOPUS:85031098837
SN - 1062-7197
VL - 22
SP - 205
EP - 219
JO - Educational Assessment
JF - Educational Assessment
IS - 4
ER -