Current concepts in validity and reliability for psychometric instruments: Theory and application

David Allan Cook, Thomas J. Beckman

Research output: Contribution to journalArticle

543 Citations (Scopus)

Abstract

Validity and reliability relate to the interpretation of scores from psychometric instruments (eg, symptom scales, questionnaires, education tests, and observer ratings) used in clinical practice, research, education, and administration. Emerging paradigms replace prior distinctions of face, content, and criterion validity with the unitary concept "construct validity," the degree to which a score can be interpreted as representing the intended underlying construct. Evidence to support the validity argument is collected from 5 sources: • Content: do instrument items completely represent the construct? • Response process: the relationship between the intended construct and the thought processes of subjects or observers • Internal structure: acceptable reliability and factor structure • Relations to other variables: correlation with scores from another instrument assessing the same construct • Consequences: do scores really make a difference? Evidence should be sought from a variety of sources to support a given interpretation. Reliable scores are necessary, but not sufficient, for valid interpretation. Increased attention to the systematic collection of validity evidence for scores from psychometric instruments will improve assessments in research, patient care, and education.

Original languageEnglish (US)
JournalAmerican Journal of Medicine
Volume119
Issue number2
DOIs
StatePublished - Feb 2006

Fingerprint

Psychometrics
Reproducibility of Results
Education
Patient Education
Research
Patient Care
Surveys and Questionnaires

Keywords

  • Construct validity
  • Educational measurement
  • Medical education
  • Quality of life
  • Questionnaire
  • Reproducibility of results

ASJC Scopus subject areas

  • Nursing(all)

Cite this

Current concepts in validity and reliability for psychometric instruments : Theory and application. / Cook, David Allan; Beckman, Thomas J.

In: American Journal of Medicine, Vol. 119, No. 2, 02.2006.

Research output: Contribution to journalArticle

@article{38c66db436e94bcfafc00b91a3ea2e5a,
title = "Current concepts in validity and reliability for psychometric instruments: Theory and application",
abstract = "Validity and reliability relate to the interpretation of scores from psychometric instruments (eg, symptom scales, questionnaires, education tests, and observer ratings) used in clinical practice, research, education, and administration. Emerging paradigms replace prior distinctions of face, content, and criterion validity with the unitary concept {"}construct validity,{"} the degree to which a score can be interpreted as representing the intended underlying construct. Evidence to support the validity argument is collected from 5 sources: • Content: do instrument items completely represent the construct? • Response process: the relationship between the intended construct and the thought processes of subjects or observers • Internal structure: acceptable reliability and factor structure • Relations to other variables: correlation with scores from another instrument assessing the same construct • Consequences: do scores really make a difference? Evidence should be sought from a variety of sources to support a given interpretation. Reliable scores are necessary, but not sufficient, for valid interpretation. Increased attention to the systematic collection of validity evidence for scores from psychometric instruments will improve assessments in research, patient care, and education.",
keywords = "Construct validity, Educational measurement, Medical education, Quality of life, Questionnaire, Reproducibility of results",
author = "Cook, {David Allan} and Beckman, {Thomas J.}",
year = "2006",
month = "2",
doi = "10.1016/j.amjmed.2005.10.036",
language = "English (US)",
volume = "119",
journal = "American Journal of Medicine",
issn = "0002-9343",
publisher = "Elsevier Inc.",
number = "2",

}

TY - JOUR

T1 - Current concepts in validity and reliability for psychometric instruments

T2 - Theory and application

AU - Cook, David Allan

AU - Beckman, Thomas J.

PY - 2006/2

Y1 - 2006/2

N2 - Validity and reliability relate to the interpretation of scores from psychometric instruments (eg, symptom scales, questionnaires, education tests, and observer ratings) used in clinical practice, research, education, and administration. Emerging paradigms replace prior distinctions of face, content, and criterion validity with the unitary concept "construct validity," the degree to which a score can be interpreted as representing the intended underlying construct. Evidence to support the validity argument is collected from 5 sources: • Content: do instrument items completely represent the construct? • Response process: the relationship between the intended construct and the thought processes of subjects or observers • Internal structure: acceptable reliability and factor structure • Relations to other variables: correlation with scores from another instrument assessing the same construct • Consequences: do scores really make a difference? Evidence should be sought from a variety of sources to support a given interpretation. Reliable scores are necessary, but not sufficient, for valid interpretation. Increased attention to the systematic collection of validity evidence for scores from psychometric instruments will improve assessments in research, patient care, and education.

AB - Validity and reliability relate to the interpretation of scores from psychometric instruments (eg, symptom scales, questionnaires, education tests, and observer ratings) used in clinical practice, research, education, and administration. Emerging paradigms replace prior distinctions of face, content, and criterion validity with the unitary concept "construct validity," the degree to which a score can be interpreted as representing the intended underlying construct. Evidence to support the validity argument is collected from 5 sources: • Content: do instrument items completely represent the construct? • Response process: the relationship between the intended construct and the thought processes of subjects or observers • Internal structure: acceptable reliability and factor structure • Relations to other variables: correlation with scores from another instrument assessing the same construct • Consequences: do scores really make a difference? Evidence should be sought from a variety of sources to support a given interpretation. Reliable scores are necessary, but not sufficient, for valid interpretation. Increased attention to the systematic collection of validity evidence for scores from psychometric instruments will improve assessments in research, patient care, and education.

KW - Construct validity

KW - Educational measurement

KW - Medical education

KW - Quality of life

KW - Questionnaire

KW - Reproducibility of results

UR - http://www.scopus.com/inward/record.url?scp=31444434169&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=31444434169&partnerID=8YFLogxK

U2 - 10.1016/j.amjmed.2005.10.036

DO - 10.1016/j.amjmed.2005.10.036

M3 - Article

C2 - 16443422

AN - SCOPUS:31444434169

VL - 119

JO - American Journal of Medicine

JF - American Journal of Medicine

SN - 0002-9343

IS - 2

ER -