A motor speech assessment for children with severe speech disorders

Reliability and validity evidence

Edythe A. Strand, Rebecca J. McCauley, Stephen D. Weigand, Ruth E. Stoeckel, Becky S. Baas

Research output: Contribution to journalArticle

27 Citations (Scopus)

Abstract

Purpose: In this article, the authors report reliability and validity evidence for the Dynamic Evaluation of Motor Speech Skill (DEMSS), a new test that uses dynamic assessment to aid in the differential diagnosis of childhood apraxia of speech (CAS). Method: Participants were 81 children between 36 and 79 months of age who were referred to the Mayo Clinic for diagnosis of speech sound disorders. Children were given the DEMSS and a standard speech and language test battery as part of routine evaluations. Subsequently, intrajudge, interjudge, and test-retest reliability were evaluated for a subset of participants. Construct validity was explored for all 81 participants through the use of agglomerative cluster analysis, sensitivity measures, and likelihood ratios. Results: The mean percentage of agreement for 171 judgments was 89% for test-retest reliability, 89% for intrajudge reliability, and 91% for interjudge reliability. Agglomerative hierarchical cluster analysis showed that total DEMSS scores largely differentiated clusters of children with CAS vs. mild CAS vs. other speech disorders. Positive and negative likelihood ratios and measures of sensitivity and specificity suggested that the DEMSS does not overdiagnose CAS but sometimes fails to identify children with CAS. Conclusions: The value of the DEMSS in differential diagnosis of severe speech impairments was supported on the basis of evidence of reliability and validity.

Original languageEnglish (US)
Pages (from-to)505-520
Number of pages16
JournalJournal of Speech, Language, and Hearing Research
Volume56
Issue number2
DOIs
StatePublished - Apr 1 2013

Fingerprint

Speech Disorders
speech disorder
Reproducibility of Results
Apraxias
Motor Skills
evidence
childhood
evaluation
cluster analysis
Cluster Analysis
Evaluation
Differential Diagnosis
Childhood Apraxia of Speech
Language Tests
test battery
construct validity

Keywords

  • Childhood apraxia of speech
  • Differential diagnosis
  • Dynamic assessment
  • Pediatric motor speech disorders
  • Speech sound disorders
  • Test development

ASJC Scopus subject areas

  • Speech and Hearing
  • Language and Linguistics
  • Linguistics and Language
  • Medicine(all)

Cite this

A motor speech assessment for children with severe speech disorders : Reliability and validity evidence. / Strand, Edythe A.; McCauley, Rebecca J.; Weigand, Stephen D.; Stoeckel, Ruth E.; Baas, Becky S.

In: Journal of Speech, Language, and Hearing Research, Vol. 56, No. 2, 01.04.2013, p. 505-520.

Research output: Contribution to journalArticle

Strand, Edythe A. ; McCauley, Rebecca J. ; Weigand, Stephen D. ; Stoeckel, Ruth E. ; Baas, Becky S. / A motor speech assessment for children with severe speech disorders : Reliability and validity evidence. In: Journal of Speech, Language, and Hearing Research. 2013 ; Vol. 56, No. 2. pp. 505-520.
@article{3f52838877b74ea2ae91a051a3d2b674,
title = "A motor speech assessment for children with severe speech disorders: Reliability and validity evidence",
abstract = "Purpose: In this article, the authors report reliability and validity evidence for the Dynamic Evaluation of Motor Speech Skill (DEMSS), a new test that uses dynamic assessment to aid in the differential diagnosis of childhood apraxia of speech (CAS). Method: Participants were 81 children between 36 and 79 months of age who were referred to the Mayo Clinic for diagnosis of speech sound disorders. Children were given the DEMSS and a standard speech and language test battery as part of routine evaluations. Subsequently, intrajudge, interjudge, and test-retest reliability were evaluated for a subset of participants. Construct validity was explored for all 81 participants through the use of agglomerative cluster analysis, sensitivity measures, and likelihood ratios. Results: The mean percentage of agreement for 171 judgments was 89{\%} for test-retest reliability, 89{\%} for intrajudge reliability, and 91{\%} for interjudge reliability. Agglomerative hierarchical cluster analysis showed that total DEMSS scores largely differentiated clusters of children with CAS vs. mild CAS vs. other speech disorders. Positive and negative likelihood ratios and measures of sensitivity and specificity suggested that the DEMSS does not overdiagnose CAS but sometimes fails to identify children with CAS. Conclusions: The value of the DEMSS in differential diagnosis of severe speech impairments was supported on the basis of evidence of reliability and validity.",
keywords = "Childhood apraxia of speech, Differential diagnosis, Dynamic assessment, Pediatric motor speech disorders, Speech sound disorders, Test development",
author = "Strand, {Edythe A.} and McCauley, {Rebecca J.} and Weigand, {Stephen D.} and Stoeckel, {Ruth E.} and Baas, {Becky S.}",
year = "2013",
month = "4",
day = "1",
doi = "10.1044/1092-4388(2012/12-0094)",
language = "English (US)",
volume = "56",
pages = "505--520",
journal = "Journal of Speech, Language, and Hearing Research",
issn = "1092-4388",
publisher = "American Speech-Language-Hearing Association (ASHA)",
number = "2",

}

TY - JOUR

T1 - A motor speech assessment for children with severe speech disorders

T2 - Reliability and validity evidence

AU - Strand, Edythe A.

AU - McCauley, Rebecca J.

AU - Weigand, Stephen D.

AU - Stoeckel, Ruth E.

AU - Baas, Becky S.

PY - 2013/4/1

Y1 - 2013/4/1

N2 - Purpose: In this article, the authors report reliability and validity evidence for the Dynamic Evaluation of Motor Speech Skill (DEMSS), a new test that uses dynamic assessment to aid in the differential diagnosis of childhood apraxia of speech (CAS). Method: Participants were 81 children between 36 and 79 months of age who were referred to the Mayo Clinic for diagnosis of speech sound disorders. Children were given the DEMSS and a standard speech and language test battery as part of routine evaluations. Subsequently, intrajudge, interjudge, and test-retest reliability were evaluated for a subset of participants. Construct validity was explored for all 81 participants through the use of agglomerative cluster analysis, sensitivity measures, and likelihood ratios. Results: The mean percentage of agreement for 171 judgments was 89% for test-retest reliability, 89% for intrajudge reliability, and 91% for interjudge reliability. Agglomerative hierarchical cluster analysis showed that total DEMSS scores largely differentiated clusters of children with CAS vs. mild CAS vs. other speech disorders. Positive and negative likelihood ratios and measures of sensitivity and specificity suggested that the DEMSS does not overdiagnose CAS but sometimes fails to identify children with CAS. Conclusions: The value of the DEMSS in differential diagnosis of severe speech impairments was supported on the basis of evidence of reliability and validity.

AB - Purpose: In this article, the authors report reliability and validity evidence for the Dynamic Evaluation of Motor Speech Skill (DEMSS), a new test that uses dynamic assessment to aid in the differential diagnosis of childhood apraxia of speech (CAS). Method: Participants were 81 children between 36 and 79 months of age who were referred to the Mayo Clinic for diagnosis of speech sound disorders. Children were given the DEMSS and a standard speech and language test battery as part of routine evaluations. Subsequently, intrajudge, interjudge, and test-retest reliability were evaluated for a subset of participants. Construct validity was explored for all 81 participants through the use of agglomerative cluster analysis, sensitivity measures, and likelihood ratios. Results: The mean percentage of agreement for 171 judgments was 89% for test-retest reliability, 89% for intrajudge reliability, and 91% for interjudge reliability. Agglomerative hierarchical cluster analysis showed that total DEMSS scores largely differentiated clusters of children with CAS vs. mild CAS vs. other speech disorders. Positive and negative likelihood ratios and measures of sensitivity and specificity suggested that the DEMSS does not overdiagnose CAS but sometimes fails to identify children with CAS. Conclusions: The value of the DEMSS in differential diagnosis of severe speech impairments was supported on the basis of evidence of reliability and validity.

KW - Childhood apraxia of speech

KW - Differential diagnosis

KW - Dynamic assessment

KW - Pediatric motor speech disorders

KW - Speech sound disorders

KW - Test development

UR - http://www.scopus.com/inward/record.url?scp=84878081641&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878081641&partnerID=8YFLogxK

U2 - 10.1044/1092-4388(2012/12-0094)

DO - 10.1044/1092-4388(2012/12-0094)

M3 - Article

VL - 56

SP - 505

EP - 520

JO - Journal of Speech, Language, and Hearing Research

JF - Journal of Speech, Language, and Hearing Research

SN - 1092-4388

IS - 2

ER -