Interobserver Agreement in the Trial of Org 10172 in Acute Stroke Treatment Classification of Stroke Based on Retrospective Medical Record Review

James F Meschia, Kevin M Barrett, Felix Chukwudelunzu, W. Mark Brown, L. Douglas Case, Brett M. Kissela, Robert D Jr. Brown, Thomas G Brott, Tammy S. Olson, Stephen S. Rich, Scott Silliman, Bradford B. Worrall

Research output: Contribution to journalArticle

44 Citations (Scopus)

Abstract

Background: The reliability of the Trial of Org 10172 in Acute Stroke Treatment (TOAST) classification system of stroke in siblings of stroke-affected probands has not been tested. Similarly, the reliability of using clinical medical records to classify ischemic stroke has not been assessed. The purpose of this study was to establish the interrater reliability of sibling stroke subtyping by applying the TOAST criteria to retrospectively obtained medical records. Methods: Thirty medical records were randomly sampled from among the records of all siblings previously classified as stroke affected by the Siblings with Ischemic Stroke Study (SWISS) Stroke Verification Committee. Blinded medical records for these individuals were sent to 6 physician reviewers who independently classified TOAST stroke subtype on the basis of record review. Results: Using the κ statistic to assess interrater reliability, the overall reliability (SE) for assigning a TOAST subtype of stroke was 0.54 (0.03). Pair-wise comparisons between the original SWISS Stroke Verification Committee diagnoses and the diagnoses made by other reviewers exhibited moderate reliability (κ range 0.41-0.56). The κ statistics for common stroke subtypes were large vessel, 0.80 (0.06); cardioembolic, 0.80 (0.06); small vessel, 0.53 (0.06); and unknown cause, 0.40 (0.06). Conclusion We conclude that TOAST subtyping had moderate interrater reliability. Large-artery and cardioembolic subtype diagnoses seemed most reliable.

Original languageEnglish (US)
Pages (from-to)266-272
Number of pages7
JournalJournal of Stroke and Cerebrovascular Diseases
Volume15
Issue number6
DOIs
StatePublished - Nov 2006

Fingerprint

Medical Records
Stroke
Therapeutics
Siblings
danaproid
Arteries

Keywords

  • Affected sibling pair study
  • cerebral infarction
  • classification
  • ischemic stroke
  • medical record review
  • reliability

ASJC Scopus subject areas

  • Clinical Neurology
  • Surgery
  • Health Professions(all)

Cite this

Interobserver Agreement in the Trial of Org 10172 in Acute Stroke Treatment Classification of Stroke Based on Retrospective Medical Record Review. / Meschia, James F; Barrett, Kevin M; Chukwudelunzu, Felix; Brown, W. Mark; Case, L. Douglas; Kissela, Brett M.; Brown, Robert D Jr.; Brott, Thomas G; Olson, Tammy S.; Rich, Stephen S.; Silliman, Scott; Worrall, Bradford B.

In: Journal of Stroke and Cerebrovascular Diseases, Vol. 15, No. 6, 11.2006, p. 266-272.

Research output: Contribution to journalArticle

Meschia, James F ; Barrett, Kevin M ; Chukwudelunzu, Felix ; Brown, W. Mark ; Case, L. Douglas ; Kissela, Brett M. ; Brown, Robert D Jr. ; Brott, Thomas G ; Olson, Tammy S. ; Rich, Stephen S. ; Silliman, Scott ; Worrall, Bradford B. / Interobserver Agreement in the Trial of Org 10172 in Acute Stroke Treatment Classification of Stroke Based on Retrospective Medical Record Review. In: Journal of Stroke and Cerebrovascular Diseases. 2006 ; Vol. 15, No. 6. pp. 266-272.
@article{1f824262a1ce4d1da00ff6a450e8a453,
title = "Interobserver Agreement in the Trial of Org 10172 in Acute Stroke Treatment Classification of Stroke Based on Retrospective Medical Record Review",
abstract = "Background: The reliability of the Trial of Org 10172 in Acute Stroke Treatment (TOAST) classification system of stroke in siblings of stroke-affected probands has not been tested. Similarly, the reliability of using clinical medical records to classify ischemic stroke has not been assessed. The purpose of this study was to establish the interrater reliability of sibling stroke subtyping by applying the TOAST criteria to retrospectively obtained medical records. Methods: Thirty medical records were randomly sampled from among the records of all siblings previously classified as stroke affected by the Siblings with Ischemic Stroke Study (SWISS) Stroke Verification Committee. Blinded medical records for these individuals were sent to 6 physician reviewers who independently classified TOAST stroke subtype on the basis of record review. Results: Using the κ statistic to assess interrater reliability, the overall reliability (SE) for assigning a TOAST subtype of stroke was 0.54 (0.03). Pair-wise comparisons between the original SWISS Stroke Verification Committee diagnoses and the diagnoses made by other reviewers exhibited moderate reliability (κ range 0.41-0.56). The κ statistics for common stroke subtypes were large vessel, 0.80 (0.06); cardioembolic, 0.80 (0.06); small vessel, 0.53 (0.06); and unknown cause, 0.40 (0.06). Conclusion We conclude that TOAST subtyping had moderate interrater reliability. Large-artery and cardioembolic subtype diagnoses seemed most reliable.",
keywords = "Affected sibling pair study, cerebral infarction, classification, ischemic stroke, medical record review, reliability",
author = "Meschia, {James F} and Barrett, {Kevin M} and Felix Chukwudelunzu and Brown, {W. Mark} and Case, {L. Douglas} and Kissela, {Brett M.} and Brown, {Robert D Jr.} and Brott, {Thomas G} and Olson, {Tammy S.} and Rich, {Stephen S.} and Scott Silliman and Worrall, {Bradford B.}",
year = "2006",
month = "11",
doi = "10.1016/j.jstrokecerebrovasdis.2006.07.001",
language = "English (US)",
volume = "15",
pages = "266--272",
journal = "Journal of Stroke and Cerebrovascular Diseases",
issn = "1052-3057",
publisher = "W.B. Saunders Ltd",
number = "6",

}

TY - JOUR

T1 - Interobserver Agreement in the Trial of Org 10172 in Acute Stroke Treatment Classification of Stroke Based on Retrospective Medical Record Review

AU - Meschia, James F

AU - Barrett, Kevin M

AU - Chukwudelunzu, Felix

AU - Brown, W. Mark

AU - Case, L. Douglas

AU - Kissela, Brett M.

AU - Brown, Robert D Jr.

AU - Brott, Thomas G

AU - Olson, Tammy S.

AU - Rich, Stephen S.

AU - Silliman, Scott

AU - Worrall, Bradford B.

PY - 2006/11

Y1 - 2006/11

N2 - Background: The reliability of the Trial of Org 10172 in Acute Stroke Treatment (TOAST) classification system of stroke in siblings of stroke-affected probands has not been tested. Similarly, the reliability of using clinical medical records to classify ischemic stroke has not been assessed. The purpose of this study was to establish the interrater reliability of sibling stroke subtyping by applying the TOAST criteria to retrospectively obtained medical records. Methods: Thirty medical records were randomly sampled from among the records of all siblings previously classified as stroke affected by the Siblings with Ischemic Stroke Study (SWISS) Stroke Verification Committee. Blinded medical records for these individuals were sent to 6 physician reviewers who independently classified TOAST stroke subtype on the basis of record review. Results: Using the κ statistic to assess interrater reliability, the overall reliability (SE) for assigning a TOAST subtype of stroke was 0.54 (0.03). Pair-wise comparisons between the original SWISS Stroke Verification Committee diagnoses and the diagnoses made by other reviewers exhibited moderate reliability (κ range 0.41-0.56). The κ statistics for common stroke subtypes were large vessel, 0.80 (0.06); cardioembolic, 0.80 (0.06); small vessel, 0.53 (0.06); and unknown cause, 0.40 (0.06). Conclusion We conclude that TOAST subtyping had moderate interrater reliability. Large-artery and cardioembolic subtype diagnoses seemed most reliable.

AB - Background: The reliability of the Trial of Org 10172 in Acute Stroke Treatment (TOAST) classification system of stroke in siblings of stroke-affected probands has not been tested. Similarly, the reliability of using clinical medical records to classify ischemic stroke has not been assessed. The purpose of this study was to establish the interrater reliability of sibling stroke subtyping by applying the TOAST criteria to retrospectively obtained medical records. Methods: Thirty medical records were randomly sampled from among the records of all siblings previously classified as stroke affected by the Siblings with Ischemic Stroke Study (SWISS) Stroke Verification Committee. Blinded medical records for these individuals were sent to 6 physician reviewers who independently classified TOAST stroke subtype on the basis of record review. Results: Using the κ statistic to assess interrater reliability, the overall reliability (SE) for assigning a TOAST subtype of stroke was 0.54 (0.03). Pair-wise comparisons between the original SWISS Stroke Verification Committee diagnoses and the diagnoses made by other reviewers exhibited moderate reliability (κ range 0.41-0.56). The κ statistics for common stroke subtypes were large vessel, 0.80 (0.06); cardioembolic, 0.80 (0.06); small vessel, 0.53 (0.06); and unknown cause, 0.40 (0.06). Conclusion We conclude that TOAST subtyping had moderate interrater reliability. Large-artery and cardioembolic subtype diagnoses seemed most reliable.

KW - Affected sibling pair study

KW - cerebral infarction

KW - classification

KW - ischemic stroke

KW - medical record review

KW - reliability

UR - http://www.scopus.com/inward/record.url?scp=33750716530&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33750716530&partnerID=8YFLogxK

U2 - 10.1016/j.jstrokecerebrovasdis.2006.07.001

DO - 10.1016/j.jstrokecerebrovasdis.2006.07.001

M3 - Article

C2 - 17904086

AN - SCOPUS:33750716530

VL - 15

SP - 266

EP - 272

JO - Journal of Stroke and Cerebrovascular Diseases

JF - Journal of Stroke and Cerebrovascular Diseases

SN - 1052-3057

IS - 6

ER -