A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool

Salah G. Aoun, Tarek Y. El Ahmadieh, Najib E. El Tecle, Marc R. Daou, Joseph G. Adel, Christine S. Park, H. Hunt Batjer, Bernard Bendok

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

OBJECT: Microsurgical skills remain an integral component of neurosurgical education. There is a need for an objective scale to assess microsurgical skills. The objective of this study was to assess the face and construct validity of a bench training microanastomosis module and an objective assessment scale, i.e., the Northwestern Objective Microanastomosis Assessment Tool (NOMAT).

METHODS: Medical students, neurosurgical residents, and postdoctoral research fellows at Northwestern University were enrolled in the study. Trainees were divided into 3 groups based on microsurgical experience: 1) experienced, 2) exposed, and 3) novices. Each trainee completed two end-to-end microanastomoses using a 1-mm and a 3-mm synthetic vessel. Two cameras were installed to capture procedural footage. One neurosurgeon blindly graded the performance of trainees using both objective and subjective methods to assess construct validity. Two neurosurgeons reviewed the contents of the simulation module to assess face validity.

RESULTS: Twenty-one trainees participated in the study, including 6 experienced, 6 exposed, and 9 novices. The mean NOMAT score for experienced trainees on the 1-mm module was 47.3/70 compared with 26.0/70 and 25.8/70 for exposed and novice trainees, respectively (p = 0.02). Using subjective grading, experienced trainees performed significantly better on the 1-mm module (64.2/100) compared with exposed or novice trainees (23.3/100 and 25.0/100, respectively; p = 0.02). No statistical difference between groups was noted for the 3-mm module with both NOMAT and subjective grading. Experienced trainees took less time to perform both tasks compared with the others.

CONCLUSIONS: Face and construct validities of the microanastomosis module were established. The scale and the microanastomosis module could help assess the microsurgical skills of neurosurgical trainees and serve as a basis for the creation of a microsurgical curriculum.

Original languageEnglish (US)
Pages (from-to)103-109
Number of pages7
JournalJournal of Neurosurgery
Volume123
Issue number1
DOIs
StatePublished - Jul 1 2015

Fingerprint

Reproducibility of Results
Medical Students
Curriculum
Education
Research
Neurosurgeons

Keywords

  • microanastomosis
  • microsurgery
  • NOMAT = Northwestern Objective Microanastomosis Assessment Tool
  • objective assessment scale
  • OSATS = Objective Structured Assessment of Technical Skill
  • resident training
  • simulation in neurosurgery
  • validity
  • vascular disorders

ASJC Scopus subject areas

  • Medicine(all)

Cite this

A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool. / Aoun, Salah G.; El Ahmadieh, Tarek Y.; El Tecle, Najib E.; Daou, Marc R.; Adel, Joseph G.; Park, Christine S.; Batjer, H. Hunt; Bendok, Bernard.

In: Journal of Neurosurgery, Vol. 123, No. 1, 01.07.2015, p. 103-109.

Research output: Contribution to journalArticle

Aoun, Salah G. ; El Ahmadieh, Tarek Y. ; El Tecle, Najib E. ; Daou, Marc R. ; Adel, Joseph G. ; Park, Christine S. ; Batjer, H. Hunt ; Bendok, Bernard. / A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool. In: Journal of Neurosurgery. 2015 ; Vol. 123, No. 1. pp. 103-109.
@article{3812b42fdfda473f9b1f323444d30484,
title = "A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool",
abstract = "OBJECT: Microsurgical skills remain an integral component of neurosurgical education. There is a need for an objective scale to assess microsurgical skills. The objective of this study was to assess the face and construct validity of a bench training microanastomosis module and an objective assessment scale, i.e., the Northwestern Objective Microanastomosis Assessment Tool (NOMAT).METHODS: Medical students, neurosurgical residents, and postdoctoral research fellows at Northwestern University were enrolled in the study. Trainees were divided into 3 groups based on microsurgical experience: 1) experienced, 2) exposed, and 3) novices. Each trainee completed two end-to-end microanastomoses using a 1-mm and a 3-mm synthetic vessel. Two cameras were installed to capture procedural footage. One neurosurgeon blindly graded the performance of trainees using both objective and subjective methods to assess construct validity. Two neurosurgeons reviewed the contents of the simulation module to assess face validity.RESULTS: Twenty-one trainees participated in the study, including 6 experienced, 6 exposed, and 9 novices. The mean NOMAT score for experienced trainees on the 1-mm module was 47.3/70 compared with 26.0/70 and 25.8/70 for exposed and novice trainees, respectively (p = 0.02). Using subjective grading, experienced trainees performed significantly better on the 1-mm module (64.2/100) compared with exposed or novice trainees (23.3/100 and 25.0/100, respectively; p = 0.02). No statistical difference between groups was noted for the 3-mm module with both NOMAT and subjective grading. Experienced trainees took less time to perform both tasks compared with the others.CONCLUSIONS: Face and construct validities of the microanastomosis module were established. The scale and the microanastomosis module could help assess the microsurgical skills of neurosurgical trainees and serve as a basis for the creation of a microsurgical curriculum.",
keywords = "microanastomosis, microsurgery, NOMAT = Northwestern Objective Microanastomosis Assessment Tool, objective assessment scale, OSATS = Objective Structured Assessment of Technical Skill, resident training, simulation in neurosurgery, validity, vascular disorders",
author = "Aoun, {Salah G.} and {El Ahmadieh}, {Tarek Y.} and {El Tecle}, {Najib E.} and Daou, {Marc R.} and Adel, {Joseph G.} and Park, {Christine S.} and Batjer, {H. Hunt} and Bernard Bendok",
year = "2015",
month = "7",
day = "1",
doi = "10.3171/2014.12.JNS131814",
language = "English (US)",
volume = "123",
pages = "103--109",
journal = "Journal of Neurosurgery",
issn = "0022-3085",
publisher = "American Association of Neurological Surgeons",
number = "1",

}

TY - JOUR

T1 - A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool

AU - Aoun, Salah G.

AU - El Ahmadieh, Tarek Y.

AU - El Tecle, Najib E.

AU - Daou, Marc R.

AU - Adel, Joseph G.

AU - Park, Christine S.

AU - Batjer, H. Hunt

AU - Bendok, Bernard

PY - 2015/7/1

Y1 - 2015/7/1

N2 - OBJECT: Microsurgical skills remain an integral component of neurosurgical education. There is a need for an objective scale to assess microsurgical skills. The objective of this study was to assess the face and construct validity of a bench training microanastomosis module and an objective assessment scale, i.e., the Northwestern Objective Microanastomosis Assessment Tool (NOMAT).METHODS: Medical students, neurosurgical residents, and postdoctoral research fellows at Northwestern University were enrolled in the study. Trainees were divided into 3 groups based on microsurgical experience: 1) experienced, 2) exposed, and 3) novices. Each trainee completed two end-to-end microanastomoses using a 1-mm and a 3-mm synthetic vessel. Two cameras were installed to capture procedural footage. One neurosurgeon blindly graded the performance of trainees using both objective and subjective methods to assess construct validity. Two neurosurgeons reviewed the contents of the simulation module to assess face validity.RESULTS: Twenty-one trainees participated in the study, including 6 experienced, 6 exposed, and 9 novices. The mean NOMAT score for experienced trainees on the 1-mm module was 47.3/70 compared with 26.0/70 and 25.8/70 for exposed and novice trainees, respectively (p = 0.02). Using subjective grading, experienced trainees performed significantly better on the 1-mm module (64.2/100) compared with exposed or novice trainees (23.3/100 and 25.0/100, respectively; p = 0.02). No statistical difference between groups was noted for the 3-mm module with both NOMAT and subjective grading. Experienced trainees took less time to perform both tasks compared with the others.CONCLUSIONS: Face and construct validities of the microanastomosis module were established. The scale and the microanastomosis module could help assess the microsurgical skills of neurosurgical trainees and serve as a basis for the creation of a microsurgical curriculum.

AB - OBJECT: Microsurgical skills remain an integral component of neurosurgical education. There is a need for an objective scale to assess microsurgical skills. The objective of this study was to assess the face and construct validity of a bench training microanastomosis module and an objective assessment scale, i.e., the Northwestern Objective Microanastomosis Assessment Tool (NOMAT).METHODS: Medical students, neurosurgical residents, and postdoctoral research fellows at Northwestern University were enrolled in the study. Trainees were divided into 3 groups based on microsurgical experience: 1) experienced, 2) exposed, and 3) novices. Each trainee completed two end-to-end microanastomoses using a 1-mm and a 3-mm synthetic vessel. Two cameras were installed to capture procedural footage. One neurosurgeon blindly graded the performance of trainees using both objective and subjective methods to assess construct validity. Two neurosurgeons reviewed the contents of the simulation module to assess face validity.RESULTS: Twenty-one trainees participated in the study, including 6 experienced, 6 exposed, and 9 novices. The mean NOMAT score for experienced trainees on the 1-mm module was 47.3/70 compared with 26.0/70 and 25.8/70 for exposed and novice trainees, respectively (p = 0.02). Using subjective grading, experienced trainees performed significantly better on the 1-mm module (64.2/100) compared with exposed or novice trainees (23.3/100 and 25.0/100, respectively; p = 0.02). No statistical difference between groups was noted for the 3-mm module with both NOMAT and subjective grading. Experienced trainees took less time to perform both tasks compared with the others.CONCLUSIONS: Face and construct validities of the microanastomosis module were established. The scale and the microanastomosis module could help assess the microsurgical skills of neurosurgical trainees and serve as a basis for the creation of a microsurgical curriculum.

KW - microanastomosis

KW - microsurgery

KW - NOMAT = Northwestern Objective Microanastomosis Assessment Tool

KW - objective assessment scale

KW - OSATS = Objective Structured Assessment of Technical Skill

KW - resident training

KW - simulation in neurosurgery

KW - validity

KW - vascular disorders

UR - http://www.scopus.com/inward/record.url?scp=84941740805&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84941740805&partnerID=8YFLogxK

U2 - 10.3171/2014.12.JNS131814

DO - 10.3171/2014.12.JNS131814

M3 - Article

C2 - 25658787

AN - SCOPUS:84941740805

VL - 123

SP - 103

EP - 109

JO - Journal of Neurosurgery

JF - Journal of Neurosurgery

SN - 0022-3085

IS - 1

ER -