Application of usability testing for improving PACS workstation design

Bradley J Erickson, Merrick F. Kossack

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

User-centered design is a critical step in the product development cycle. It is an iterative process consisting of product design, implementation, and evaluation stages. Industry-standard usability metrics were employed to evaluate two sequential versions of commercial Picture Archiving and Communications System (PACS) workstation software as part of this process. They were evaluated 6 months apart by five radiologists with varying PACS experience. All radiologists were naive to the specific workstation tested. After a brief workstation overview, they were videotaped as they completed scenarios that closely simulated typical radiological practice. Each scenario consisted of various task categories. The task duration, nature and number of errors, help requests, and operator's manual consultations were recorded. After evaluating the fast software version, areas for improvement were identified and the application design modified. An unexpected result was the rewriting of the software manual to be task- and process-based rather than feature-based. Testing of the second version revealed a 22% improvement in performance time and 30% decrease in the number of errors compared to the first. Usability testing objectively identifies areas for improvement in the PACS workstation software. Additionally, it provides quantitative measures that may be used to prioritize and suggest future design efforts. Performing this evaluation as early as possible results in the rapid evolution of an application that will maximize radiologists' productivity and satisfaction.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
PublisherSociety of Photo-Optical Instrumentation Engineers
Pages188-195
Number of pages8
Volume3980
StatePublished - 2000
EventMedical Imaging 2000 - PACS Design and Evaluation: Engineering and Clinical Issues - San Diego, CA, USA
Duration: Feb 15 2000Feb 17 2000

Other

OtherMedical Imaging 2000 - PACS Design and Evaluation: Engineering and Clinical Issues
CitySan Diego, CA, USA
Period2/15/002/17/00

Fingerprint

Picture archiving and communication systems
workstations
telecommunication
computer programs
Testing
Product design
Product development
product development
evaluation
Productivity
productivity
industries
operators
cycles
Industry
products

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Erickson, B. J., & Kossack, M. F. (2000). Application of usability testing for improving PACS workstation design. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 3980, pp. 188-195). Society of Photo-Optical Instrumentation Engineers.

Application of usability testing for improving PACS workstation design. / Erickson, Bradley J; Kossack, Merrick F.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3980 Society of Photo-Optical Instrumentation Engineers, 2000. p. 188-195.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Erickson, BJ & Kossack, MF 2000, Application of usability testing for improving PACS workstation design. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 3980, Society of Photo-Optical Instrumentation Engineers, pp. 188-195, Medical Imaging 2000 - PACS Design and Evaluation: Engineering and Clinical Issues, San Diego, CA, USA, 2/15/00.
Erickson BJ, Kossack MF. Application of usability testing for improving PACS workstation design. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3980. Society of Photo-Optical Instrumentation Engineers. 2000. p. 188-195
Erickson, Bradley J ; Kossack, Merrick F. / Application of usability testing for improving PACS workstation design. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 3980 Society of Photo-Optical Instrumentation Engineers, 2000. pp. 188-195
@inproceedings{0f8660af6e244667bb6d58943bb6fde4,
title = "Application of usability testing for improving PACS workstation design",
abstract = "User-centered design is a critical step in the product development cycle. It is an iterative process consisting of product design, implementation, and evaluation stages. Industry-standard usability metrics were employed to evaluate two sequential versions of commercial Picture Archiving and Communications System (PACS) workstation software as part of this process. They were evaluated 6 months apart by five radiologists with varying PACS experience. All radiologists were naive to the specific workstation tested. After a brief workstation overview, they were videotaped as they completed scenarios that closely simulated typical radiological practice. Each scenario consisted of various task categories. The task duration, nature and number of errors, help requests, and operator's manual consultations were recorded. After evaluating the fast software version, areas for improvement were identified and the application design modified. An unexpected result was the rewriting of the software manual to be task- and process-based rather than feature-based. Testing of the second version revealed a 22{\%} improvement in performance time and 30{\%} decrease in the number of errors compared to the first. Usability testing objectively identifies areas for improvement in the PACS workstation software. Additionally, it provides quantitative measures that may be used to prioritize and suggest future design efforts. Performing this evaluation as early as possible results in the rapid evolution of an application that will maximize radiologists' productivity and satisfaction.",
author = "Erickson, {Bradley J} and Kossack, {Merrick F.}",
year = "2000",
language = "English (US)",
volume = "3980",
pages = "188--195",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "Society of Photo-Optical Instrumentation Engineers",

}

TY - GEN

T1 - Application of usability testing for improving PACS workstation design

AU - Erickson, Bradley J

AU - Kossack, Merrick F.

PY - 2000

Y1 - 2000

N2 - User-centered design is a critical step in the product development cycle. It is an iterative process consisting of product design, implementation, and evaluation stages. Industry-standard usability metrics were employed to evaluate two sequential versions of commercial Picture Archiving and Communications System (PACS) workstation software as part of this process. They were evaluated 6 months apart by five radiologists with varying PACS experience. All radiologists were naive to the specific workstation tested. After a brief workstation overview, they were videotaped as they completed scenarios that closely simulated typical radiological practice. Each scenario consisted of various task categories. The task duration, nature and number of errors, help requests, and operator's manual consultations were recorded. After evaluating the fast software version, areas for improvement were identified and the application design modified. An unexpected result was the rewriting of the software manual to be task- and process-based rather than feature-based. Testing of the second version revealed a 22% improvement in performance time and 30% decrease in the number of errors compared to the first. Usability testing objectively identifies areas for improvement in the PACS workstation software. Additionally, it provides quantitative measures that may be used to prioritize and suggest future design efforts. Performing this evaluation as early as possible results in the rapid evolution of an application that will maximize radiologists' productivity and satisfaction.

AB - User-centered design is a critical step in the product development cycle. It is an iterative process consisting of product design, implementation, and evaluation stages. Industry-standard usability metrics were employed to evaluate two sequential versions of commercial Picture Archiving and Communications System (PACS) workstation software as part of this process. They were evaluated 6 months apart by five radiologists with varying PACS experience. All radiologists were naive to the specific workstation tested. After a brief workstation overview, they were videotaped as they completed scenarios that closely simulated typical radiological practice. Each scenario consisted of various task categories. The task duration, nature and number of errors, help requests, and operator's manual consultations were recorded. After evaluating the fast software version, areas for improvement were identified and the application design modified. An unexpected result was the rewriting of the software manual to be task- and process-based rather than feature-based. Testing of the second version revealed a 22% improvement in performance time and 30% decrease in the number of errors compared to the first. Usability testing objectively identifies areas for improvement in the PACS workstation software. Additionally, it provides quantitative measures that may be used to prioritize and suggest future design efforts. Performing this evaluation as early as possible results in the rapid evolution of an application that will maximize radiologists' productivity and satisfaction.

UR - http://www.scopus.com/inward/record.url?scp=0033686805&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033686805&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:0033686805

VL - 3980

SP - 188

EP - 195

BT - Proceedings of SPIE - The International Society for Optical Engineering

PB - Society of Photo-Optical Instrumentation Engineers

ER -