Application of mathematical models of system uncertainty to evaluate the utility of assay calibration protocols

Varun Ramamohan, Jim Abbott, George G. Klee, Yuehwern Yih

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Background : Laboratory protocols used to calibrate commercial clinical chemistry systems affect test result quality. Mathematical models of system uncertainty can be developed using performance parameters provided by the manufacturer for various subsystems. These models can be used to evaluate protocols for specific laboratory operations. Methods : A mathematical model was developed to estimate the uncertainty inherent in the Roche Diagnostics P-Modular system, and included uncertainties associated with the sample and reagent pipettes, spectrometer and the calibration process. The model was then used to evaluate various alternate calibration protocols: calibration based on mean of replicate measurements (n=1 - 6) and calibration based on conditional acceptance when the following quality control specimen was within one standard deviation of target. The effect of calibrator concentrations on assay measurement uncertainty was also studied, and calibrator concentrations that minimize uncertainty at a specific concentration were identified. Results : The simulation model produced uncertainty estimates of 3.5 % for the serum cholesterol assay and identified sample pipette (40 % ) and spectrometer (21 % ) as the largest contributors to measurement uncertainty. Each additional replicate calibrator measurements result in diminishing reductions in measurement uncertainty, with maximum reductions (19 % ) achieved with five replicate measurements. The conditional acceptance of calibration only when the control was within 1s resulted in an 18 % reduction. Conclusions : The model can be used to evaluate the utility of laboratory protocols and establish realistic assay performance targets. The model also can help instrument manufacturers and laboratorians identify major contributors to assay measurement uncertainty, which helps improve performance in future assay systems.

Original languageEnglish (US)
Pages (from-to)1945-1951
Number of pages7
JournalClinical Chemistry and Laboratory Medicine
Volume50
Issue number11
DOIs
StatePublished - Nov 2012

Fingerprint

Calibration
Uncertainty
Assays
Theoretical Models
Mathematical models
Spectrometers
Clinical Chemistry
Quality Control
Quality control
Cholesterol
Serum

Keywords

  • Calibration analysis
  • Monte Carlo simulation
  • Serum cholesterol assay
  • Uncertainty estimation

ASJC Scopus subject areas

  • Clinical Biochemistry
  • Biochemistry, medical

Cite this

Application of mathematical models of system uncertainty to evaluate the utility of assay calibration protocols. / Ramamohan, Varun; Abbott, Jim; Klee, George G.; Yih, Yuehwern.

In: Clinical Chemistry and Laboratory Medicine, Vol. 50, No. 11, 11.2012, p. 1945-1951.

Research output: Contribution to journalArticle

Ramamohan, Varun ; Abbott, Jim ; Klee, George G. ; Yih, Yuehwern. / Application of mathematical models of system uncertainty to evaluate the utility of assay calibration protocols. In: Clinical Chemistry and Laboratory Medicine. 2012 ; Vol. 50, No. 11. pp. 1945-1951.
@article{85b984161ca94297bfb2a9d78fb63d1b,
title = "Application of mathematical models of system uncertainty to evaluate the utility of assay calibration protocols",
abstract = "Background : Laboratory protocols used to calibrate commercial clinical chemistry systems affect test result quality. Mathematical models of system uncertainty can be developed using performance parameters provided by the manufacturer for various subsystems. These models can be used to evaluate protocols for specific laboratory operations. Methods : A mathematical model was developed to estimate the uncertainty inherent in the Roche Diagnostics P-Modular system, and included uncertainties associated with the sample and reagent pipettes, spectrometer and the calibration process. The model was then used to evaluate various alternate calibration protocols: calibration based on mean of replicate measurements (n=1 - 6) and calibration based on conditional acceptance when the following quality control specimen was within one standard deviation of target. The effect of calibrator concentrations on assay measurement uncertainty was also studied, and calibrator concentrations that minimize uncertainty at a specific concentration were identified. Results : The simulation model produced uncertainty estimates of 3.5 {\%} for the serum cholesterol assay and identified sample pipette (40 {\%} ) and spectrometer (21 {\%} ) as the largest contributors to measurement uncertainty. Each additional replicate calibrator measurements result in diminishing reductions in measurement uncertainty, with maximum reductions (19 {\%} ) achieved with five replicate measurements. The conditional acceptance of calibration only when the control was within 1s resulted in an 18 {\%} reduction. Conclusions : The model can be used to evaluate the utility of laboratory protocols and establish realistic assay performance targets. The model also can help instrument manufacturers and laboratorians identify major contributors to assay measurement uncertainty, which helps improve performance in future assay systems.",
keywords = "Calibration analysis, Monte Carlo simulation, Serum cholesterol assay, Uncertainty estimation",
author = "Varun Ramamohan and Jim Abbott and Klee, {George G.} and Yuehwern Yih",
year = "2012",
month = "11",
doi = "10.1515/cclm-2012-0265",
language = "English (US)",
volume = "50",
pages = "1945--1951",
journal = "Clinical Chemistry and Laboratory Medicine",
issn = "1434-6621",
publisher = "Walter de Gruyter GmbH & Co. KG",
number = "11",

}

TY - JOUR

T1 - Application of mathematical models of system uncertainty to evaluate the utility of assay calibration protocols

AU - Ramamohan, Varun

AU - Abbott, Jim

AU - Klee, George G.

AU - Yih, Yuehwern

PY - 2012/11

Y1 - 2012/11

N2 - Background : Laboratory protocols used to calibrate commercial clinical chemistry systems affect test result quality. Mathematical models of system uncertainty can be developed using performance parameters provided by the manufacturer for various subsystems. These models can be used to evaluate protocols for specific laboratory operations. Methods : A mathematical model was developed to estimate the uncertainty inherent in the Roche Diagnostics P-Modular system, and included uncertainties associated with the sample and reagent pipettes, spectrometer and the calibration process. The model was then used to evaluate various alternate calibration protocols: calibration based on mean of replicate measurements (n=1 - 6) and calibration based on conditional acceptance when the following quality control specimen was within one standard deviation of target. The effect of calibrator concentrations on assay measurement uncertainty was also studied, and calibrator concentrations that minimize uncertainty at a specific concentration were identified. Results : The simulation model produced uncertainty estimates of 3.5 % for the serum cholesterol assay and identified sample pipette (40 % ) and spectrometer (21 % ) as the largest contributors to measurement uncertainty. Each additional replicate calibrator measurements result in diminishing reductions in measurement uncertainty, with maximum reductions (19 % ) achieved with five replicate measurements. The conditional acceptance of calibration only when the control was within 1s resulted in an 18 % reduction. Conclusions : The model can be used to evaluate the utility of laboratory protocols and establish realistic assay performance targets. The model also can help instrument manufacturers and laboratorians identify major contributors to assay measurement uncertainty, which helps improve performance in future assay systems.

AB - Background : Laboratory protocols used to calibrate commercial clinical chemistry systems affect test result quality. Mathematical models of system uncertainty can be developed using performance parameters provided by the manufacturer for various subsystems. These models can be used to evaluate protocols for specific laboratory operations. Methods : A mathematical model was developed to estimate the uncertainty inherent in the Roche Diagnostics P-Modular system, and included uncertainties associated with the sample and reagent pipettes, spectrometer and the calibration process. The model was then used to evaluate various alternate calibration protocols: calibration based on mean of replicate measurements (n=1 - 6) and calibration based on conditional acceptance when the following quality control specimen was within one standard deviation of target. The effect of calibrator concentrations on assay measurement uncertainty was also studied, and calibrator concentrations that minimize uncertainty at a specific concentration were identified. Results : The simulation model produced uncertainty estimates of 3.5 % for the serum cholesterol assay and identified sample pipette (40 % ) and spectrometer (21 % ) as the largest contributors to measurement uncertainty. Each additional replicate calibrator measurements result in diminishing reductions in measurement uncertainty, with maximum reductions (19 % ) achieved with five replicate measurements. The conditional acceptance of calibration only when the control was within 1s resulted in an 18 % reduction. Conclusions : The model can be used to evaluate the utility of laboratory protocols and establish realistic assay performance targets. The model also can help instrument manufacturers and laboratorians identify major contributors to assay measurement uncertainty, which helps improve performance in future assay systems.

KW - Calibration analysis

KW - Monte Carlo simulation

KW - Serum cholesterol assay

KW - Uncertainty estimation

UR - http://www.scopus.com/inward/record.url?scp=84872921762&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872921762&partnerID=8YFLogxK

U2 - 10.1515/cclm-2012-0265

DO - 10.1515/cclm-2012-0265

M3 - Article

C2 - 23093083

AN - SCOPUS:84872921762

VL - 50

SP - 1945

EP - 1951

JO - Clinical Chemistry and Laboratory Medicine

JF - Clinical Chemistry and Laboratory Medicine

SN - 1434-6621

IS - 11

ER -