Improved Statistical Methods for Evaluation of Stability of In Vitro Diagnostic Reagents

Mark Holland, Paul Kraght, Neval Akbas, Jeffrey Budd, George Klee

Research output: Contribution to journalArticle

Abstract

In vitro diagnostic (IVD) reagent stability is typically evaluated using regression analysis of measurand drift across time following CLSI guideline EP25-A. The corresponding stability duration establishment has several limitations. The stability duration conclusion is based on a two-stage acceptance criteria using the p-value of the regression slope followed by the 95% confidence interval (CI) on the fitted regression line if the p-value <0.05. This analysis technique is based on traditional statistical hypothesis testing; however, the statistical equivalence testing framework better represents the goals of IVD reagent stability evaluation. The resulting stability duration CI does not achieve 95% coverage probability and the statistical properties of the estimated stability duration are substantially impacted by presence of common variance components not accounted for during power analysis and by not accounting for variability in the baseline estimate. The current proposal based on the equivalence testing framework uses a one-stage acceptance criteria based on the 95% CI for proportional measurand drift derived from the regression fit. The proposed methodology was applied to automated immunoassay data (Akbas, Budd, and Klee 2016). Monte Carlo simulation studies are presented to illustrate the improved statistical properties of the current proposal along with an example power analysis for study design. Supplementary materials for this article are available online.

Original languageEnglish (US)
Pages (from-to)272-278
Number of pages7
JournalStatistics in Biopharmaceutical Research
Volume9
Issue number3
DOIs
StatePublished - Jul 3 2017

Fingerprint

Statistical method
Diagnostics
Confidence Intervals
Evaluation
Confidence interval
Power Analysis
p-Value
Immunoassay
Statistical property
Regression
Regression Analysis
Equivalence
Guidelines
Regression line
Testing
Variance Components
Coverage Probability
Hypothesis Testing
In Vitro Techniques
Baseline

Keywords

  • Equivalence testing
  • Regression analysis
  • Stability testing

ASJC Scopus subject areas

  • Statistics and Probability
  • Pharmaceutical Science

Cite this

Improved Statistical Methods for Evaluation of Stability of In Vitro Diagnostic Reagents. / Holland, Mark; Kraght, Paul; Akbas, Neval; Budd, Jeffrey; Klee, George.

In: Statistics in Biopharmaceutical Research, Vol. 9, No. 3, 03.07.2017, p. 272-278.

Research output: Contribution to journalArticle

Holland, Mark ; Kraght, Paul ; Akbas, Neval ; Budd, Jeffrey ; Klee, George. / Improved Statistical Methods for Evaluation of Stability of In Vitro Diagnostic Reagents. In: Statistics in Biopharmaceutical Research. 2017 ; Vol. 9, No. 3. pp. 272-278.
@article{a6185a2536e14ca59d6c336e43dce6b1,
title = "Improved Statistical Methods for Evaluation of Stability of In Vitro Diagnostic Reagents",
abstract = "In vitro diagnostic (IVD) reagent stability is typically evaluated using regression analysis of measurand drift across time following CLSI guideline EP25-A. The corresponding stability duration establishment has several limitations. The stability duration conclusion is based on a two-stage acceptance criteria using the p-value of the regression slope followed by the 95{\%} confidence interval (CI) on the fitted regression line if the p-value <0.05. This analysis technique is based on traditional statistical hypothesis testing; however, the statistical equivalence testing framework better represents the goals of IVD reagent stability evaluation. The resulting stability duration CI does not achieve 95{\%} coverage probability and the statistical properties of the estimated stability duration are substantially impacted by presence of common variance components not accounted for during power analysis and by not accounting for variability in the baseline estimate. The current proposal based on the equivalence testing framework uses a one-stage acceptance criteria based on the 95{\%} CI for proportional measurand drift derived from the regression fit. The proposed methodology was applied to automated immunoassay data (Akbas, Budd, and Klee 2016). Monte Carlo simulation studies are presented to illustrate the improved statistical properties of the current proposal along with an example power analysis for study design. Supplementary materials for this article are available online.",
keywords = "Equivalence testing, Regression analysis, Stability testing",
author = "Mark Holland and Paul Kraght and Neval Akbas and Jeffrey Budd and George Klee",
year = "2017",
month = "7",
day = "3",
doi = "10.1080/19466315.2017.1305287",
language = "English (US)",
volume = "9",
pages = "272--278",
journal = "Statistics in Biopharmaceutical Research",
issn = "1946-6315",
publisher = "Taylor and Francis Ltd.",
number = "3",

}

TY - JOUR

T1 - Improved Statistical Methods for Evaluation of Stability of In Vitro Diagnostic Reagents

AU - Holland, Mark

AU - Kraght, Paul

AU - Akbas, Neval

AU - Budd, Jeffrey

AU - Klee, George

PY - 2017/7/3

Y1 - 2017/7/3

N2 - In vitro diagnostic (IVD) reagent stability is typically evaluated using regression analysis of measurand drift across time following CLSI guideline EP25-A. The corresponding stability duration establishment has several limitations. The stability duration conclusion is based on a two-stage acceptance criteria using the p-value of the regression slope followed by the 95% confidence interval (CI) on the fitted regression line if the p-value <0.05. This analysis technique is based on traditional statistical hypothesis testing; however, the statistical equivalence testing framework better represents the goals of IVD reagent stability evaluation. The resulting stability duration CI does not achieve 95% coverage probability and the statistical properties of the estimated stability duration are substantially impacted by presence of common variance components not accounted for during power analysis and by not accounting for variability in the baseline estimate. The current proposal based on the equivalence testing framework uses a one-stage acceptance criteria based on the 95% CI for proportional measurand drift derived from the regression fit. The proposed methodology was applied to automated immunoassay data (Akbas, Budd, and Klee 2016). Monte Carlo simulation studies are presented to illustrate the improved statistical properties of the current proposal along with an example power analysis for study design. Supplementary materials for this article are available online.

AB - In vitro diagnostic (IVD) reagent stability is typically evaluated using regression analysis of measurand drift across time following CLSI guideline EP25-A. The corresponding stability duration establishment has several limitations. The stability duration conclusion is based on a two-stage acceptance criteria using the p-value of the regression slope followed by the 95% confidence interval (CI) on the fitted regression line if the p-value <0.05. This analysis technique is based on traditional statistical hypothesis testing; however, the statistical equivalence testing framework better represents the goals of IVD reagent stability evaluation. The resulting stability duration CI does not achieve 95% coverage probability and the statistical properties of the estimated stability duration are substantially impacted by presence of common variance components not accounted for during power analysis and by not accounting for variability in the baseline estimate. The current proposal based on the equivalence testing framework uses a one-stage acceptance criteria based on the 95% CI for proportional measurand drift derived from the regression fit. The proposed methodology was applied to automated immunoassay data (Akbas, Budd, and Klee 2016). Monte Carlo simulation studies are presented to illustrate the improved statistical properties of the current proposal along with an example power analysis for study design. Supplementary materials for this article are available online.

KW - Equivalence testing

KW - Regression analysis

KW - Stability testing

UR - http://www.scopus.com/inward/record.url?scp=85029931678&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029931678&partnerID=8YFLogxK

U2 - 10.1080/19466315.2017.1305287

DO - 10.1080/19466315.2017.1305287

M3 - Article

AN - SCOPUS:85029931678

VL - 9

SP - 272

EP - 278

JO - Statistics in Biopharmaceutical Research

JF - Statistics in Biopharmaceutical Research

SN - 1946-6315

IS - 3

ER -