Assessing agreement of repeated binary measurements with an application to the CDC's anthrax vaccine clinical trial

Yi Pan, Charles E. Rose, Michael Haber, Yan Ma, Josep L. Carrasco, Brock Stewart, Wendy A. Keitel, Harry Keyserling, Robert M. Jacobson, Gregory Poland, Michael M. McNeil

Research output: Contribution to journalArticle

4 Scopus citations

Abstract

Cohen's kappa coefficient, which was introduced in 1960, serves as the most widely employed coefficient to assess inter-observer agreement for categorical outcomes. However, the original kappa can only be applied to cross-sectional binary measurements and, therefore, cannot be applied in the practical situation when the observers evaluate the same subjects at repeated time intervals. This study summarizes six methods of assessing agreement of repeated binary outcomes under different assumptions and discusses under which condition we should use the most appropriate method in practice. These approaches are illustrated using data from the CDC anthrax vaccine adsorbed (AVA) human clinical trial comparing the agreement for two solicited adverse events after AVA between the 1-3 day in-clinic medical record and the patient's diary on the same day. We hope this article can inspire researchers to choose the most appropriate method to assess agreement for their own study with longitudinal binary data.

Original languageEnglish (US)
JournalInternational Journal of Biostatistics
Volume9
Issue number1
DOIs
StatePublished - Jul 1 2013

    Fingerprint

Keywords

  • Adverse event
  • Agreement
  • Anthrax vaccine
  • Binary
  • Kappa
  • Longitudinal

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Cite this

Pan, Y., Rose, C. E., Haber, M., Ma, Y., Carrasco, J. L., Stewart, B., Keitel, W. A., Keyserling, H., Jacobson, R. M., Poland, G., & McNeil, M. M. (2013). Assessing agreement of repeated binary measurements with an application to the CDC's anthrax vaccine clinical trial. International Journal of Biostatistics, 9(1). https://doi.org/10.1515/ijb-2012-0001