Operator variability in scan positioning is a major component of HR-pQCT precision error and is reduced by standardized training

S. Bonaretti, N. Vilayphiou, C. M. Chan, A. Yu, K. Nishiyama, D. Liu, S. Boutroy, A. Ghasem-Zadeh, S. K. Boyd, R. Chapurlat, H. McKay, E. Shane, M. L. Bouxsein, D. M. Black, S. Majumdar, E. S. Orwoll, T. F. Lang, Sundeep Khosla, A. J. Burghardt

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

Summary: In this study, we determined that operator positioning precision contributes significant measurement error in high-resolution peripheral quantitative computed tomography (HR-pQCT). Moreover, we developed software to quantify intra- and inter-operator variability and demonstrated that standard positioning training (now available as a web-based application) can significantly reduce inter-operator variability. Introduction: HR-pQCT is increasingly used to assess bone quality, fracture risk, and anti-fracture interventions. The contribution of the operator has not been adequately accounted in measurement precision. Operators acquire a 2D projection (“scout view image”) and define the region to be scanned by positioning a “reference line” on a standard anatomical landmark. In this study, we (i) evaluated the contribution of positioning variability to in vivo measurement precision, (ii) measured intra- and inter-operator positioning variability, and (iii) tested if custom training software led to superior reproducibility in new operators compared to experienced operators. Methods: To evaluate the operator in vivo measurement precision, we compared precision errors calculated in 64 co-registered and non-co-registered scan-rescan images. To quantify operator variability, we developed software that simulates the positioning process of the scanner’s software. Eight experienced operators positioned reference lines on scout view images designed to test intra- and inter-operator reproducibility. Finally, we developed modules for training and evaluation of reference line positioning. We enrolled six new operators to participate in a common training, followed by the same reproducibility experiments performed by the experienced group. Results: In vivo precision errors were up to threefold greater (Tt.BMD and Ct.Th) when variability in scan positioning was included. The inter-operator precision errors were significantly greater than the short-term intra-operator precision (p < 0.001). New trained operators achieved comparable intra-operator reproducibility to experienced operators and lower inter-operator reproducibility (p < 0.001). Precision errors were significantly greater for the radius than for the tibia. Conclusion: Operator reference line positioning contributes significantly to in vivo measurement precision and is significantly greater for multi-operator datasets. Inter-operator variability can be significantly reduced using a systematic training platform, now available online (http://webapps.radiology.ucsf.edu/refline/).

Original languageEnglish (US)
Pages (from-to)1-13
Number of pages13
JournalOsteoporosis International
DOIs
StateAccepted/In press - Jul 30 2016

Fingerprint

Software
Tomography
Bone Fractures
Tibia
Radiology

Keywords

  • HR-pQCT
  • Multicenter studies
  • Operator reproducibility
  • Precision
  • Standardization

ASJC Scopus subject areas

  • Endocrinology, Diabetes and Metabolism
  • Medicine(all)

Cite this

Operator variability in scan positioning is a major component of HR-pQCT precision error and is reduced by standardized training. / Bonaretti, S.; Vilayphiou, N.; Chan, C. M.; Yu, A.; Nishiyama, K.; Liu, D.; Boutroy, S.; Ghasem-Zadeh, A.; Boyd, S. K.; Chapurlat, R.; McKay, H.; Shane, E.; Bouxsein, M. L.; Black, D. M.; Majumdar, S.; Orwoll, E. S.; Lang, T. F.; Khosla, Sundeep; Burghardt, A. J.

In: Osteoporosis International, 30.07.2016, p. 1-13.

Research output: Contribution to journalArticle

Bonaretti, S, Vilayphiou, N, Chan, CM, Yu, A, Nishiyama, K, Liu, D, Boutroy, S, Ghasem-Zadeh, A, Boyd, SK, Chapurlat, R, McKay, H, Shane, E, Bouxsein, ML, Black, DM, Majumdar, S, Orwoll, ES, Lang, TF, Khosla, S & Burghardt, AJ 2016, 'Operator variability in scan positioning is a major component of HR-pQCT precision error and is reduced by standardized training', Osteoporosis International, pp. 1-13. https://doi.org/10.1007/s00198-016-3705-5
Bonaretti, S. ; Vilayphiou, N. ; Chan, C. M. ; Yu, A. ; Nishiyama, K. ; Liu, D. ; Boutroy, S. ; Ghasem-Zadeh, A. ; Boyd, S. K. ; Chapurlat, R. ; McKay, H. ; Shane, E. ; Bouxsein, M. L. ; Black, D. M. ; Majumdar, S. ; Orwoll, E. S. ; Lang, T. F. ; Khosla, Sundeep ; Burghardt, A. J. / Operator variability in scan positioning is a major component of HR-pQCT precision error and is reduced by standardized training. In: Osteoporosis International. 2016 ; pp. 1-13.
@article{c0d550e3373c4b0c93843320ae6fc4ca,
title = "Operator variability in scan positioning is a major component of HR-pQCT precision error and is reduced by standardized training",
abstract = "Summary: In this study, we determined that operator positioning precision contributes significant measurement error in high-resolution peripheral quantitative computed tomography (HR-pQCT). Moreover, we developed software to quantify intra- and inter-operator variability and demonstrated that standard positioning training (now available as a web-based application) can significantly reduce inter-operator variability. Introduction: HR-pQCT is increasingly used to assess bone quality, fracture risk, and anti-fracture interventions. The contribution of the operator has not been adequately accounted in measurement precision. Operators acquire a 2D projection (“scout view image”) and define the region to be scanned by positioning a “reference line” on a standard anatomical landmark. In this study, we (i) evaluated the contribution of positioning variability to in vivo measurement precision, (ii) measured intra- and inter-operator positioning variability, and (iii) tested if custom training software led to superior reproducibility in new operators compared to experienced operators. Methods: To evaluate the operator in vivo measurement precision, we compared precision errors calculated in 64 co-registered and non-co-registered scan-rescan images. To quantify operator variability, we developed software that simulates the positioning process of the scanner’s software. Eight experienced operators positioned reference lines on scout view images designed to test intra- and inter-operator reproducibility. Finally, we developed modules for training and evaluation of reference line positioning. We enrolled six new operators to participate in a common training, followed by the same reproducibility experiments performed by the experienced group. Results: In vivo precision errors were up to threefold greater (Tt.BMD and Ct.Th) when variability in scan positioning was included. The inter-operator precision errors were significantly greater than the short-term intra-operator precision (p < 0.001). New trained operators achieved comparable intra-operator reproducibility to experienced operators and lower inter-operator reproducibility (p < 0.001). Precision errors were significantly greater for the radius than for the tibia. Conclusion: Operator reference line positioning contributes significantly to in vivo measurement precision and is significantly greater for multi-operator datasets. Inter-operator variability can be significantly reduced using a systematic training platform, now available online (http://webapps.radiology.ucsf.edu/refline/).",
keywords = "HR-pQCT, Multicenter studies, Operator reproducibility, Precision, Standardization",
author = "S. Bonaretti and N. Vilayphiou and Chan, {C. M.} and A. Yu and K. Nishiyama and D. Liu and S. Boutroy and A. Ghasem-Zadeh and Boyd, {S. K.} and R. Chapurlat and H. McKay and E. Shane and Bouxsein, {M. L.} and Black, {D. M.} and S. Majumdar and Orwoll, {E. S.} and Lang, {T. F.} and Sundeep Khosla and Burghardt, {A. J.}",
year = "2016",
month = "7",
day = "30",
doi = "10.1007/s00198-016-3705-5",
language = "English (US)",
pages = "1--13",
journal = "Osteoporosis International",
issn = "0937-941X",
publisher = "Springer London",

}

TY - JOUR

T1 - Operator variability in scan positioning is a major component of HR-pQCT precision error and is reduced by standardized training

AU - Bonaretti, S.

AU - Vilayphiou, N.

AU - Chan, C. M.

AU - Yu, A.

AU - Nishiyama, K.

AU - Liu, D.

AU - Boutroy, S.

AU - Ghasem-Zadeh, A.

AU - Boyd, S. K.

AU - Chapurlat, R.

AU - McKay, H.

AU - Shane, E.

AU - Bouxsein, M. L.

AU - Black, D. M.

AU - Majumdar, S.

AU - Orwoll, E. S.

AU - Lang, T. F.

AU - Khosla, Sundeep

AU - Burghardt, A. J.

PY - 2016/7/30

Y1 - 2016/7/30

N2 - Summary: In this study, we determined that operator positioning precision contributes significant measurement error in high-resolution peripheral quantitative computed tomography (HR-pQCT). Moreover, we developed software to quantify intra- and inter-operator variability and demonstrated that standard positioning training (now available as a web-based application) can significantly reduce inter-operator variability. Introduction: HR-pQCT is increasingly used to assess bone quality, fracture risk, and anti-fracture interventions. The contribution of the operator has not been adequately accounted in measurement precision. Operators acquire a 2D projection (“scout view image”) and define the region to be scanned by positioning a “reference line” on a standard anatomical landmark. In this study, we (i) evaluated the contribution of positioning variability to in vivo measurement precision, (ii) measured intra- and inter-operator positioning variability, and (iii) tested if custom training software led to superior reproducibility in new operators compared to experienced operators. Methods: To evaluate the operator in vivo measurement precision, we compared precision errors calculated in 64 co-registered and non-co-registered scan-rescan images. To quantify operator variability, we developed software that simulates the positioning process of the scanner’s software. Eight experienced operators positioned reference lines on scout view images designed to test intra- and inter-operator reproducibility. Finally, we developed modules for training and evaluation of reference line positioning. We enrolled six new operators to participate in a common training, followed by the same reproducibility experiments performed by the experienced group. Results: In vivo precision errors were up to threefold greater (Tt.BMD and Ct.Th) when variability in scan positioning was included. The inter-operator precision errors were significantly greater than the short-term intra-operator precision (p < 0.001). New trained operators achieved comparable intra-operator reproducibility to experienced operators and lower inter-operator reproducibility (p < 0.001). Precision errors were significantly greater for the radius than for the tibia. Conclusion: Operator reference line positioning contributes significantly to in vivo measurement precision and is significantly greater for multi-operator datasets. Inter-operator variability can be significantly reduced using a systematic training platform, now available online (http://webapps.radiology.ucsf.edu/refline/).

AB - Summary: In this study, we determined that operator positioning precision contributes significant measurement error in high-resolution peripheral quantitative computed tomography (HR-pQCT). Moreover, we developed software to quantify intra- and inter-operator variability and demonstrated that standard positioning training (now available as a web-based application) can significantly reduce inter-operator variability. Introduction: HR-pQCT is increasingly used to assess bone quality, fracture risk, and anti-fracture interventions. The contribution of the operator has not been adequately accounted in measurement precision. Operators acquire a 2D projection (“scout view image”) and define the region to be scanned by positioning a “reference line” on a standard anatomical landmark. In this study, we (i) evaluated the contribution of positioning variability to in vivo measurement precision, (ii) measured intra- and inter-operator positioning variability, and (iii) tested if custom training software led to superior reproducibility in new operators compared to experienced operators. Methods: To evaluate the operator in vivo measurement precision, we compared precision errors calculated in 64 co-registered and non-co-registered scan-rescan images. To quantify operator variability, we developed software that simulates the positioning process of the scanner’s software. Eight experienced operators positioned reference lines on scout view images designed to test intra- and inter-operator reproducibility. Finally, we developed modules for training and evaluation of reference line positioning. We enrolled six new operators to participate in a common training, followed by the same reproducibility experiments performed by the experienced group. Results: In vivo precision errors were up to threefold greater (Tt.BMD and Ct.Th) when variability in scan positioning was included. The inter-operator precision errors were significantly greater than the short-term intra-operator precision (p < 0.001). New trained operators achieved comparable intra-operator reproducibility to experienced operators and lower inter-operator reproducibility (p < 0.001). Precision errors were significantly greater for the radius than for the tibia. Conclusion: Operator reference line positioning contributes significantly to in vivo measurement precision and is significantly greater for multi-operator datasets. Inter-operator variability can be significantly reduced using a systematic training platform, now available online (http://webapps.radiology.ucsf.edu/refline/).

KW - HR-pQCT

KW - Multicenter studies

KW - Operator reproducibility

KW - Precision

KW - Standardization

UR - http://www.scopus.com/inward/record.url?scp=84979988113&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84979988113&partnerID=8YFLogxK

U2 - 10.1007/s00198-016-3705-5

DO - 10.1007/s00198-016-3705-5

M3 - Article

C2 - 27475931

AN - SCOPUS:84979988113

SP - 1

EP - 13

JO - Osteoporosis International

JF - Osteoporosis International

SN - 0937-941X

ER -