Speed and accuracy of a point of care web-based knowledge resource for clinicians: A controlled crossover trial

David Allan Cook, Felicity T Enders, Jane A. Linderbaum, Dale Zwart, Farrell J. Lloyd

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Background: Effective knowledge translation at the point of care requires that clinicians quickly find correct answers to clinical questions, and that they have appropriate confidence in their answers. Web-based knowledge resources can facilitate this process. Objective: The objective of our study was to evaluate a novel Web-based knowledge resource in comparison with other available Web-based resources, using outcomes of accuracy, time, and confidence. Methods: We conducted a controlled, crossover trial involving 59 practicing clinicians. Each participant answered questions related to two clinical scenarios. For one scenario, participants used a locally developed Web-based resource, and for the second scenario, they used other self-selected Web-based resources. The local knowledge resource ("AskMayoExpert") was designed to provide very concise evidence-based answers to commonly asked clinical questions. Outcomes included time to a correct response with at least 80% confidence (primary outcome), accuracy, time, and confidence. Results: Answers were more often accurate when using the local resource than when using other Web-based resources, with odds ratio 6.2 (95% CI 2.6-14.5; P<.001) when averaged across scenarios. Time to find an answer was faster, and confidence in that answer was consistently higher, for the local resource (P<.001). Overconfidence was also less frequent with the local resource. In a time-to-event analysis, the chance of responding correctly with at least 80% confidence was 2.5 times greater when using the local resource than with other resources (95% CI 1.6-3.8; P<.001). Conclusions: Clinicians using a Web-based knowledge resource designed to provide quick, concise answers at the point of care found answers with greater accuracy and confidence than when using other self-selected Web-based resources. Further study to improve the design and implementation of knowledge resources may improve point of care learning.

Original languageEnglish (US)
Article numbere7
JournalJournal of Medical Internet Research
Volume16
Issue number2
DOIs
StatePublished - Feb 2014

Fingerprint

Point-of-Care Systems
Cross-Over Studies
Translational Medical Research
Odds Ratio
Learning

Keywords

  • Clinical decision support
  • Educational technology
  • Health information technology
  • Medical education
  • Web-based learning

ASJC Scopus subject areas

  • Health Informatics

Cite this

Speed and accuracy of a point of care web-based knowledge resource for clinicians : A controlled crossover trial. / Cook, David Allan; Enders, Felicity T; Linderbaum, Jane A.; Zwart, Dale; Lloyd, Farrell J.

In: Journal of Medical Internet Research, Vol. 16, No. 2, e7, 02.2014.

Research output: Contribution to journalArticle

@article{e8bd155e1ae948e6a8eb88a9aafd8ca0,
title = "Speed and accuracy of a point of care web-based knowledge resource for clinicians: A controlled crossover trial",
abstract = "Background: Effective knowledge translation at the point of care requires that clinicians quickly find correct answers to clinical questions, and that they have appropriate confidence in their answers. Web-based knowledge resources can facilitate this process. Objective: The objective of our study was to evaluate a novel Web-based knowledge resource in comparison with other available Web-based resources, using outcomes of accuracy, time, and confidence. Methods: We conducted a controlled, crossover trial involving 59 practicing clinicians. Each participant answered questions related to two clinical scenarios. For one scenario, participants used a locally developed Web-based resource, and for the second scenario, they used other self-selected Web-based resources. The local knowledge resource ({"}AskMayoExpert{"}) was designed to provide very concise evidence-based answers to commonly asked clinical questions. Outcomes included time to a correct response with at least 80{\%} confidence (primary outcome), accuracy, time, and confidence. Results: Answers were more often accurate when using the local resource than when using other Web-based resources, with odds ratio 6.2 (95{\%} CI 2.6-14.5; P<.001) when averaged across scenarios. Time to find an answer was faster, and confidence in that answer was consistently higher, for the local resource (P<.001). Overconfidence was also less frequent with the local resource. In a time-to-event analysis, the chance of responding correctly with at least 80{\%} confidence was 2.5 times greater when using the local resource than with other resources (95{\%} CI 1.6-3.8; P<.001). Conclusions: Clinicians using a Web-based knowledge resource designed to provide quick, concise answers at the point of care found answers with greater accuracy and confidence than when using other self-selected Web-based resources. Further study to improve the design and implementation of knowledge resources may improve point of care learning.",
keywords = "Clinical decision support, Educational technology, Health information technology, Medical education, Web-based learning",
author = "Cook, {David Allan} and Enders, {Felicity T} and Linderbaum, {Jane A.} and Dale Zwart and Lloyd, {Farrell J.}",
year = "2014",
month = "2",
doi = "10.2196/ijmr.2811",
language = "English (US)",
volume = "16",
journal = "Journal of Medical Internet Research",
issn = "1439-4456",
publisher = "Journal of medical Internet Research",
number = "2",

}

TY - JOUR

T1 - Speed and accuracy of a point of care web-based knowledge resource for clinicians

T2 - A controlled crossover trial

AU - Cook, David Allan

AU - Enders, Felicity T

AU - Linderbaum, Jane A.

AU - Zwart, Dale

AU - Lloyd, Farrell J.

PY - 2014/2

Y1 - 2014/2

N2 - Background: Effective knowledge translation at the point of care requires that clinicians quickly find correct answers to clinical questions, and that they have appropriate confidence in their answers. Web-based knowledge resources can facilitate this process. Objective: The objective of our study was to evaluate a novel Web-based knowledge resource in comparison with other available Web-based resources, using outcomes of accuracy, time, and confidence. Methods: We conducted a controlled, crossover trial involving 59 practicing clinicians. Each participant answered questions related to two clinical scenarios. For one scenario, participants used a locally developed Web-based resource, and for the second scenario, they used other self-selected Web-based resources. The local knowledge resource ("AskMayoExpert") was designed to provide very concise evidence-based answers to commonly asked clinical questions. Outcomes included time to a correct response with at least 80% confidence (primary outcome), accuracy, time, and confidence. Results: Answers were more often accurate when using the local resource than when using other Web-based resources, with odds ratio 6.2 (95% CI 2.6-14.5; P<.001) when averaged across scenarios. Time to find an answer was faster, and confidence in that answer was consistently higher, for the local resource (P<.001). Overconfidence was also less frequent with the local resource. In a time-to-event analysis, the chance of responding correctly with at least 80% confidence was 2.5 times greater when using the local resource than with other resources (95% CI 1.6-3.8; P<.001). Conclusions: Clinicians using a Web-based knowledge resource designed to provide quick, concise answers at the point of care found answers with greater accuracy and confidence than when using other self-selected Web-based resources. Further study to improve the design and implementation of knowledge resources may improve point of care learning.

AB - Background: Effective knowledge translation at the point of care requires that clinicians quickly find correct answers to clinical questions, and that they have appropriate confidence in their answers. Web-based knowledge resources can facilitate this process. Objective: The objective of our study was to evaluate a novel Web-based knowledge resource in comparison with other available Web-based resources, using outcomes of accuracy, time, and confidence. Methods: We conducted a controlled, crossover trial involving 59 practicing clinicians. Each participant answered questions related to two clinical scenarios. For one scenario, participants used a locally developed Web-based resource, and for the second scenario, they used other self-selected Web-based resources. The local knowledge resource ("AskMayoExpert") was designed to provide very concise evidence-based answers to commonly asked clinical questions. Outcomes included time to a correct response with at least 80% confidence (primary outcome), accuracy, time, and confidence. Results: Answers were more often accurate when using the local resource than when using other Web-based resources, with odds ratio 6.2 (95% CI 2.6-14.5; P<.001) when averaged across scenarios. Time to find an answer was faster, and confidence in that answer was consistently higher, for the local resource (P<.001). Overconfidence was also less frequent with the local resource. In a time-to-event analysis, the chance of responding correctly with at least 80% confidence was 2.5 times greater when using the local resource than with other resources (95% CI 1.6-3.8; P<.001). Conclusions: Clinicians using a Web-based knowledge resource designed to provide quick, concise answers at the point of care found answers with greater accuracy and confidence than when using other self-selected Web-based resources. Further study to improve the design and implementation of knowledge resources may improve point of care learning.

KW - Clinical decision support

KW - Educational technology

KW - Health information technology

KW - Medical education

KW - Web-based learning

UR - http://www.scopus.com/inward/record.url?scp=84897652455&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84897652455&partnerID=8YFLogxK

U2 - 10.2196/ijmr.2811

DO - 10.2196/ijmr.2811

M3 - Article

AN - SCOPUS:84897652455

VL - 16

JO - Journal of Medical Internet Research

JF - Journal of Medical Internet Research

SN - 1439-4456

IS - 2

M1 - e7

ER -