Abstract
Background: Effective knowledge translation at the point of care requires that clinicians quickly find correct answers to clinical questions, and that they have appropriate confidence in their answers. Web-based knowledge resources can facilitate this process. Objective: The objective of our study was to evaluate a novel Web-based knowledge resource in comparison with other available Web-based resources, using outcomes of accuracy, time, and confidence. Methods: We conducted a controlled, crossover trial involving 59 practicing clinicians. Each participant answered questions related to two clinical scenarios. For one scenario, participants used a locally developed Web-based resource, and for the second scenario, they used other self-selected Web-based resources. The local knowledge resource ("AskMayoExpert") was designed to provide very concise evidence-based answers to commonly asked clinical questions. Outcomes included time to a correct response with at least 80% confidence (primary outcome), accuracy, time, and confidence. Results: Answers were more often accurate when using the local resource than when using other Web-based resources, with odds ratio 6.2 (95% CI 2.6-14.5; P<.001) when averaged across scenarios. Time to find an answer was faster, and confidence in that answer was consistently higher, for the local resource (P<.001). Overconfidence was also less frequent with the local resource. In a time-to-event analysis, the chance of responding correctly with at least 80% confidence was 2.5 times greater when using the local resource than with other resources (95% CI 1.6-3.8; P<.001). Conclusions: Clinicians using a Web-based knowledge resource designed to provide quick, concise answers at the point of care found answers with greater accuracy and confidence than when using other self-selected Web-based resources. Further study to improve the design and implementation of knowledge resources may improve point of care learning.
| Original language | English (US) |
|---|---|
| Article number | e7 |
| Journal | Journal of Medical Internet Research |
| Volume | 16 |
| Issue number | 2 |
| DOIs | |
| State | Published - Feb 2014 |
Fingerprint
Keywords
- Clinical decision support
- Educational technology
- Health information technology
- Medical education
- Web-based learning
ASJC Scopus subject areas
- Health Informatics
Cite this
Speed and accuracy of a point of care web-based knowledge resource for clinicians : A controlled crossover trial. / Cook, David Allan; Enders, Felicity T; Linderbaum, Jane A.; Zwart, Dale; Lloyd, Farrell J.
In: Journal of Medical Internet Research, Vol. 16, No. 2, e7, 02.2014.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Speed and accuracy of a point of care web-based knowledge resource for clinicians
T2 - A controlled crossover trial
AU - Cook, David Allan
AU - Enders, Felicity T
AU - Linderbaum, Jane A.
AU - Zwart, Dale
AU - Lloyd, Farrell J.
PY - 2014/2
Y1 - 2014/2
N2 - Background: Effective knowledge translation at the point of care requires that clinicians quickly find correct answers to clinical questions, and that they have appropriate confidence in their answers. Web-based knowledge resources can facilitate this process. Objective: The objective of our study was to evaluate a novel Web-based knowledge resource in comparison with other available Web-based resources, using outcomes of accuracy, time, and confidence. Methods: We conducted a controlled, crossover trial involving 59 practicing clinicians. Each participant answered questions related to two clinical scenarios. For one scenario, participants used a locally developed Web-based resource, and for the second scenario, they used other self-selected Web-based resources. The local knowledge resource ("AskMayoExpert") was designed to provide very concise evidence-based answers to commonly asked clinical questions. Outcomes included time to a correct response with at least 80% confidence (primary outcome), accuracy, time, and confidence. Results: Answers were more often accurate when using the local resource than when using other Web-based resources, with odds ratio 6.2 (95% CI 2.6-14.5; P<.001) when averaged across scenarios. Time to find an answer was faster, and confidence in that answer was consistently higher, for the local resource (P<.001). Overconfidence was also less frequent with the local resource. In a time-to-event analysis, the chance of responding correctly with at least 80% confidence was 2.5 times greater when using the local resource than with other resources (95% CI 1.6-3.8; P<.001). Conclusions: Clinicians using a Web-based knowledge resource designed to provide quick, concise answers at the point of care found answers with greater accuracy and confidence than when using other self-selected Web-based resources. Further study to improve the design and implementation of knowledge resources may improve point of care learning.
AB - Background: Effective knowledge translation at the point of care requires that clinicians quickly find correct answers to clinical questions, and that they have appropriate confidence in their answers. Web-based knowledge resources can facilitate this process. Objective: The objective of our study was to evaluate a novel Web-based knowledge resource in comparison with other available Web-based resources, using outcomes of accuracy, time, and confidence. Methods: We conducted a controlled, crossover trial involving 59 practicing clinicians. Each participant answered questions related to two clinical scenarios. For one scenario, participants used a locally developed Web-based resource, and for the second scenario, they used other self-selected Web-based resources. The local knowledge resource ("AskMayoExpert") was designed to provide very concise evidence-based answers to commonly asked clinical questions. Outcomes included time to a correct response with at least 80% confidence (primary outcome), accuracy, time, and confidence. Results: Answers were more often accurate when using the local resource than when using other Web-based resources, with odds ratio 6.2 (95% CI 2.6-14.5; P<.001) when averaged across scenarios. Time to find an answer was faster, and confidence in that answer was consistently higher, for the local resource (P<.001). Overconfidence was also less frequent with the local resource. In a time-to-event analysis, the chance of responding correctly with at least 80% confidence was 2.5 times greater when using the local resource than with other resources (95% CI 1.6-3.8; P<.001). Conclusions: Clinicians using a Web-based knowledge resource designed to provide quick, concise answers at the point of care found answers with greater accuracy and confidence than when using other self-selected Web-based resources. Further study to improve the design and implementation of knowledge resources may improve point of care learning.
KW - Clinical decision support
KW - Educational technology
KW - Health information technology
KW - Medical education
KW - Web-based learning
UR - http://www.scopus.com/inward/record.url?scp=84897652455&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84897652455&partnerID=8YFLogxK
U2 - 10.2196/ijmr.2811
DO - 10.2196/ijmr.2811
M3 - Article
AN - SCOPUS:84897652455
VL - 16
JO - Journal of Medical Internet Research
JF - Journal of Medical Internet Research
SN - 1439-4456
IS - 2
M1 - e7
ER -