Designing therapeutic care experiences with AI in mind

Designing systems and services with AI functionality as part of a care experience presents a range of challenges and opportunities. Limitations with sparse or missing data can make algorithmic training difficult, while the opaqueness of some black box methods muddies the process of interpreting outcomes. Human expertise and knowledge need to be carefully integrated at appropriate stages to inform both the AI approach and the fulfillment of the overall care cycle. Tackling this complex problem space requires a multidimensional and multi-stage approach integrating technical, social, medical, design and HCI knowledge. Based on our work creating therapeutic AI systems for cognitive and physical training, we propose six key system design challenges for consideration.