Personalized prediction of smartphone-based psychotherapeutic micro-intervention success using machine learning

Gunther Meinlschmidt, Marion Tegethoff, Angelo Belardi, Esther Stalujanis, Minkyung Oh, Eun Kyung Jung, Hyun Chul Kim, Seung Schik Yoo, Jong Hwan Lee

Research output: Contribution to journalArticle

Abstract

Background: Tailoring healthcare to patients’ individual needs is a central goal of precision medicine. Combining smartphone-based interventions with machine learning approaches may help attaining this goal. The aim of our study was to explore the predictability of the success of smartphone-based psychotherapeutic micro-interventions in eliciting mood changes using machine learning. Methods: Participants conducted daily smartphone-based psychotherapeutic micro-interventions, guided by short video clips, for 13 consecutive days. Participants chose one of four intervention techniques used in psychotherapeutic approaches. Mood changes were assessed using the Multidimensional Mood State Questionnaire. Micro-intervention success was predicted using random forest (RF) tree-based mixed-effects logistic regression models. Data from 27 participants were used, totaling 324 micro-interventions, randomly split 100 times into training and test samples, using within-subject and between-subject sampling. Results: Mood improved from pre- to post-intervention in 137 sessions (initial success-rate: 42.3%). The RF approach resulted in predictions of micro-intervention success significantly better than the initial success-rate within and between subjects (positive predictive value: 0.732 (95%-CI: 0.607; 0.820) and 0.698 (95%-CI: 0.564; 0.805), respectively). Prediction quality was highest using the RF approach within subjects (rand accuracy: 0.75 (95%-CI: 0.641; 0.840), Matthew's correlation coefficient: 0.483 (95%-CI: 0.323; 0.723)). Limitations: The RF approach does not allow firm conclusions about the exact contribution of each factor to the algorithm's predictions. We included a limited number of predictors and did not compare whether predictability differed between psychotherapeutic techniques. Conclusions: Our findings may pave the way for translation and encourage scrutinizing personalized prediction in the psychotherapeutic context to improve treatment efficacy.

Original languageEnglish
Pages (from-to)430-437
Number of pages8
JournalJournal of Affective Disorders
Volume264
DOIs
Publication statusPublished - 2020 Mar 1

    Fingerprint

Keywords

  • Binary classification
  • Ecological momentary intervention
  • Internet- and mobile-based intervention
  • Mental disorder
  • Mhealth
  • Supervised learning

ASJC Scopus subject areas

  • Clinical Psychology
  • Psychiatry and Mental health

Cite this

Meinlschmidt, G., Tegethoff, M., Belardi, A., Stalujanis, E., Oh, M., Jung, E. K., Kim, H. C., Yoo, S. S., & Lee, J. H. (2020). Personalized prediction of smartphone-based psychotherapeutic micro-intervention success using machine learning. Journal of Affective Disorders, 264, 430-437. https://doi.org/10.1016/j.jad.2019.11.071