Feasibility and Acceptability of a Mobile-Based Emotion Recognition Approach for Bipolar Disorder.
DOI:
https://doi.org/10.9781/ijimai.2021.08.015Keywords:
Assistance Systems, Bipolar Disorder, Emotion recognition, Intelligent Systems, Mobile HealthAbstract
Over the past years, the mobile Health approach has motivated research projects to develop mood monitoring systems for bipolar disorder. Whereas mobile-based approaches have examined self-assessment or sensor data, so far, potentially important emotional aspects of this disease have been neglected. Thus, we developed an emotion-sensitive system that analyzes the verbal and facial expressions of bipolar patients in regard to their emotional cues. In this article, preliminary findings of a pilot study with five bipolar patients with respect to the acceptability and feasibility of the new approach are presented and discussed. There were individual differences in the usage frequency of the participants, and improvements regarding its handling were suggested. From the technical point of view, the video analysis was less dependable than the audio analysis and recognized almost exclusively the facial expressions of happiness. However, the system was feasible and well-accepted. The results indicate that further developments could facilitate the long-term analysis of expressed emotions in bipolar or other disorders without invading the privacy of patients.
Downloads
References
I. Grande, M. Berk, B. Birmaher, and E. Vieta, “Bipolar disorder,” Lancet, vol. 387, no. 10027. pp. 1561–1572, 2016.
J. V. Pinto et al., “Remission and recurrence in bipolar disorder: The data from health outcomes and patient evaluations in bipolar disorder (HOPEBD) study,” Journal of Affective Disorders, vol. 268, pp. 150–157, 2020.
L. A. Carolan and M. J. Power, “What Basic Emotions Are Experienced in Bipolar Disorder?,” Clinical Psychology & Psychotherapy, vol. 18, no. 5, pp. 366–378, 2011.
M. Paris, Y. Mahajan, J. Kim, and T. Meade, “Emotional speech processing deficits in bipolar disorder: The role of mismatch negativity and P3a,” Journal of Affective Disorders, vol. 234, pp. 261–269, 2018.
A. C. Bilderbeck et al., “Associations between mood instability and emotional processing in a large cohort of bipolar patients,” Psychological Medicine, vol. 46, no. 15, pp. 3151–3160, 2016.
S. L. Johnson, C. S. Carver, and J. A. Tharp, “Suicidality in Bipolar Disorder: The Role of Emotion-Triggered Impulsivity,” Suicide and Life-Threatening Behavior, vol. 47, no. 2, pp. 177–192, 2017.
S. L. Johnson et al., “Emotion in Bipolar I Disorder: Implications for Functional and Symptom Outcomes,” Journal of Abnormal Psychology and Symptom Outcomes, vol. 125, no. 1, pp. 40–52, 2015.
A. Aparicio, J. L. Santos, E. Jiménez-López, A. Bagney, R. Rodríguez Jiménez, and E. M. Sánchez-Morla, “Emotion processing and psychosocial functioning in euthymic bipolar disorder,” Acta Psychiatrica Scandinavica, vol. 135, no. 4, pp. 339–350, 2017.
L. D. Branco, C. Cotrena, A. Ponsoni, R. Salvador-Silva, S. J. L. Vasconcellos, and R. P. Fonseca, “Identification and Perceived Intensity of Facial Expressions of Emotion in Bipolar Disorder and Major Depression,” Archives of Clinical Neuropsychology, vol. 33, no. 4, pp. 491–501, 2018.
J. Gray et al., “Bipolar patients show mood-congruent biases in sensitivity to facial expressions of emotion when exhibiting depressed symptoms, but not when exhibiting manic symptoms,” Cognitive Neuropsychiatry, vol. 11, no. 6, pp. 505–520, 2006.
H. R. Venn et al., “Perception of facial expressions of emotion in bipolar disorder,” Bipolar Disorders, vol. 6, no. 4, pp. 286–293, 2004.
C. M. Hoertnagl et al., “Combined processing of facial and vocal emotion in remitted patients with bipolar i disorder,” Journal of the International Neuropsychological Society, vol. 25, no. 3, pp. 275–284, 2019.
G. Bersani et al., “Facial expression in patients with bipolar disorder and schizophrenia in response to emotional stimuli: A partially shared cognitive and social deficit of the two disorders,” Neuropsychiatric Disease and Treatment, vol. 9, pp. 1137–1144, 2013.
I. Broch-Due, H. L. Kjærstad, L. V. Kessing, and K. Miskowiak, “Subtle behavioural responses during negative emotion reactivity and downregulation in bipolar disorder: A facial expression and eye-tracking study,” Psychiatry Research, vol. 266, pp. 152–159, 2018.
R. P. Bentall, P. Kinderman, and K. Manson, “Self-discrepancies in bipolar disorder: Comparison of manic, depressed, remitted and normal participants,” British Journal of Clinical Psychology, vol. 44, no. 4, pp. 457–473, 2005.
M. L. Inder, M. T. Crowe, P. R. Joyce, S. Moor, J. D. Carter, and S. E. Luty, “‘I really don’t know whether it is still there’: Ambivalent acceptance of a diagnosis of bipolar disorder,” Psychiatric Quarterly, vol. 81, no. 2, pp. 157–165, 2010.
L. M. Weinstock, T. Chou, C. Celis-de Hoyos, I. W. Miller, and J. Gruber, “Reward and Punishment Sensitivity and Emotion Regulation Processes Differentiate Bipolar and Unipolar Depression,” Cognitive Therapy and Research, vol. 42, no. 6, pp. 794–802, 2018.
J. Pech, M. Akhøj, J. Forman, L. V. Kessing, and U. Knorr, “The impact of a new affective episode on psychosocial functioning, quality of life and perceived stress in newly diagnosed patients with bipolar disorder: A prospective one-year case-control study,” Journal of Affective Disorders, vol. 277, pp. 486–494, 2020.
F. Bennett et al., “Predictors of psychosocial outcome of bipolar disorder: data from the Stanley Foundation Bipolar Network,” International Journal of Bipolar Disorders, vol. 7, no. 1, 2019.
A. López-Villarreal et al., “Progression of the functional deficit in a group of patients with bipolar disorder: a cluster analysis based on longitudinal data,” European Archives of Psychiatry and Clinical Neuroscience, vol. 270, no. 8, pp. 947–957, 2020.
M. J. Gitlin and D. J. Miklowitz, “The difficult lives of individuals with bipolar disorder: A review of functional outcomes and their implications for treatment,” Journal of Affective Disorders, vol. 209, no. July 2016, pp. 147–154, 2017.
C. J. L. Murray et al., “Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: A systematic analysis for the Global Burden of Disease Study 2010,” Lancet, vol. 380, no. 9859, pp. 2197–2223, 2012.
S. Miziou et al., “Psychosocial treatment and interventions for bipolar disorder: a systematic review.,” Annals of General Psychiatry, vol. 14, p. 19, 2015.
E. Morton, E. E. Michalak, R. Hole, S. Buzwell, and G. Murray, “‘Taking back the reins’ – A qualitative study of the meaning and experience of self-management in bipolar disorder,” Journal of Affective Disorders, vol. 228, pp. 160–165, 2018.
D. Hidalgo-Mazzei, A. Mateu, M. Reinares, A. Matic, E. Vieta, and F. Colom, “Internet-based psychological interventions for bipolar disorder: Review of the present and insights into the future,” Journal of Affective Disorders, vol. 188, pp. 1–13, 2015.
E. Gliddon, S. J. Barnes, G. Murray, and E. E. Michalak, “Online and mobile technologies for self-management in bipolar disorder: A systematic review.,” Psychiatric Rehabilitation Journal, vol. 40, no. 3, pp. 309–319, 2017.
M. Matthews et al., “Development and Evaluation of a Smartphone-Based Measure of Social Rhythms for Bipolar Disorder,” Assessment, vol. 23, pp. 472–483, 2016.
C. A. Depp et al., “Augmenting psychoeducation with a mobile intervention for bipolar disorder: A randomized controlled trial,” Journal of Affective Disorders, vol. 174, pp. 23–30, 2015.
D. Hidalgo-Mazzei et al., “OpenSIMPLe: A real-world implementation feasibility study of a smartphone-based psychoeducation programme for bipolar disorder,” Journal of Affective Disorders, vol. 241, pp. 436–445, 2018.
M. Faurholt-Jepsen et al., “Smartphone-based self-monitoring in bipolar disorder: evaluation of usability and feasibility of two systems,” International Journal of Bipolar Disorders, vol. 7, no. 1, pp. 1–11, 2019.
E. Mühlbauer et al., “Effectiveness of smartphone-based ambulatory assessment (SBAA-BD) including a predicting system for upcoming episodes in the long-term treatment of patients with bipolar disorders: Study protocol for a randomized controlled single-blind trial 11 Medical a,” BMC Psychiatry, vol. 18, no. 1, 2018.
J. Zulueta et al., “Predicting mood disturbance severity with mobile phone keystroke metadata: A biaffect digital phenotyping study,” Journal of Medical Internet Research, vol. 20, no. 7, pp. 1–10, 2018.
A. Cochran, L. Belman-Wells, and M. McInnis, “Engagement strategies for self-monitoring symptoms of bipolar disorder with mobile and wearable technology: Protocol for a randomized controlled trial,” Journal of Medical Internet Research, vol. 20, no. 5, 2018.
H. Daus, T. Bloecher, R. Egeler, R. De Klerk, W. Stork, and M. Backenstrass, “Development of an emotion-sensitive mobile Health approach for mood state recognition in bipolar disorder,” JMIR Mental Health, vol. 7, no. 7, pp. 1–10, 2020.
H. Daus, N. Kislicyn, S. Heuer, and M. Backenstrass, “Disease management apps and technical assistance systems for bipolar disorder_ Investigating the patients´ point of view,” Journal of Affective Disorders, vol. 229, pp. 351–357, 2018.
R. Bauer et al., “Internet use by older adults with bipolar disorder,” International Journal of Bipolar Disorders, vol. 6, no. 1, p. 20, 2018.
R. Bauer et al., “Internet use by patients with bipolar disorder: Results from an international multisite survey,” Psychiatry Research, vol. 242, 2016.
J. W. Pennebaker, M. E. Francis, and R. J. Booth, “Linguistic Inquiry and Word Count,” Word Journal Of The International Linguistic Association. pp. 1–21, 2001.
P. Ekman and W. V. Friesen, “Manual for the facial action coding system,” Consulting Psychologists Press, 1978.
S. Schwartz, S. Schultz, A. Reider, and E. F. H. Saunders, “Daily mood monitoring of symptoms using smartphones in bipolar disorder: A pilot study assessing the feasibility of ecological momentary assessment,” Journal of Affective Disorders, vol. 191, pp. 88–93, 2016.
D. Hidalgo-Mazzei et al., “Psychoeducation in bipolar disorder with a SIMPLe smartphone application: Feasibility, acceptability and satisfaction,” Journal of Affective Disorders, vol. 200, pp. 58–66, 2016.
T. J. Rothausen, “‘Family’ in organizational research: A review and comparison of definitions and measures,” Journal of Organizational Behavior, vol. 20, no. 6, pp. 817–836, 1999.
M. M. Al-Aynati and K. A. Chorneyko, “Comparison of voice-automated transcription and human transcription in generating pathology reports,” Archives of Pathology & Laboratory Medicine, vol. 127, no. 6, pp. 721–725, 2003.
S. Abdullah, M. Matthews, E. Frank, G. Doherty, G. Gay, and T. Choudhury, “Automatic detection of social rhythms in bipolar disorder,” Journal of the American Medical Informatics Association, vol. 23, no. 3, pp. 538–543, 2016.
F. Or, J. Torous, and J.-P. Onnela, “High potential but limited evidence: Using voice data from smartphones to monitor and diagnose mood disorders.,” Psychiatric Rehabilitation Journal, vol. 40, no. 3, pp. 320–324, 2017.
M. Faurholt-Jepsen et al., “Voice analysis as an objective state marker in bipolar disorder,” Translational Psychiatry, vol. 6, p. e856, 2016.
Z. Pan, C. Gui, J. Zhang, J. Zhu, and D. Cui, “Detecting Manic State of Bipolar Disorder Based on Support Vector Machine and Gaussian Mixture Model Using Spontaneous Speech,” Psychiatry Investigation, vol. 15, no. 7, pp. 695–700, 2018.
K. E. A. Saunders, A. C. Bilderbeck, P. Panchal, L. Z. Atkinson, J. R. Geddes, and G. M. Goodwin, “Experiences of remote mood and activity monitoring in bipolar disorder: A qualitative study,” European Psychiatry, vol. 41, pp. 115–121, 2017.
T. J. Trull and U. Ebner-Priemer, “Ambulatory assessment,” Annual Review of Clinical Psychology, vol. 9, pp. 151–176, 2013.
U. W. Ebner-Priemer and T. J. Trull, “Ecological Momentary Assessment of Mood Disorders and Mood Dysregulation,” Psychological Assessment, vol. 21, no. 4, pp. 463–475, 2009.
American Psychiatric Association, “Diagnostic and statistical manual of mental disorders (5th ed.),” American Psychiatric Publishing, 2013.
I. M. M. Lima, A. D. Peckham, and S. L. Johnson, “Cognitive deficits in bipolar disorders: Implications for emotion,” Clinical Psychology Review, vol. 59. pp. 126–136, 2018.
Downloads
Published
-
Abstract173
-
PDF35
Submit Article
Information
