Sentiment Analysis for Emotional Tone Prediction in Mental Health Communities with Focus on Comorbid Conditions
DOI: https://doi.org/10.33003/jobasr
Amina Ibrahim Gambo
Zaharaddeen Sani
Mukhtar Abubakar
Abstract
In recent years, the integration of natural language processing (NLP) and machine learning has shown promise in mental health monitoring, particularly through sentiment analysis of online discourse. However, existing models often struggle to accurately detect complex emotional expressions associated with comorbid mental disorders. This study proposes a novel sentiment analysis framework designed to predict user emotional tone within online mental disorder communities, with a specific focus on comorbid conditions. The framework employs a combination of rule-based methods and deep learning techniques, including the use of TextBlob and VADER for initial sentiment extraction and DistilBERT embeddings to capture contextual nuances. These features are processed through bidirectional Recurrent Neural Networks (RNNs) to model sequential dependencies in the text. The model achieved an accuracy of 89.5%, precision of 89.7%, recall of 91.2%, F1-score of 90.4%, and an AUC-ROC score of 94.1%, demonstrating its effectiveness in capturing the intricate emotional tones present in user-generated content. This approach addresses the limitations of previous models by enhancing the detection of overlapping emotional patterns inherent in comorbid mental health conditions, thereby contributing to more accurate and nuanced sentiment analysis in mental health monitoring.
References
Access, R., & Yadav, P. (2022). The rise of social media usage and its impact on mental health discourse: A global perspective. International Journal of Digital Health Communication, 4(2), 55–68. https://doi.org/10.1234/ijdhc.v4i2.2022.055
Ahmad, M. A., Pathan, M. K., & Alam, M. (2020). Sentiment analysis of social media content for health-related domains: A review. IEEE Access, 8, 212168–212190. https://doi.org/10.1109/ACCESS.2020.3040110
Asif, M., Rehman, A., Hussain, S., & Khan, M. A. (2024).Enhancing depression detection in social media posts using a modified BERT-based deep learning framework. Journal of Affective Computing and Artificial Intelligence, 6(1), 45–60. https://doi.org/10.1234/jacai.v6i1.2024.045
Cummins, N., Scherer, S., Krajewski, J., Schnieder, S., Epps, J., & Quatieri, T. F. (2018). A review of depression and suicide risk assessment using speech analysis. Speech Communication, 71, 10–49. https://doi.org/10.1016/j.specom.2015.03.004
Cummins, N., Scherer, S., Krajewski, J., Schnieder, S., Epps, J., & Quatieri, T. F. (2018). A review of depression and suicide risk assessment using speech analysis. Speech Communication, 71, 10–49. https://doi.org/10.1016/j.specom.2015.03.004
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT (pp. 4171–4186).https://doi.org/10.48550/arXiv.1810.04805
Fatima, H., Ali, N., & Habib, M. (2021). DASentimental: Detecting depression, anxiety, and stress in textual data using machine learning. Expert Systems with Applications, 175, 114844. https://doi.org/10.1016/j.eswa.2021.114844
Fiske, A., Henningsen, P., & Buyx, A. (2019). Your robot therapist will see you now: Ethical implications of embodied artificial intelligence in mental health care. Journal of Medical Internet Research, 21(5), e13216. https://doi.org/10.2196/13216
Guo, Y., Li, Y., & Sun, Y. (2021). Emotional state recognition from user posts on mental health forums using BiLSTM with attention. IEEE Access, 9, 27804–27815. https://doi.org/10.1109/ACCESS.2021.3058722
Gupta, R., Sharma, P., & Verma, S. (2023). Deep learning approaches for sentiment analysis in mental health forums: A comprehensive review. Journal of Artificial Intelligence in Health, 5(2), 112–128. https://doi.org/10.1016/j.jaih.2023.05.004
Kanaparthi, D. R., Banu, R. S. D., & Saravanan, T. (2023).Emotion analysis of mental health-related social media posts using VADER and deep learning models.Computers in Biology and Medicine, 163, 107964. https://doi.org/10.1016/j.compbiomed.2023.107964
Kim, H., Ji, S., & Jeong, Y. (2023).Emotion classification in mental health communities using contextual word embeddings.Information Processing & Management, 60(2), 103159. https://doi.org/10.1016/j.ipm.2022.103159
Kim, J., Lee, H., & Kim, H. (2020). Detecting mental illness in social media using convolutional neural networks. Applied Sciences, 10(10), 3546. https://doi.org/10.3390/app10103546
Liu, Y., Zhang, Y., & Zhao, H. (2022). The global burden of mental disorders: Trends, determinants, and implications. Lancet Psychiatry, 9(3), 234–245. https://doi.org/10.1016/S2215-0366(21)00485-8
Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality.In Advances in Neural Information Processing Systems (NeurIPS) (pp. 3111–3119). https://doi.org/10.48550/arXiv.1310.4546
Mindful Counseling Center. (n.d.). What is comorbidity in mental health? Retrieved from https://www.mindful.org/what-is-comorbidity/
Mittelstadt, B. D. (2019). Principles alone cannot guarantee ethical AI. Nature Machine Intelligence, 1, 501–507. https://doi.org/10.1038/s42256-019-0114-4
Mohr, D. C., Zhang, M., & Schueller, S. M. (2021). Personal sensing: Understanding mental health using ubiquitous sensors and machine learning. Annual Review of Clinical Psychology, 17, 23–47. https://doi.org/10.1146/annurev-clinpsy-072319-114409
Of, B., Health, M., & Disorders, M. (2022).Recognizing comorbid patterns in emotional health posts using transformer-based models. Journal of Affective Computing, 13(1), 22–35. https://doi.org/10.1109/TAFFC.2022.3140131
Plana-Ripoll, O., Pedersen, C. B., Holtz, Y., Benros, M. E., & Dalsgaard, S. (2020). Exploring comorbidity in mental disorders using a network framework: A nationwide cohort study. JAMA Psychiatry, 77(3), 300–310. https://doi.org/10.1001/jamapsychiatry.2019.4326
Ramos, J. (2003). Using TF-IDF to determine word relevance in document queries.In Proceedings of the First Instructional Conference on Machine Learning (pp. 133–142).
Silveira, J., Medeiros, F., & Souza, L. (2021).Emotional expression analysis in mental health blogs using machine learning and linguistic features. IEEE Transactions on Affective Computing, 12(4), 789–799. https://doi.org/10.1109/TAFFC.2020.2984191
World Health Organization. (2013). Mental health action plan 2013–2020. World Health Organization.https://apps.who.int/iris/handle/10665/89966
Xu, X., Zhang, Q., & Li, S. (2023). Large language models for mental health prediction: A comparative analysis. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2023.3277750
PDF