Predicting Academic Performance: Analysis of Students' Mental Health Condition from Social Media Interactions

Abstract

Social media have become an indispensable part of peoples' daily lives. Research suggests that interactions on social media partly exhibit individuals' personality, sentiment, and behavior. In this study, we examine the association between students' mental health and psychological attributes derived from social media interactions and academic performance. We build a classification model where students' psychological attributes and mental health issues will be predicted from their social media interactions. Then, students' academic performance will be identified from their predicted psychological attributes and mental health issues in the previous level. Firstly, we select samples by using judgmental sampling technique and collect the textual content from students' Facebook news feeds. Then, we derive feature vectors using MPNet (Masked and Permuted Pre-training for Language Understanding), which is one of the latest pre-trained sentence transformer models. Secondly, we find two different levels of correlations: (i) users' social media usage and their psychological attributes and mental health status and (ii) users' psychological attributes and mental health status and their academic performance. Thirdly, we build a two-level hybrid model to predict academic performance (i.e., Grade Point Average (GPA)) from students' Facebook posts: (1) from Facebook posts to mental health and psychological attributes using a regression model (SM-MP model) and (2) from psychological and mental attributes to the academic performance using a classifier model (MP-AP model). Later, we conduct an evaluation study by using real-life samples to validate the performance of the model and compare the performance with Baseline Models (i.e., Linguistic Inquiry and Word Count (LIWC) and Empath). Our model shows a strong performance with a microaverage f-score of 0.94 and an AUC-ROC score of 0.95. Finally, we build an ensemble model by combining both the psychological attributes and the mental health models and find that our combined model outperforms the independent models.

Keywords: BiLSTM; Facebook; MPNet; classification; ensemble; psychological attributes and mental health; regression; word embedding.

Figure 1

High-level architecture of the academic performance prediction model.

Figure 2

Architecture of predicting mental health and psychological attributes (SM-MP) from Facebook posts.

Figure 3

Architecture of predicting users’ academic performance (i.e., high, medium, and low) from mental health and psychological attributes (MP-AP).

Figure 4

Comparison of different models using AUC-ROC.

Figure 5

Design of the evaluation study to validate the model using real-life samples.