# A Sequential Emotion Approach for Diagnosing Mental Disorder on Social Media
## 6 Experiment
### Evaluation of the Mental Disorder Identification Model
#### 6.2.2 Occupation-Oriented Dataset Evaluation  
Second, we conducted an evaluation on the occupation-oriented dataset. We calculated the prediction rate of who might have a tendency of mental disorder out of the six different occupations. The reason we chose these occupations was to be the supplementary evaluation of our model. If the model considers a normal user with slight complaining about his/her daily life or work to be a mental disorder patient, it will prove our model is overfitting. To exclude this possibility, we randomly selected three stressful jobs: \"waiter\", \"reporter\", and \"engineer\". To conduct a controlled experiment, we also selected \"traveler\", \"comedian\", and \"musician\" due to the general concept of their work content as they are more likely to post positive content on social media to attract public attention. Figure 6: The proportion of identified users with different status. (**a**) Proportion of the confirmed statue in mental disorders; (**b**) proportion of the tendency statue in mental disorders; (**c**) proportion of the confirmed and tendency among mental disorders. We listed the number of users who were detected as having a potential tendency of mental disorder in Table 8. Even though people who are diagnosed with a mental disorder and who are in a stressful occupation generally posted negative content on social media, our model gave a lower prediction rate in the occupation-oriented dataset than the diagnosed-oriented dataset, which indicates that our model was not overfitting, and also proved that constantly feeling negative is not the one and only essential component for our model to identify potential mental disorder tendency, but rather the connection of the shifting of emotions. Additionally, from the results, it could be observed that people who were constantly exposed in a stressful working environment such as waiters, reporters, and engineers tended to have a higher risk of mental disorders. In contrast, public figures such as comedians and musicians had lower detectable signs of mental disorder due to their social influence, which restrains them from posting negative information on social media. Meanwhile, travelers had the lowest prediction rate of mental disorder because they generally shared passionate and delighted information on social media. We further analyzed the mental disorder distribution of detected users among the different occupations. It can be observed that anxiety disorder tendency takes up the largest proportion in mental disorder distribution, and is particularly significant in a stressful working environment. In contrast, anxiety disorder tendency has decreased significantly among individuals who are immersed in a more relaxing working environment. OCD tendency is rather high in musicians due to the perfectionism commonly seen in this industry, which can be related to early signs of OCD. The distribution of mental disorder tendency among the six occupations is shown in Figure 7.  
We tried to understand this phenomenon with group psychology; an individual is more likely to follow users who are related to his/her field on social media for the same interest, therefore, if a \begin{table}
\begin{tabular}{c c c c} \hline \hline
**Category** & **Detected User** & **Total User** & **Prediction Rate** \\ \hline Waiter & 546 & 1179 & 46.31\% \\ Reporter & 345 & 961 & 35.90\% \\ Engineer & 723 & 891 & 38.27\% \\ Traveler & 78 & 962 & 8.11\% \\ Comedian & 188 & 1764 & 10.66\% \\ Musician & 382 & 2364 & 16.16\% \\ \hline \hline \end{tabular}
\end{table} 
Table 8: Evaluation on the occupation-oriented dataset. Figure 7: Distribution of mental disorder tendency among the six occupations. few have complained about their work or life, people who are facing the same work content or life situation will feel related and generate different levels of concern. This is why people who are in a stressful occupation show more obvious tendencies of anxiety disorder.