The potency of psychiatric questionnaires to distinguish major mental disorders in Chinese outpatients

Background Considering the huge population in China, the available mental health resources are inadequate. Thus, our study aimed to evaluate whether mental questionnaires, serving as auxiliary diagnostic tools, have efficient diagnostic ability in outpatient psychiatric services. Methods We conducted a retrospective study of Chinese psychiatric outpatients. Altogether 1,182, 5,069, and 4,958 records of Symptom Checklist-90 (SCL-90), Hamilton Anxiety Rating Scale (HAM-A), and Hamilton Depression Rating Scale (HAM-D), respectively, were collected from March 2021 to July 2022. The Mann–Whitney U test was applied to subscale scores and total scores of SCL-90, HAM-A, and HAM-D between the two sexes (male and female groups), different age groups, and four diagnostic groups (anxiety disorder, depressive disorder, bipolar disorder, and schizophrenia). Kendall's tau coefficient analysis and machine learning were also conducted in the diagnostic groups. Results We found significant differences in most subscale scores for both age and gender groups. Using the Mann–Whitney U test and Kendall's tau coefficient analysis, we found that there were no statistically significant differences in diseases in total scale scores and nearly all subscale scores. The results of machine learning (ML) showed that for HAM-A, anxiety had a small degree of differentiation with an AUC of 0.56, while other diseases had an AUC close to 0.50. As for HAM-D, bipolar disorder was slightly distinguishable with an AUC of 0.60, while the AUC of other diseases was lower than 0.50. In SCL-90, all diseases had a similar AUC; among them, bipolar disorder had the lowest score, schizophrenia had the highest score, while anxiety and depression both had an AUC of approximately 0.56. Conclusion This study is the first to conduct wide and comprehensive analyses on the use of these three scales in Chinese outpatient clinics with both traditional statistical approaches and novel machine learning methods. Our results indicated that the univariate subscale scores did not have statistical significance among our four diagnostic groups, which highlights the limit of their practical use by doctors in identifying different mental diseases in Chinese outpatient psychiatric services.