Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Feb 2:15:1353022.
doi: 10.3389/fpsyg.2024.1353022. eCollection 2024.

Artificial intelligence and social intelligence: preliminary comparison study between AI models and psychologists

Nabil Saleh Sufyan  1 , Fahmi H Fadhel #  2 , Saleh Safeer Alkhathami  1 , Jubran Y A Mukhadi  1
Affiliations

Artificial intelligence and social intelligence: preliminary comparison study between AI models and psychologists

Nabil Saleh Sufyan et al. Front Psychol. .

Abstract

Background: Social intelligence (SI) is of great importance in the success of the counseling and psychotherapy, whether for the psychologist or for the artificial intelligence systems that help the psychologist, as it is the ability to understand the feelings, emotions, and needs of people during the counseling process. Therefore, this study aims to identify the Social Intelligence (SI) of artificial intelligence represented by its large linguistic models, "ChatGPT; Google Bard; and Bing" compared to psychologists.

Methods: A stratified random manner sample of 180 students of counseling psychology from the bachelor's and doctoral stages at King Khalid University was selected, while the large linguistic models included ChatGPT-4, Google Bard, and Bing. They (the psychologists and the AI models) responded to the social intelligence scale.

Results: There were significant differences in SI between psychologists and AI's ChatGPT-4 and Bing. ChatGPT-4 exceeded 100% of all the psychologists, and Bing outperformed 50% of PhD holders and 90% of bachelor's holders. The differences in SI between Google Bard and bachelor students were not significant, whereas the differences with PhDs were significant; Where 90% of PhD holders excel on Google Bird.

Conclusion: We explored the possibility of using human measures on AI entities, especially language models, and the results indicate that the development of AI in understanding emotions and social behavior related to social intelligence is very rapid. AI will help the psychotherapist a great deal in new ways. The psychotherapist needs to be aware of possible areas of further development of AI given their benefits in counseling and psychotherapy. Studies using humanistic and non-humanistic criteria with large linguistic models are needed.

Keywords: Bing; ChatGPT; Google Bard; artificial intelligence; psychologists; social intelligence.

PubMed Disclaimer

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Figures

Figure 1
Figure 1
Social intelligence levels of AI models and psychologists.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Ayers J. W., Poliak A., Dredze M., Leas E. C., Zhu Z., Kelley J. B., et al. . (2023). Comparing physician and artificial intelligence Chatbot responses to patient questions posted to a public social media forum. JAMA Intern. Med. 183, 589–596. doi: 10.1001/jamainternmed.2023.1838, PMID: - DOI - PMC - PubMed
    1. Bell D. (2019). “The coming of post-industrial society” in Social stratification, class, race, and gender in sociological perspective. 2nd ed (New York:Routledge; ), 805–817.
    1. Bodroza B., Dinic B. M., Bojic L. (2023). Personality testing of GPT-3: limited temporal reliability, but highlighted social desirability of GPT-3's personality instruments results. arXiv:2306.04308v2. doi: 10.48550/arXiv.2306.04308 - DOI
    1. Brants T., Popat A., Xu P., Och F. J., Dean J. (2007). Large language models in machine translation. In: In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL) (pp. 858–867).
    1. Chang Y., Wang X., Wang J., Wu Y., Zhu K., Chen H., et al. . (2023). A survey on evaluation of large language models. arXiv:2307.03109. doi: 10.48550/arXiv.2307.03109 - DOI

LinkOut - more resources