Communications in Humanities Research ISSN: 2753-7072
Home> Volumes> Volume CHR Vol.42> Article
Research Article

Exploring the Impact of Different Textual Language Features on Large Language Models' Detection of Fake News

Huilin OuyangSoochow University* Hangqi YanSoochow University

* Corresponding author: [email protected]

Abstract

With the proliferation of social media and online platforms, fake news has become increasingly rampant. This study explores the impact of different textual language features on large language models (such as ChatGPT) in detecting fake news. By extracting extreme emotional vocabulary and exaggerated syntactic words commonly found in fake news and calculating their TF-IDF values, this study analyzes their influence on large language models' ability to assess the veracity of news. The study found that the frequency of extreme emotional words is higher than that of exaggerated syntactic words and has a more significant impact on fake news detection by large language models. Furthermore, this study suggests that by carefully selecting and adjusting language features, the accuracy and stability of fake news detection can be improved, providing new insights for optimizing automated detection systems. These findings provide important references for improving the technology of automatic fake news detection, contributing to the construction of a safer and more reliable online environment.

Keywords: Fake News Detection; Large Language Models; Language Features.
Published: November 15, 2024
DOI: 10.54254/2753-7064/42/20242585
Volume: CHR Vol.42
pp. 142-148
Download PDF

References

  1. Takayasu, M., Sato, K., Sano, Y. (2015) Rumor diffusion and convergence during the 3.11 earthquake: A Twitter case study. PLoS One, 10(4): e0121443.
  2. Gupta, A., Lamba, H., Kumaraguru, P. (2013) Faking Sandy: Characterizing and identifying fake images on Twitter during Hurricane Sandy. Proceedings of the 22nd international conference on World Wide Web (pp. 729-736).
  3. Mao, Z., Zhao, B., Bai, J. (2022) A Review of Fake News Detection Methods Based on Propagation Intent Features. Signal Processing, 38(06): 1155-1169.
  4. Shu, K., Sliva, A., Wang, S., Tang, J., Liu, H., (2021) Fake News Detection on Social Media: A Data Mining Perspective. Social and Information Networks.
  5. Che, W., Dou, Z., Feng, Y. (2023) Natural Language Processing in the Era of Large Models: Challenges, Opportunities, and Development. Science China: Information Sciences, 53(09): 1645-1687.
  6. Hu, B., Sheng, Q., Cao, J., Shi, Y., Li, Y., Wang, D., Qi, P. (2024) Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 38(20): 22105-22113.
  7. Liu, H., Chen, S., Cao, S. (2023) A Study on Fake News Detection Based on Multimodal Learning [J]. Computer Science and Exploration, 17(09): 2015-2029.
  8. Zhang, Z., Jing, J., Li, F. (2021), A Review of Fake Information Detection, Spread, and Control in Online Social Networks from the Perspective of Artificial Intelligence. Journal of Computer Science, 44(11): 2261-2282.
  9. Hassan, N., Li, C., Tremayne, M. (2015) Detecting Check-Worthy Factual Claims in Presidential Debates. Proceedings of the 24th ACM International on Conference on Information and Knowledge Management.
  10. Chen, T., Li, X., Yin, H. (2018) Call Attention to Rumors: Deep Attention-Based Recurrent Neural Networks for Early Rumor Detection. Trends and Applications in Knowledge Discovery and Data Mining.