Gender Prejudice in Large Language Models from the Perspective of Pragmatics-Based on Critical Translation

Yizhuohan Zhang; Minyiyang Zhao; Yichun Ma

doi:10.54254/2753-7064/2024.21411

Research Article

Gender Prejudice in Large Language Models from the Perspective of Pragmatics-Based on Critical Translation

Yizhuohan Zhang^{School of Humanities, Communication University of China, Beijing, 100024, China} Minyiyang Zhao^{School of Humanities and Social Sciences, Xi’an Jiaotong-Liverpool University, Suzhou, 215123, China}* Yichun Ma^{Suzhou North America High School, Suzhou, 215000, China}

* Corresponding author: [email protected]

Abstract

This paper explores the complex interplay between gender bias in Large Language Models (LLMs) and human empirical perspectives, focusing on pragmatic and critical translation approaches. Considering this pressing issue, this work creates a database of 55 Chinese sentences without explicit gender pronounces and tests translation tasks on ChatGPT, Ernie Bot, and Spark Desk platforms. The study reveals that LLMs exhibit varying levels of gender bias, reflecting cultural differences observed in human translators. In the research, the “Gender Stereotype Circle of Large Language Models and Human”, a theoretical framework is designed to address these biases through six vital factors and demonstrate the interactions to aid in optimizing how LLMs cope with gender issues, enhancing the output quality, and providing an empirical foundation for the LLMs’ training.

Keywords: Large language models; Gender prejudice; Empiricism; Pragmatics; Critical translation

Published: March 13, 2025

DOI: 10.54254/2753-7064/2024.21411

Volume: CHR Vol.55

pp. 99-108

Download PDF

References

Euronews. (2023). ChatGPT a year on: 3 ways the AI chatbot has completely changed the world in 12 months. https://www.euronews.com/next/2023/11/30/chatgpt-a-year-on-3-ways-the-ai-chatbot-has-completely-changed-the-world-in-12-months
Naveed, H., Khana, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2023). A Comprehensive Overview of Large Language Models. https://doi.org/10.48550/arXiv.2307.06435
Malsburg, T., Poppels, T., & Levy, R. (2020). Implicit Gender Bias in Linguistic Descriptions for Expected Events: The Cases of the 2016 United States and 2017 United Kingdom Elections. https://doi.org/10.1177/0956797619890619
Manasi, A., Panchanadesaran, S., & Sours, E. (2023). Addressing Gender Bias to Achieve Ethical AI. The Global Observatory. https://theglobalobservatory.org/2023/03/gender-bias-ethical-artificial-intelligence/
Kotek, H. Dockum, R. Sun, D. (2023) Gender bias and stereotypes in Large Language Models. In Collective Intelligence Conference (CI '23), November 06--09, 2023, Delft, Netherlands. ACM, New York, NY, USA 13 Pages. https://doi.org/10.1145/3582269.3615599
Cho, W., Kim, J., Kim S., & Kim, N. (2019). On Measuring Gender Bias in Translation of Gender-neutral Pronouns. https://doi.org/10.48550/arXiv.1905.11684
García-UII, F.-J., & Melero-Lázaro, M. (2023). Gender stereotypes in AI-generated images. Profesional De La información, 32(5). https://doi.org/10.3145/epi.2023.sep.05
Wan, Y., Pu, G., Sun, J., Garimella, A., Chang, K. W., & Peng, N. (2023). "Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters. https://doi.org/10.48550/arXiv.2310.09219
UNESCO. (2024). Challenging systematic prejudices: an investigation into bias against women and girls in large language models. https://discovery.ucl.ac.uk/id/eprint/10188772
OpenAI. (2022). Introducing ChatGPT. Retrieved 12 August 2024, from: https://openai.com/blog/chatgpt
Baidu. (2023). Ernie Bot. Retrieved 12 August 2024, from: https://yiyan.baidu.com/welcome
iFlytek. (2023). Spark Desk. Retrieved 12 August 2024, from: https://xinghuo.xfyun.cn
Fu, R., & Yang, X. (2023). Analysis of AIGC Language Models and Application Scenarios in University Libraries. Journal of Library and Information Science in Agriculture. https://link.cnki.net/doi/10.13998/j.cnki.issn1002-1248.23-0406
Xu, N., & Yin, Y. (2008). Bias in Linguistic Discrimination—A Study of Anti-Male Language. JOURNAL OF NORTHWEST A&F UNIVERSITY (SOCIAL SCIENCE EDITION), 8(5), 116–119. https://doi-org-s.elink.xjtlu.edu.cn:443/10.3969/j.issn.1009-9107.2008.05.025
Acerbi, A., & Stubbersfield, JM. (2023). Large language models show human-like content biases in transmission chain experiments. Proceedings of the National Academy of Sciences of the United States of America, 120:44
Hall, E. (1977). Beyond Culture. Anchor Books, New York
Xing, J., & Yang, H. (2020). Ideological Explicitation in the Corpus-based Critical Translation Studies: A Review of Introducing Corpus-based Critical Translation Studies. Shandong Foreign Languages Teaching Journal, 41(4), 131–135. https://link.cnki.net/doi/10.16482/j.sdwy37-1026.2020-04-014
Derner, E., de la Fuente, S. S., Gutiérrez, Y., Moreda, P., & Oliver, N. (2024). Leveraging Large Language Models to Measure Gender Bias in Gendered Languages.