Communications in Humanities Research ISSN: 2753-7072
Home> Volumes> Volume CHR Vol.123> Article
Research Article

Ethical Controversies in AI-Driven Risk Control and Content Moderation on Social Platforms—A Case Study of Xiaohongshu

Chen Gong*
The University of Sydney

* Corresponding author: [email protected]

Abstract

The use of artificial intelligence (AI) to identify and manage content risks on social platforms is growing. It raises ethical questions about uncertain classifications, proportionate intervention and opportunities to challenge decisions. This paper examines Xiaohongshu through a qualitative documentary case study comprising a technical publication, a regulatory document and three original news reports. The analysis distinguishes source identification, harmfulness assessment and moderation action, and examines the relationship between internal explanations and user-facing remedies. The selected documents separately describe evidence for reviewers, information for audiences and appeal access, leaving their integration unevaluated. This study argues that technical explanations alone do not establish user-facing procedural protection, understandable reasons and accessible correction are also necessary. Source labels can provide transparency without establishing harm, while stronger restrictions require an additional justification appropriate to their consequences. Differentiated review, bounded disclosure and traceable appeals are proposed as design requirements whose effectiveness remains to be evaluated. The contribution emphasizes linking content-safety objectives with user protections in platform governance.

Keywords: artificial intelligence; risk control; content moderation; platform ethics; Xiaohongshu
Published: November 3, 2026
DOI: 10.54254/2753-7064/2026.BA38619
Volume: CHR Vol.123
pp. 180-186
Download PDF

References

  1. Gorwa, R., Binns, R., & Katzenbach, C. (2020). Algorithmic content moderation: Technical and political challenges in the automation of platform governance.Big Data & Society, 7(1), 1–15. https://doi.org/10.1177/2053951719897945
  2. Gillespie, T. (2020). Content moderation, AI, and the question of scale.Big Data & Society, 7(2), 1–5. https://doi.org/10.1177/2053951720943234
  3. Ju, R. (2022). Producing entrepreneurial citizens: Governmentality over and through Hong Kong influencers on Xiaohongshu (Red).Policy & Internet, 14(3), 618–632. https://doi.org/10.1002/poi3.324
  4. Suzor, N. P., West, S. M., Quodling, A., & York, J. (2019). What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation.International Journal of Communication, 13, 1526–1543. https://ijoc.org/index.php/ijoc/article/view/9736
  5. Jhaver, S., Bruckman, A., & Gilbert, E. (2019). Does transparency in moderation really matter?: User behavior after content removal explanations on Reddit.Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), Article 150, 1–27. https://doi.org/10.1145/3359252
  6. Are, C. (2025). 'Dysfunctional' appeals and failures of algorithmic justice in Instagram and TikTok content moderation.Information, Communication & Society, 28(11), 1997–2014. https://doi.org/10.1080/1369118X.2024.2396621
  7. Bowen, G. A. (2009). Document analysis as a qualitative research method.Qualitative Research Journal, 9(2), 27–40. https://doi.org/10.3316/QRJ0902027
  8. Li, A., Jin, W., Tong, J., Qin, P., Li, J., & Lu, G. (2026). Towards trustworthy multimodal moderation via policy-aligned reasoning and hierarchical labeling. InProceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1(pp. 2278–2289). ACM. https://doi.org/10.1145/3770854.3783934
  9. Cyberspace Administration of China, Ministry of Industry and Information Technology, Ministry of Public Security, & National Radio and Television Administration. (2025, March 14). Notice on issuing the Measures for Labeling Content Generated or Synthesized by Artificial Intelligence [in Chinese]. https://www.cac.gov.cn/2025-03/14/c_1743654684782215.htm
  10. Yang, L., & Fan, W. (2025, March 18). AI content labeling comes under stronger regulation: Testing implementation across 23 mainstream platforms [in Chinese].Southern Metropolis Daily (Nanfang Plus). https://static.nfnews.com/content/202503/18/c11095123.html?enterColumnId=2556
  11. Xiao, X., Zhang, X., & Bai, J. (2025, September 4). First test of AI content "carrying identification": Which of 35 applications slip through the net? [in Chinese].21st Century Business Herald. https://www.21jingji.com/article/20250904/herald/ce1753b0474be884a904a4c5aef8d53e.html
  12. Yang, M. (2026, April 27). Focusing on AI governance and supporting quality creation: Xiaohongshu announces its AI governance position for the first time [in Chinese].Economic Information Daily Online. https://www.jjckb.cn/20260427/a1a0a208bc244043bbfe3b2d2b5f9dec/c.html
  13. Ruckenstein, M., & Turunen, L. L. M. (2020). Re-humanizing the platform: Content moderators and the logic of care.New Media & Society, 22(6), 1026–1042. https://doi.org/10.1177/1461444819875990