Research Article

AI vs. Human: Reconciling Autonomy and Governance in Decision-Making

Dowson LiuRapidsDB, Inc. Xue LieXomAI Limited*

* Corresponding author: [email protected]

Abstract

This report addresses the escalating conflict between decision-making processes augmented by artificial intelligence and the safeguarding of human autonomy. The focal point of our investigation rests on the ethical ramifications arising from the increasing integration of AI across crucial sectors. The analysis considers applications in areas such as healthcare, finance, and law, where AI enhances efficiency and scalability but also heightens risks of bias, opacity, and reduced accountability. Further, we delve into the concept of AI governance as a mechanism to ensure sustained societal oversight and control. Governance is approached not only as regulation but as an adaptive framework that incorporates transparency, inclusivity, and continuous monitoring to address emerging challenges. The objective is to elucidate the inherent challenges in harmonizing the efficiency and scalability offered by AI systems with the imperative of preserving human agency and ethical considerations in decision-making frameworks. By synthesizing sectoral impacts, ethical concerns, and governance strategies, the report highlights both the transformative promise of AI and the urgent need for policies that safeguard fairness and human values. The report provides an overview of the current landscape, highlighting potential risks and proposing avenues for future research and policy development in the realm of AI governance.

Keywords: AI Governance; Human Autonomy; Ethical Implications; Decision-Making; AI Integration
Published: September 9, 2025
DOI: 10.54254/2753-7064/2025.KM26716
Volume: CHR Vol.80
pp. 81-86
Download PDF

References

  1. Zhou Y, Chia MA, Wagner S, Ayhan MS, Williamson DJ, Struyven R, et al. A foundation model for generalizable disease detection from retinal images. Nature. 2023
  2. Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature. 2023
  3. Seyyed-Kalantari L, Zhang H, McDermott MBA, Chen IY, Ghassemi M. Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nature Medicine. 2021
  4. Arora A, Alderman J, Palmer J, Ganapathi S, Laws E, McCradden MD, et al. The value of standards for health datasets in artificial intelligence-based applications. Nature Medicine. 2023
  5. Yip MC, Salcudean SE, Goldberg K, Althoefer K, Menciassi A, Opfermann JD, et al. Artificial intelligence meets medical robotics. Science. 2023
  6. Varghese C, Harrison EM, O’Grady G, Topol EJ. Artificial intelligence in surgery. Nature Medicine. 2024
  7. Obermeyer Z, Powers BW, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019
  8. Pearl J. Causality. 2009
  9. Caliskan A, Bryson JJ, Narayanan A. Semantics derived automatically from language corpora contain human-like biases. Science. 2017
  10. Mehrabi N, Morstatter F, Saxena NA, Lerman K, Galstyan A. A survey on bias and fairness in machine learning. ACM Computing Surveys. 2021
  11. Pessach D, Shmueli E. A review on fairness in machine learning. ACM Computing Surveys. 2022;
  12. Benjamin R. Assessing risk, automating racism. Science. 2019
  13. Mittelstadt B, Allo P, Taddeo M, Wachter S, Floridi L. The ethics of algorithms: Mapping the debate. Big Data & Society. 2016
  14. Wang C, Liu S, Yang H, Jiu-lin G, Wu Y, Liu J. Ethical considerations of using ChatGPT in health care. Journal of Medical Internet Research. 2023
  15. Birhane A. Algorithmic injustice: A relational ethics approach. Patterns. 2021
  16. Ferrara E. Fairness and bias in artificial intelligence: A brief survey of sources, impacts, and mitigation strategies. Sci. 2023
  17. Ferryman K, Mackintosh M, Ghassemi M. Considering biased data as informative artifacts in AI-assisted health care. New England Journal of Medicine. 2023
  18. Cerdeña JP, Plaisime MV, Tsai J. From race-based to race-conscious medicine: How anti-racist uprisings call us to act. The Lancet. 2020
  19. Didier C, Duan W, Dupuy J, Guston DH, Yong-mou L, Cerezo JAL, et al. Acknowledging AI’s dark side. Science. 2015
  20. Liu X, Rivera SC, Moher D, Calvert M, Denniston AK, Chan A, et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension. Nature Medicine. 2020
  21. Nosek BA, Alter G, Banks GC, Borsboom D, Bowman S, Breckler SJ, et al. Promoting an open research culture. Science. 2015
  22. Fiume M, Cupák M, Keenan S, Rambla J, Torre S de la, Dyke SOM, et al. Federated discovery and sharing of genomic data using beacons. Nature Biotechnology. 2019
  23. Hennink M, Kaiser BN. Sample sizes for saturation in qualitative research: A systematic review of empirical tests. Social Science & Medicine. 2021
  24. Hacker P, Engel A, Mauer M. Regulating ChatGPT and other large generative AI models. 2022 ACM Conference on Fairness, Accountability, and Transparency. 2023
  25. Díaz-Rodríguez N, Ser JD, Coeckelbergh M, Prado ML de, Herrera–Viedma E, Herrera F. Connecting the dots in trustworthy artificial intelligence: From AI principles, ethics, and key requirements to responsible AI systems and regulation. Information Fusion. 2023
  26. Fahrenkamp-Uppenbrink J. An ethical way forward for AI. Science. 2018
  27. Kelly C, Karthikesalingam A, Suleyman M, Corrado GS, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Medicine. 2019
  28. Kukutai T. How indigenous communities in new zealand are protecting their data. Science. 2024