AI vs. Human: Reconciling Autonomy and Governance in Decision-Making
Abstract
This report addresses the escalating conflict between decision-making processes augmented by artificial intelligence and the safeguarding of human autonomy. The focal point of our investigation rests on the ethical ramifications arising from the increasing integration of AI across crucial sectors. The analysis considers applications in areas such as healthcare, finance, and law, where AI enhances efficiency and scalability but also heightens risks of bias, opacity, and reduced accountability. Further, we delve into the concept of AI governance as a mechanism to ensure sustained societal oversight and control. Governance is approached not only as regulation but as an adaptive framework that incorporates transparency, inclusivity, and continuous monitoring to address emerging challenges. The objective is to elucidate the inherent challenges in harmonizing the efficiency and scalability offered by AI systems with the imperative of preserving human agency and ethical considerations in decision-making frameworks. By synthesizing sectoral impacts, ethical concerns, and governance strategies, the report highlights both the transformative promise of AI and the urgent need for policies that safeguard fairness and human values. The report provides an overview of the current landscape, highlighting potential risks and proposing avenues for future research and policy development in the realm of AI governance.
References
- Zhou Y, Chia MA, Wagner S, Ayhan MS, Williamson DJ, Struyven R, et al. A foundation model for generalizable disease detection from retinal images. Nature. 2023
- Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature. 2023
- Seyyed-Kalantari L, Zhang H, McDermott MBA, Chen IY, Ghassemi M. Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nature Medicine. 2021
- Arora A, Alderman J, Palmer J, Ganapathi S, Laws E, McCradden MD, et al. The value of standards for health datasets in artificial intelligence-based applications. Nature Medicine. 2023
- Yip MC, Salcudean SE, Goldberg K, Althoefer K, Menciassi A, Opfermann JD, et al. Artificial intelligence meets medical robotics. Science. 2023
- Varghese C, Harrison EM, O’Grady G, Topol EJ. Artificial intelligence in surgery. Nature Medicine. 2024
- Obermeyer Z, Powers BW, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019
- Pearl J. Causality. 2009
- Caliskan A, Bryson JJ, Narayanan A. Semantics derived automatically from language corpora contain human-like biases. Science. 2017
- Mehrabi N, Morstatter F, Saxena NA, Lerman K, Galstyan A. A survey on bias and fairness in machine learning. ACM Computing Surveys. 2021
- Pessach D, Shmueli E. A review on fairness in machine learning. ACM Computing Surveys. 2022;
- Benjamin R. Assessing risk, automating racism. Science. 2019
- Mittelstadt B, Allo P, Taddeo M, Wachter S, Floridi L. The ethics of algorithms: Mapping the debate. Big Data & Society. 2016
- Wang C, Liu S, Yang H, Jiu-lin G, Wu Y, Liu J. Ethical considerations of using ChatGPT in health care. Journal of Medical Internet Research. 2023
- Birhane A. Algorithmic injustice: A relational ethics approach. Patterns. 2021
- Ferrara E. Fairness and bias in artificial intelligence: A brief survey of sources, impacts, and mitigation strategies. Sci. 2023
- Ferryman K, Mackintosh M, Ghassemi M. Considering biased data as informative artifacts in AI-assisted health care. New England Journal of Medicine. 2023
- Cerdeña JP, Plaisime MV, Tsai J. From race-based to race-conscious medicine: How anti-racist uprisings call us to act. The Lancet. 2020
- Didier C, Duan W, Dupuy J, Guston DH, Yong-mou L, Cerezo JAL, et al. Acknowledging AI’s dark side. Science. 2015
- Liu X, Rivera SC, Moher D, Calvert M, Denniston AK, Chan A, et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension. Nature Medicine. 2020
- Nosek BA, Alter G, Banks GC, Borsboom D, Bowman S, Breckler SJ, et al. Promoting an open research culture. Science. 2015
- Fiume M, Cupák M, Keenan S, Rambla J, Torre S de la, Dyke SOM, et al. Federated discovery and sharing of genomic data using beacons. Nature Biotechnology. 2019
- Hennink M, Kaiser BN. Sample sizes for saturation in qualitative research: A systematic review of empirical tests. Social Science & Medicine. 2021
- Hacker P, Engel A, Mauer M. Regulating ChatGPT and other large generative AI models. 2022 ACM Conference on Fairness, Accountability, and Transparency. 2023
- Díaz-Rodríguez N, Ser JD, Coeckelbergh M, Prado ML de, Herrera–Viedma E, Herrera F. Connecting the dots in trustworthy artificial intelligence: From AI principles, ethics, and key requirements to responsible AI systems and regulation. Information Fusion. 2023
- Fahrenkamp-Uppenbrink J. An ethical way forward for AI. Science. 2018
- Kelly C, Karthikesalingam A, Suleyman M, Corrado GS, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Medicine. 2019
- Kukutai T. How indigenous communities in new zealand are protecting their data. Science. 2024