AI and Big Data Resources

Perhaps never in the history of science has a suite of technologies inspired more work to identify ethical and governance issues, and suggest best practices. Institutional, academic, governmental and other organizations have generated numerous reports, white papers and analyses – so many that sorting and tracking them is a challenge. A selection of some of these documents is available here.

Click here to return to the  "Overview" section. 

Adam Harvey/megapixels.cc. Images from the MegaFace face recognition training and benchmarking dataset

World Health Organization

The "WHO Guidance on Ethics & Governance of Artificial Intelligence for Health" is the product of 18 months of deliberation amongst leading experts in ethics, digital technology, law, human rights, as well as experts from Ministries of Health." Several Collaborating Centers, including that at the University of Miami, contributed to the document, which is available here. An online course based on the report, and to which UM also contributed, is here. The WHO's "Ethics and governance of artificial intelligence for health: guidance on large multi-modal models," released in January 2024, is available here. See also "Ageism in artificial intelligence for health."

Professional, Academic Societies

• American College of Physicians
  • Artificial Intelligence in the Provision of Health Care: An American College of Physicians Policy Position Paper (2024)
• American Medical Association
  • Principles for Augmented Intelligence Development, Deployment, and Use (2023)
• Association for Computing Machinery
  
  • Statement on Principles for Responsible Algorithmic Systems (2022)
• Council of Canadian Academies
  
  • Connecting the Dots: The Expert Panel on Health Data Sharing (2023)
• Federation of State Medical Boards
  • Navigating the Responsible and Ethical Incorporation of Artificial Intelligence into Clinical Practice (2024)
• Institute of Electrical and Electronic Engineers (IEEE) Advancing Technology for Humanity
  • Ethically Aligned Design. This work is published under the auspices of the IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems for the purposes of furthering public understanding of the importance of addressing ethical considerations in the design of autonomous and intelligent systems.
• National Academy of Medicine
  • Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril (2019)
  • Artificial Intelligence Code of Conduct (2023)
  • Artificial Intelligence in Health, Health Care, and Biomedical Science: An AI Code of Conduct Principles and Commitments Discussion Draft (2024)
• National Academies of Sciences, Engineering, Medicine
  • Planning for Long-Term Use of Biomedical Data: Proceedings of a Workshop (2020)
• National Academy of Sciences, the Annenberg Public Policy Center of the University of Pennsylvania, and the Annenberg Foundation Trust at Sunnylands
  • Protecting scientific integrity in an age of generative AI (2024)
• Nuffield Council on Bioethics
  • Artificial Intelligence on Healthcare and Research. Ethical Considerations for the use of AI in healthcare and research

NGOs

• Center for Democracy & Technology (CDT)
  • AI and Machine Learning
• Coalition for Health AI
  • Blueprint for Trustworthy AI Implementation Guidance and Assurance for Healthcare (2023)
  • Assurance Standards Guide and Assurance Reporting Checklists (2024)
• Institute for Healthcare Improvement
  • Patient Safety and Artificial Intelligence: Opportunities and Challenges for Care Delivery (2024)
• MITRE
  • Varia
• Organisation for Economic Co-operation and Development (OECD)
  • Principles for Trustworthy AI (2020, 2024)
  • Effective governance of AI and its particular challenges
• Sage Bionetworks
  • Bringing Structure and Design to Data Governance
  •  Mechanisms to Govern Responsible Sharing of Open Data: A Progress Report
• UNESCO
  • Artificial intelligence with human values for sustainable development
  • Recommendation on the Ethics of Artificial Intelligence (2021)
• United Nations
  • A UN system-wide strategic approach and roadmap for supporting capacity development on artificial intelligence
• World Economic Forum
  • Model AI Governance Framework
• World Health Organization
  • Guidance on ethics and governance of artificial intelligence for health (2021)
  • Ethics and governance of artificial intelligence for health: guidance on large multi-modal models (2024)
    
  • Global Initiative on AI for Health (2024)

Governments [see also "Regional Initiatives," below]

• Chile
  • Ministerio de Ciencia, Conocimiento, Tecnología e Innovación, Política Nacional de Inteligencia Artificial (2021)
  • Comisión “Desafíos del Futuro, Ciencia Tecnología e Innovación," Inteligencia Artificial para Chile: la urgencia de desarrollar una estrategia (2019)
• Council of Europe
  • The Impact of Artificial Intelligence on the Doctor Patient Relationship 2021. 
  • Consolidated Working Draft of the Framework Convention on Artificial Intelligence, Human Rights, Democracy and the Rule of Law (2023)
• European Commission
  • Artificial Intelligence Act, a comprehensive law (2024); cf. "Shaping Europe's digital future"; and Ada Lovelace Institute, Discussion Paper: Inclusive AI Governance (2023)
  • Analysis on AI in medical Device Legislation (2020)
  • Medical Artificial Intelligence: The European Legal Perspective (2021)
  • White Paper on Artificial Intelligence - A European approach to excellence and trust. (2020). Cf. COCIR. The purpose of this White Paper is to set out policy options on how to address risks associated with the use of Artificial Intelligence.
• European Parliament
  • The ethics of artificial intelligence: Issues and initiatives (2020)
  • The ethics of artificial intelligence: Issues and initiatives. This study deals with the ethical implications and moral questions that arise from the development and implementation of artificial intelligence (AI) technologies.
• United Kingdom
  • Implementing the UK’s AI regulatory principles: initial guidance for regulators (2024)
• Vatican
  • Artificial Intelligence and Peace (2024)

U.S. Government

• Food & Drug Administration
  • Digital Health Center of Excellence 
  • Artificial Intelligence/Machine Learning (AI/ML)-Based Software as a Medical Device (SaMD) Action Plan (2021)
  • Good Machine Learning Practice for Medical Device Development: Guiding Principles (2021)
  • Marketing Submission Recommendations for a Predetermined Change Control Plan for Artificial Intelligence/Machine Learning (AI/ML)-Enabled Device Software Functions. Draft Guidance for Industry and Food and Drug Administration Staff (2023)
• General Accounting Office
  • Artificial Intelligence in Health Care: Benefits and Challenges of Machine Learning Technologies for Medical Diagnostics  (2022)
• National Institutes of Health
  
  • Artificial Intelligence Working Group Update, Advisory Committee to the Director (2019)
  • Artificial Intelligence in Research: Policy Considerations and Guidance
• National Institute of Standards and Technology (NIST)
  • Research Data Framework (RDaF): Motivation, Development, and A Preliminary Framework Core (2021)
  • Towards a Standard for Identifying and Managing Bias in Artificial Intelligence (2022)
  • Artificial Intelligence Risk Management Framework (2023)
• Office of the National Coordinator for Health Information Technology (ONC)
  • JASON Task Force Report (2014)
  • Sharing Genomic Data and Information for Patient Care via Application Programming Interfaces (2022)
  • Health Data, Technology, and Interoperability: Certification Program Updates, Algorithm Transparency, and Information Sharing (2024)
• U.S. Veterans Administration
  • Ethical Principles for Access to and Use of Veteran Data (2021)
• White House
  • Blueprint for an AI Bill of Rights (2022)
  • Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence (2023)
  • Office of Management and Budget, Advancing Governance, Innovation, and Risk Management for Agency Use of Artificial Intelligence (2024)
  • Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence (2024)

Academia

• SHERPA
  • EU-funded project which analyses how AI and analytics impact ethics and human rights, Shaping the Ethical Dimensions of Smart Information Systems.
• Stanford University,  Measuring Trends in AI (2024)

Law, Legislation, Governance

• Clearinghouse Project, a University of North Carolina School of Law resource.
• International Medical Device Regulators Forum, an international group of medical device regulators.
• Datos Protegidos, a Chilean site devoted to data protection, privacy law, cybersecurity, etc.
• Data-Driven Decision Making. Law, Ethics, Robotics, Health. Open Access Series of the Interdepartmental Research Centre, European Centre for Law, Science and New Technologies (ECLT), University of Pavia. 

Military and Warfare

• U.S. Department of Defense
  • Ethical Principles for Using Artificial Intelligence in Warfare (2020)
  • Defense Innovation Unit, Responsible AI Guidelines in Practice (2021)
  • Department of the Air Force's NIPRGPT (2024)

Journals

• AI and Ethics,Springer
• NEJM AI

Biomedical Informatics: History and Miscellany

• U.S. National Library of Medicine
  • Long Range Plan (1987)
• UK Data Service
  • Big Data and Data Sharing: Ethical issues. This is a brief introduction to ethical issues arising in social research with big data.
• United States Department of Defense
  • Ethical Principles for Using Artificial Intelligence in Warfare.
  • Ethics of AI in Radiology: European and North American Multisociety Statement. This statement arises from the multi-national radiology community's desire to examine the ethics and code of behavior for artificial intelligence (AI) in radiology.
• Stanford Encyclopedia of Philosophy
  • Ethics of Artificial Intelligence and Robotics. A comprehensive approach to ethical concerns in response for the use of new technologies.
• European Parliament 
  • EU guidelines on ethics in artificial intelligence: Context and implementation. This document aims to shed some light on the ethical rules that are now recommended when designing, developing, deploying, implementing or using AI products and services in the EU
• OECD
  • Going Digital: Shaping Policies, Improving Lives Organization for Economic Cooperation and Development This report presents key insights and policy messages from the OECD Going Digital project, which was carried out over 2017-18 under the leadership of the OECD Committee on Digital Economy Policy.
    
• Baylor College of Medicine: Center for Medical Ethics and Health Policy
  • Medical Information Commons Project, explores the ethical, legal, and social implications of health-related data sharing and various non-technical challenges to the formation and sustainability of commons.
• Federal Register, Vol. 84, No. 31
  • Guidance for Regulation of Artificial Intelligence Applications in the U.S.: Executive Order 13859, "Maintaining American Leadership in Artificial Intelligence".  Thursday, February 14, 2019.

Think Tanks

• The Hastings Center
  • Control and Responsible Innovation in the Development of AI and Robotics Draft Final Report
• Rand Corporation
  • "Face Recognition Technologies: Designing Systems that Protect Privacy and Prevent Bias." Report is "intended to help improve U.S. Department of Homeland Security (DHS) acquisition and oversight of FRTs by describing their opportunities and challenges."

Regional Initiatives

• Nordic Council of Ministers, Nordic Ethical AI Expert Group
  • Policy Recommendations for Ethical and Responsible AI (2024)
• OECD
  • The Strategic and Responsible Use of Artificial Intelligence in the Public Sector of Latin America and the Caribbean 2022. 
• The Law Library of Congress, Global Legal Research Directorate
  
  •  Regulation of Artificial Intelligence in Selected Jurisdictions (2019)
• AI Latin American Summit Proceedings of the January 2020 Artificial Intelligence Latin American Summit. This report offers a comprehensive description of the current AI governance in the region, perspectives for the use of AI in several Latin American countries, and recommendations for AI use in the judiciary, industry, education, and health sectors.

Other and Miscellaneous

• Oliver Patel, AstraZeneca, AI Governance Tracker Handbook [LinkedIn]

Creation of this resource was supported by a grant from the WHO. Please send corrections and suggestions for additions to ethics@miami.edu.

October 2024