When Artificial Intelligence Fails
The Emerging Role of Incident Databases
Copyright (c) 2023 Rodrigues Rowena, Resseguier Anais, Santiago Nicole
This work is licensed under a Creative Commons Attribution 4.0 International License.
Abstract
Diverse initiatives promote the responsible development, deployment and use of Artificial Intelligence (AI). AI incident databases have emerged as a valuable and timely learning resource and tool in AI governance. This article assesses the value of such databases and outlines how this value can be enhanced. It reviews four databases: the AI Incident Database, the AI, Algorithmic, and Automation Incidents and Controversies Repository, the AI Incident Tracker and Where in the World Is AI. The article provides a descriptive analysis of these databases, examines their objectives, and locates them within the landscape of initiatives that advance responsible AI. It reflects on their primary objective, i.e. learning from mistakes to avoid them in the future, and explores how they might benefit diverse stakeholders. The article supports the broader uptake of these databases and recommends four key actions to enhance their value.
Keywords:
How to Cite
References
AI Global (2020). Responsible AI Design Assistant. Online: https://bit.ly/3uyI6MK
AIAAIC (2023a, November 4). About the Repository. Online: https://bit.ly/47tl5th
AIAAIC (2023b, August 3). Repository users and endorsements. Online: https://bit.ly/49XER1N
AIAAIC (2023c, November 22). Classifications and Definitions. Online: https://bit.ly/3sTmk5T
AIAAIC (2023d, November 22). Governance. Online: https://www.aiaaic.org/aiaaic-repository/governance
AIAAIC (2023e, November 22). Repository. Online: https://www.aiaaic.org/aiaaic-repository
AIAAIC (2023f, November 22). Research and Advocacy Citations and Mentions. Online: https://www.aiaaic.org/about-aiaaic/research-citations-mentions
AIAAIC (2023g, November 22). Team. Online: https://www.aiaaic.org/about-aiaaic/team
AIID (2023). Editors Guide. Online: https://incidentdatabase.ai/editors-guide
Ethical ML (2023). Awesome Artificial Intelligence Guidelines. Online: https://github.com/EthicalML/awesome-artificial-intelligence-guidelines
European Commission (2020). White Paper on Artificial Intelligence – A European Approach to Excellence and Trust. Online: https://bit.ly/40V34BA
European Commission (2021). Proposal for a Regulation of the European Parliament and of the Council Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act) and Amending Certain Union Legislative Acts. Online: https://bit.ly/47V0oX7
Google Cloud Tech (2019). Making Friends with Machine Learning: Regression. Online: https://www.youtube.com/watch?v=WNvOtwP_yf4
Hofer, C. W. & Schendel, D. (1978). Strategy Formulation: Analytical Concepts. West Publishing Company.
Jansen, P., Brey, P., Fox, A., Maas, J., Hillas, H., Wagner, N., Smith, P, Ouoch, I., Lamers, L., van Gein, H., Resseguier, A., Rodrigues, R., Wright, D. & Douglas, D. (2020). SIENNA D4.4: Ethical Analysis of AI and Robotics Technologies. Zenodo. Online: https://doi.org/10.5281/zenodo.4068082
Jobin, A., Ienca, M. & Vayena, E. (2019, September 1). The Global Landscape of AI Ethics Guidelines. Nature Machine Intelligence, 1(9), 389–399. Online: https://doi.org/10.1038/s42256-019-0088-2
McGregor, S. (2020). Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. Online: https://bit.ly/47AWliL
McGregor, S., Paeth, K. & Lam, K. (2022). Indexing AI Risks with Incidents, Issues, and Variants. Online: https://doi.org/10.48550/arXiv.2211.10384
Naurin, D. (2006). Transparency, Publicity, Accountability – The Missing Links. Swiss Political Science Review, 12(3), 90–98. Online: http://hdl.handle.net/1814/661
Partnership on AI (2023a). About. Online: https://partnershiponai.org/about/
Partnership on AI (2023b). AI Incident Database. Online: https://partnershiponai.org/aiincidentdatabase/
Pickton, D. W. & Wright, S. (1998). What’s SWOT in Strategic Analysis? Strategic Change, 7(2), 101–109. Online: https://doi.org/10.1002/(SICI)1099-1697(199803/04)7:2%3C101::AID-JSC332%3E3.0.CO;2-6
Rességuier, A. & Rodrigues, R. (2020). AI Ethics Should Not Remain Toothless! A Call to Bring Back the Teeth of Ethics. Big Data & Society, 7(2). Online: https://doi.org/10.1177/2053951720942541
Rodrigues, R., Siemaszko, K. & Warso, Z. (2019). SIENNA D4.2: Analysis of the Legal and Human Rights Requirements for AI and Robotics In and Outside the EU (Version V2.0). Zenodo. Online: https://doi.org/10.5281/zenodo.4066812
Siemaszko, K. Rodrigues, R. & Slokenberga, S. (2020). SIENNA D5.6: Recommendations for the Enhancement of the Existing Legal Frameworks for Genomics, Human Enhancement, and AI and Robotics (V2.0). Zenodo. Online: https://doi.org/10.5281/zenodo.4121082
Taplin, J. (2017). Move Fast and Break Things: How Facebook, Google, and Amazon Have Cornered Culture and What It Means for All of Us. Pan Macmillan.
Taneja, H. (2019). The Era of “Move Fast and Break Things” Is Over. Harvard Business Review. Online: https://bit.ly/47NUqag
The AI Incident Tracker (2023). Awesome Machine Learning Interpretability. Online: https://bit.ly/40ZnVUA
Ullah, M. H., Hazelton, J. & Nelson, P. F. (2021). Can Databases Facilitate Accountability? The Case of Australian Mercury Accounting Via the National Pollutant Inventory. Accounting. Auditing & Accountability Journal, 34(1), 164–193. Online: https://doi.org/10.1108/AAAJ-11-2017-3232
UNESCO (2021). Recommendation on the Ethics of Artificial Intelligence. Paris. Online: https://bit.ly/3sIvGS9
Wagner, B. (2018). Ethics as an Escape from Regulation: From Ethics-Washing to Ethics-Shopping. In E. Bayamlioğlu, I. Baraliuc, L. Janssens & M. Hildebrandt (Eds.), Being Profiled: Cogitas Ergo Sum: 10 Years of ‘Profiling the European Citizen’ (pp. 84–89). Amsterdam University Press.
Where in the World Is AI (2021). Global Map. Online: https://map.ai-global.org
This article draws from work conducted on the ethics and regulation of AI and new technologies in the EU-funded Horizon projects SIENNA (Grant Agreement Number: 741716) (https://www.sienna-project.eu), SHERPA (Grant Agreement Number: 786641) (https://www.project-sherpa.eu) and TechEthos (Grant Agreement Number: 101006249) (https://www.techethos.eu). This article reflects only the views and opinions of the authors and does not intend to reflect those of the database creator/managers/representatives or the European Commission. Neither they, nor the European Commission, are responsible for any use that may be made of the information it contains.