When Artificial Intelligence Fails

The Emerging Role of Incident Databases

doi: 10.53116/pgaflr.7030


Diverse initiatives promote the responsible development, deployment and use of Artificial Intelligence (AI). AI incident databases have emerged as a valuable and timely learning resource and tool in AI governance. This article assesses the value of such databases and outlines how this value can be enhanced. It reviews four databases: the AI Incident Database, the AI, Algorithmic, and Automation Incidents and Controversies Repository, the AI Incident Tracker and Where in the World Is AI. The article provides a descriptive analysis of these databases, examines their objectives, and locates them within the landscape of initiatives that advance responsible AI. It reflects on their primary objective, i.e. learning from mistakes to avoid them in the future, and explores how they might benefit diverse stakeholders. The article supports the broader uptake of these databases and recommends four key actions to enhance their value.


Artificial Intelligence incident databases repositories ethical AI responsible technology controversies

How to Cite

Rodrigues, R., Resseguier, A., & Santiago, N. (2023). When Artificial Intelligence Fails: The Emerging Role of Incident Databases. Public Governance, Administration and Finances Law Review, 8(2), 17–28. https://doi.org/10.53116/pgaflr.7030


AI Global (2020). Responsible AI Design Assistant. Online: https://bit.ly/3uyI6MK

AIAAIC (2023a, November 4). About the Repository. Online: https://bit.ly/47tl5th

AIAAIC (2023b, August 3). Repository users and endorsements. Online: https://bit.ly/49XER1N

AIAAIC (2023c, November 22). Classifications and Definitions. Online: https://bit.ly/3sTmk5T

AIAAIC (2023d, November 22). Governance. Online: https://www.aiaaic.org/aiaaic-repository/governance

AIAAIC (2023e, November 22). Repository. Online: https://www.aiaaic.org/aiaaic-repository

AIAAIC (2023f, November 22). Research and Advocacy Citations and Mentions. Online: https://www.aiaaic.org/about-aiaaic/research-citations-mentions

AIAAIC (2023g, November 22). Team. Online: https://www.aiaaic.org/about-aiaaic/team

AIID (2023). Editors Guide. Online: https://incidentdatabase.ai/editors-guide

Ethical ML (2023). Awesome Artificial Intelligence Guidelines. Online: https://github.com/EthicalML/awesome-artificial-intelligence-guidelines

European Commission (2020). White Paper on Artificial Intelligence – A European Approach to Excellence and Trust. Online: https://bit.ly/40V34BA

European Commission (2021). Proposal for a Regulation of the European Parliament and of the Council Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act) and Amending Certain Union Legislative Acts. Online: https://bit.ly/47V0oX7

Google Cloud Tech (2019). Making Friends with Machine Learning: Regression. Online: https://www.youtube.com/watch?v=WNvOtwP_yf4

Hofer, C. W. & Schendel, D. (1978). Strategy Formulation: Analytical Concepts. West Publishing Company.

Jansen, P., Brey, P., Fox, A., Maas, J., Hillas, H., Wagner, N., Smith, P, Ouoch, I., Lamers, L., van Gein, H., Resseguier, A., Rodrigues, R., Wright, D. & Douglas, D. (2020). SIENNA D4.4: Ethical Analysis of AI and Robotics Technologies. Zenodo. Online: https://doi.org/10.5281/zenodo.4068082

Jobin, A., Ienca, M. & Vayena, E. (2019, September 1). The Global Landscape of AI Ethics Guidelines. Nature Machine Intelligence, 1(9), 389–399. Online: https://doi.org/10.1038/s42256-019-0088-2

McGregor, S. (2020). Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. Online: https://bit.ly/47AWliL

McGregor, S., Paeth, K. & Lam, K. (2022). Indexing AI Risks with Incidents, Issues, and Variants. Online: https://doi.org/10.48550/arXiv.2211.10384

Naurin, D. (2006). Transparency, Publicity, Accountability – The Missing Links. Swiss Political Science Review, 12(3), 90–98. Online: http://hdl.handle.net/1814/661

Partnership on AI (2023a). About. Online: https://partnershiponai.org/about/

Partnership on AI (2023b). AI Incident Database. Online: https://partnershiponai.org/aiincidentdatabase/

Pickton, D. W. & Wright, S. (1998). What’s SWOT in Strategic Analysis? Strategic Change, 7(2), 101–109. Online: https://doi.org/10.1002/(SICI)1099-1697(199803/04)7:2%3C101::AID-JSC332%3E3.0.CO;2-6

Rességuier, A. & Rodrigues, R. (2020). AI Ethics Should Not Remain Toothless! A Call to Bring Back the Teeth of Ethics. Big Data & Society, 7(2). Online: https://doi.org/10.1177/2053951720942541

Rodrigues, R., Siemaszko, K. & Warso, Z. (2019). SIENNA D4.2: Analysis of the Legal and Human Rights Requirements for AI and Robotics In and Outside the EU (Version V2.0). Zenodo. Online: https://doi.org/10.5281/zenodo.4066812

Siemaszko, K. Rodrigues, R. & Slokenberga, S. (2020). SIENNA D5.6: Recommendations for the Enhancement of the Existing Legal Frameworks for Genomics, Human Enhancement, and AI and Robotics (V2.0). Zenodo. Online: https://doi.org/10.5281/zenodo.4121082

Taplin, J. (2017). Move Fast and Break Things: How Facebook, Google, and Amazon Have Cornered Culture and What It Means for All of Us. Pan Macmillan.

Taneja, H. (2019). The Era of “Move Fast and Break Things” Is Over. Harvard Business Review. Online: https://bit.ly/47NUqag

The AI Incident Tracker (2023). Awesome Machine Learning Interpretability. Online: https://bit.ly/40ZnVUA

Ullah, M. H., Hazelton, J. & Nelson, P. F. (2021). Can Databases Facilitate Accountability? The Case of Australian Mercury Accounting Via the National Pollutant Inventory. Accounting. Auditing & Accountability Journal, 34(1), 164–193. Online: https://doi.org/10.1108/AAAJ-11-2017-3232

UNESCO (2021). Recommendation on the Ethics of Artificial Intelligence. Paris. Online: https://bit.ly/3sIvGS9

Wagner, B. (2018). Ethics as an Escape from Regulation: From Ethics-Washing to Ethics-Shopping. In E. Bayamlioğlu, I. Baraliuc, L. Janssens & M. Hildebrandt (Eds.), Being Profiled: Cogitas Ergo Sum: 10 Years of ‘Profiling the European Citizen’ (pp. 84–89). Amsterdam University Press.

Where in the World Is AI (2021). Global Map. Online: https://map.ai-global.org


Download data is not yet available.