Title: Robustness and Explainability of Artificial Intelligence
Authors: HAMON RONANJUNKLEWITZ HENRIKSANCHEZ MARTIN JOSE IGNACIO
Publisher: Publications Office of the European Union
Publication Year: 2020
JRC N°: JRC119336
ISBN: 978-92-76-14660-5 (online)
ISSN: 1831-9424 (online)
Other Identifiers: EUR 30040 EN
OP KJ-NA-30040-EN-N (online)
URI: https://publications.jrc.ec.europa.eu/repository/handle/JRC119336
DOI: 10.2760/57493
Type: EUR - Scientific and Technical Research Reports
Abstract: In the light of the recent advances in artificial intelligence (AI), the serious negative consequences of its use for EU citizens and organisations have led to multiple initiatives from the European Commission to set up the principles of a trustworthy and secure AI. Among the identified requirements, the concepts of robustness and explainability of AI systems have emerged as key elements for a future regulation of this technology. This Technical Report by the European Commission Joint Research Centre (JRC) aims to contribute to this movement for the establishment of a sound regulatory framework for AI, by making the connection between the principles embodied in current regulations regarding to the cybersecurity of digital systems and the protection of data, the policy activities concerning AI, and the technical discussions within the scientific community of AI, in particular in the field of machine learning, that is largely at the origin of the recent advancements of this technology. The individual objectives of this report are to provide a policy-oriented description of the current perspectives of AI and its implications in society, an objective view on the current landscape of AI, focusing of the aspects of robustness and explainability. This also include a technical discussion of the current risks associated with AI in terms of security, safety, and data protection, and a presentation of the scientific solutions that are currently under active development in the AI community to mitigate these risks. This report puts forward several policy-related considerations for the attention of policy makers to establish a set of standardisation and certification tools for AI. First, the development of methodologies to evaluate the impacts of AI on society, built on the model of the Data Protection Impact Assessments (DPIA) introduced in the General Data Protection Regulation (GDPR), is discussed. Secondly, a focus is made on the establishment of methodologies to assess the robustness of systems that would be adapted to the context of use. This would come along with the identification of known vulnerabilities of AI systems, and the technical solutions that have been proposed in the scientific community to address them. Finally, the promotion of transparency systems in sensitive systems is discussed, through the implementation of explainability-by-design approaches in AI components that would provide guarantee of the respect of the fundamental rights.
JRC Directorate:Space, Security and Migration

Files in This Item:
File Description SizeFormat 
dpad_report.pdf1.92 MBAdobe PDFView/Open


Items in repository are protected by copyright, with all rights reserved, unless otherwise indicated.