19 February 2024 | Malak Sadek¹ · Emma Kallina² · Thomas Bohné² · Céline Mougenot¹ · Rafael A. Calvo¹ · Stephen Cave²
This paper presents a scoping review of the challenges in implementing Responsible AI (RAI) guidelines in practice, identifying five key limitations: (1) abstract RAI principles leading to diverging interpretations, (2) narrow and conflicting values, (3) lack of RAI metrics, (4) fragmentation of the AI pipeline, and (5) lack of internal advocacy and accountability. The review highlights the gap between theoretical RAI principles and practical implementation, noting that RAI guidelines are often too abstract to guide real-world applications. The paper also discusses the challenges of reconciling conflicting values, the difficulty of operationalizing RAI success metrics, and the fragmentation of the AI development process. It emphasizes the need for a more practical, participatory approach to RAI, incorporating diverse perspectives and stakeholder input. The paper recommends solutions such as participatory interpretation, adopting wider perspectives, and operationalizing RAI metrics. These solutions aim to address the identified challenges by fostering collaboration, considering socio-technical contexts, and developing concrete, measurable outcomes. The paper concludes that a multidisciplinary approach is necessary to ensure that RAI guidelines are effectively implemented in practice.This paper presents a scoping review of the challenges in implementing Responsible AI (RAI) guidelines in practice, identifying five key limitations: (1) abstract RAI principles leading to diverging interpretations, (2) narrow and conflicting values, (3) lack of RAI metrics, (4) fragmentation of the AI pipeline, and (5) lack of internal advocacy and accountability. The review highlights the gap between theoretical RAI principles and practical implementation, noting that RAI guidelines are often too abstract to guide real-world applications. The paper also discusses the challenges of reconciling conflicting values, the difficulty of operationalizing RAI success metrics, and the fragmentation of the AI development process. It emphasizes the need for a more practical, participatory approach to RAI, incorporating diverse perspectives and stakeholder input. The paper recommends solutions such as participatory interpretation, adopting wider perspectives, and operationalizing RAI metrics. These solutions aim to address the identified challenges by fostering collaboration, considering socio-technical contexts, and developing concrete, measurable outcomes. The paper concludes that a multidisciplinary approach is necessary to ensure that RAI guidelines are effectively implemented in practice.