A meta-summary of challenges in building products with ml components–collecting experiences from 4758+ practitioners

N Nahar, H Zhang, G Lewis, S Zhou… - 2023 IEEE/ACM 2nd …, 2023 - ieeexplore.ieee.org
Incorporating machine learning (ML) components into software products raises new
software-engineering challenges and exacerbates existing ones. Many researchers have …

Model evaluation for extreme risks

T Shevlane, S Farquhar, B Garfinkel, M Phuong… - arXiv preprint arXiv …, 2023 - arxiv.org
Current approaches to building general-purpose AI systems tend to produce systems with
both beneficial and harmful capabilities. Further progress in AI development could lead to …

Visibility into AI Agents

A Chan, C Ezell, M Kaufmann, K Wei… - The 2024 ACM …, 2024 - dl.acm.org
Increased delegation of commercial, scientific, governmental, and personal activities to AI
agents—systems capable of pursuing complex goals with limited supervision—may …

A Systematic Literature Review of Human-Centered, Ethical, and Responsible AI

M Tahaei, M Constantinides, D Quercia… - arXiv preprint arXiv …, 2023 - arxiv.org
As Artificial Intelligence (AI) continues to advance rapidly, it becomes increasingly important
to consider AI's ethical and societal implications. In this paper, we present a bottom-up …

Deep learning safety concerns in automated driving perception

S Abrecht, A Hirsch, S Raafatnia… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Recent advances in the field of deep learning and impressive performance of deep neural
networks (DNNs) for perception have resulted in an increased demand for their use in …

Farsight: Fostering Responsible AI Awareness During AI Application Prototyping

ZJ Wang, C Kulkarni, L Wilcox, M Terry… - Proceedings of the CHI …, 2024 - dl.acm.org
Prompt-based interfaces for Large Language Models (LLMs) have made prototyping and
building AI-powered applications easier than ever before. However, identifying potential …

Holistic safety and responsibility evaluations of advanced AI models

L Weidinger, J Barnhart, J Brennan… - arXiv preprint arXiv …, 2024 - arxiv.org
Safety and responsibility evaluations of advanced AI models are a critical but developing
field of research and practice. In the development of Google DeepMind's advanced AI …

What does it mean to be a responsible AI practitioner: An ontology of roles and skills

S Rismani, AJ Moon - Proceedings of the 2023 AAAI/ACM Conference …, 2023 - dl.acm.org
With the growing need to regulate AI systems across a wide variety of application domains, a
new set of occupations has emerged in the industry. The so-called responsible Artificial …

Towards a Non-Ideal Methodological Framework for Responsible ML

RK Mothilal, S Guha, SI Ahmed - arXiv preprint arXiv:2401.11131, 2024 - arxiv.org
Though ML practitioners increasingly employ various Responsible ML (RML) strategies,
their methodological approach in practice is still unclear. In particular, the constraints …

A collaborative, Human-Centred taxonomy of AI, algorithmic, and automation harms

G Abercrombie, D Benbouzid, P Giudici… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper introduces a collaborative, human-centered taxonomy of AI, algorithmic and
automation harms. We argue that existing taxonomies, while valuable, can be narrow …