Synthesis and properties of optimally value-aligned normative systems

N Montes, C Sierra - Journal of Artificial Intelligence Research, 2022 - jair.org
The value alignment problem is concerned with the design of systems that provably abide by
our human values. One approach to this challenge is through the leverage of prescriptive …

Axies: Identifying and evaluating context-specific values

E Liscio, MT van der Meer, LC Siebert… - 20th International …, 2021 - research.tudelft.nl
The pursuit of values drives human behavior and promotes cooperation. Existing research is
focused on general (eg, Schwartz) values that transcend contexts. However, context-specific …

Instilling moral value alignment by means of multi-objective reinforcement learning

M Rodriguez-Soto, M Serramia… - Ethics and Information …, 2022 - Springer
AI research is being challenged with ensuring that autonomous agents learn to behave
ethically, namely in alignment with moral values. Here, we propose a novel way of tackling …

[PDF][PDF] Value inference in sociotechnical systems

E Liscio, R Lera-Leri, F Bistaffa… - Proceedings of the …, 2023 - enricoliscio.github.io
As artificial agents become increasingly embedded in our society, we must ensure that their
behavior aligns with human values. Value alignment entails value inference, the process of …

What values should an agent align with? An empirical comparison of general and context-specific values

E Liscio, M van der Meer, LC Siebert… - Autonomous Agents and …, 2022 - Springer
The pursuit of values drives human behavior and promotes cooperation. Existing research is
focused on general values (eg, Schwartz) that transcend contexts. However, context-specific …

Towards pluralistic value alignment: Aggregating value systems through ℓp-regression

R Lera-Leri, F Bistaffa, M Serramia, M Lopez-Sanchez… - 2022 - openaccess.city.ac.uk
Dealing with the challenges of an interconnected globalised world requires to handle
plurality. This is no exception when considering value-aligned intelligent systems, since the …

[HTML][HTML] Aggregating value systems for decision support

RX Lera-Leri, E Liscio, F Bistaffa, CM Jonker… - Knowledge-Based …, 2024 - Elsevier
We adopt an emerging and prominent vision of human-centred Artificial Intelligence that
requires building trustworthy intelligent systems. Such systems should be capable of dealing …

Social Ranking Problems at the Interplay between Social Choice Theory and Coalitional Games

F Fritz, S Moretti, J Staudacher - Mathematics, 2023 - mdpi.com
This paper reviews the recent literature on the “social ranking problem”, that is, the problem
of converting group rankings into individual rankings. We introduce and categorize existing …

Estimating value preferences in a hybrid participatory system

LC Siebert, E Liscio, PK Murukannaiah… - HHAI2022 …, 2022 - ebooks.iospress.nl
We propose methods for an AI agent to estimate the value preferences of individuals in a
hybrid participatory system, considering a setting where participants make choices and …

Value engineering for autonomous agents

N Montes, N Osman, C Sierra, M Slavkovik - arXiv preprint arXiv …, 2023 - arxiv.org
Machine Ethics (ME) is concerned with the design of Artificial Moral Agents (AMAs), ie
autonomous agents capable of reasoning and behaving according to moral values …