Beyond preferences in ai alignment

T Zhi-Xuan, M Carroll, M Franklin, H Ashton - Philosophical Studies, 2024 - Springer
The dominant practice of AI alignment assumes (1) that preferences are an adequate
representation of human values,(2) that human rationality can be understood in terms of …

When is it acceptable to break the rules? Knowledge representation of moral judgements based on empirical data

E Awad, S Levine, A Loreggia, N Mattei… - Autonomous Agents and …, 2024 - Springer
Constraining the actions of AI systems is one promising way to ensure that these systems
behave in a way that is morally acceptable to humans. But constraints alone come with …

Preferences and ethical principles in decision making

A Loreggia, N Mattei, F Rossi, KB Venable - Proceedings of the 2018 …, 2018 - dl.acm.org
If we want people to trust AI systems, we need to provide the systems we create with the
ability to discriminate between what humans would consider good and bad decisions. The …

Flexible representative democracy: An introduction with binary issues

B Abramowitz, N Mattei - Social Choice and Welfare, 2024 - Springer
Abstract We introduce Flexible Representative Democracy (FRD), a novel hybrid of
Representative Democracy and Direct Democracy in which voters can alter the issue …

Probabilistic conditional preference networks

D Bigot, B Zanuttini, H Fargier, J Mengin - arXiv preprint arXiv:1309.6817, 2013 - arxiv.org
In order to represent the preferences of a group of individuals, we introduce Probabilistic CP-
nets (PCP-nets). PCP-nets provide a compact language for representing probability …

On the equivalence of optimal recommendation sets and myopically optimal query sets

P Viappiani, C Boutilier - Artificial Intelligence, 2020 - Elsevier
Preference elicitation is an important component in many AI applications, including decision
support and recommender systems. Such systems must assess user preferences, based on …

[PDF][PDF] A notion of distance between cp-nets

A Loreggia, N Mattei, F Rossi, KB Venable - Proc. of AAMAS, 2018 - mpref-2018.preflib.org
In many scenarios including multi-agent systems and recommender systems, user
preference play a key role in driving the decisions the system makes. Thus it is important to …

Reasoning with PCP-nets

C Cornelio, J Goldsmith, U Grandi, N Mattei… - Journal of Artificial …, 2021 - jair.org
We introduce PCP-nets, a formalism to model qualitative conditional preferences with
probabilistic uncertainty. PCP-nets generalise CP-nets by allowing for uncertainty over the …

[PDF][PDF] Reasoning with PCP-nets in a Multi-Agent Context.

C Cornelio, U Grandi, J Goldsmith, N Mattei, F Rossi… - AAMAS, 2015 - academia.edu
ABSTRACT PCP-nets generalize CP-nets to model conditional preferences with
probabilistic uncertainty. In this paper we use PCP-nets in a multiagent context to compactly …

Uniform random generation and dominance testing for CP-nets

TE Allen, J Goldsmith, HE Justice, N Mattei… - Journal of Artificial …, 2017 - jair.org
The generation of preferences represented as CP-nets for experiments and empirical testing
has typically been done in an ad hoc manner that may have introduced a large statistical …