As artificial agents become increasingly embedded in our society, we must ensure that their
behavior aligns with human values. Value alignment entails value inference, the process of …

This paper addresses the question of how to align AI systems with human values and
situates it within a wider body of thought regarding technology and value. Far from existing …

AI alignment considers the overall problem of ensuring an AI produces desired outcomes,
without undesirable side effects. While often considered from the perspectives of safety and …

The rapid advancement of Large Language Models (LLMs) has attracted much attention to
value alignment for their responsible development. However, how to define values in this …

The pursuit of values drives human behavior and promotes cooperation. Existing research is
focused on general values (eg, Schwartz) that transcend contexts. However, context-specific …

Unsupervised learning algorithms are widely used for many important statistical tasks with
numerous applications in science and industry. Yet despite their prevalence, they have …

How can one build AI systems such that they pursue the goals their designers want them to
pursue? This is the alignment problem. Numerous authors have raised concerns that, as …

Large language models have been used as the foundation of highly sophisticated artificial
intelligences, capable of delivering human-like responses to probes about legal and moral …

Generative AI enables automated, effective manipulation at scale. Despite the growing
general ethical discussion around generative AI, the specific manipulation risks remain …

Ethics is concerned with what it is to live a flourishing life and what it is we morally owe to
others. The optimizing mindset prevalent among computer scientists and economists …