Aya model: An instruction finetuned open-access multilingual language model

A Üstün, V Aryabumi, ZX Yong, WY Ko… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent breakthroughs in large language models (LLMs) have centered around a handful of
data-rich languages. What does it take to broaden access to breakthroughs beyond first …

Multilingual large language model: A survey of resources, taxonomy and frontiers

L Qin, Q Chen, Y Zhou, Z Chen, Y Li, L Liao… - arXiv preprint arXiv …, 2024 - arxiv.org
Multilingual Large Language Models are capable of using powerful Large Language
Models to handle and respond to queries in multiple languages, which achieves remarkable …

Coercing LLMs to do and reveal (almost) anything

J Geiping, A Stein, M Shu, K Saifullah, Y Wen… - arXiv preprint arXiv …, 2024 - arxiv.org
It has recently been shown that adversarial attacks on large language models (LLMs) can"
jailbreak" the model into making harmful statements. In this work, we argue that the spectrum …

Investigating cultural alignment of large language models

B AlKhamissi, M ElNokrashy, M AlKhamissi… - arXiv preprint arXiv …, 2024 - arxiv.org
The intricate relationship between language and culture has long been a subject of
exploration within the realm of linguistic anthropology. Large Language Models (LLMs) …

Jailbreakzoo: Survey, landscapes, and horizons in jailbreaking large language and vision-language models

H Jin, L Hu, X Li, P Zhang, C Chen, J Zhuang… - arXiv preprint arXiv …, 2024 - arxiv.org
The rapid evolution of artificial intelligence (AI) through developments in Large Language
Models (LLMs) and Vision-Language Models (VLMs) has brought significant advancements …

Adapting llms for efficient context processing through soft prompt compression

C Wang, Y Yang, R Li, D Sun, R Cai, Y Zhang… - Proceedings of the …, 2024 - dl.acm.org
The rapid advancement of Large Language Models (LLMs) has inaugurated a
transformative epoch in natural language processing, fostering unprecedented proficiency in …

Exploring Multilingual Human Value Concepts in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?

S Xu, W Dong, Z Guo, X Wu, D Xiong - arXiv preprint arXiv:2402.18120, 2024 - arxiv.org
Prior research in representation engineering has revealed that LLMs encode concepts
within their representation spaces, predominantly centered around English. In this study, we …

Preference tuning for toxicity mitigation generalizes across languages

X Li, ZX Yong, SH Bach - arXiv preprint arXiv:2406.16235, 2024 - arxiv.org
Detoxifying multilingual Large Language Models (LLMs) has become crucial due to their
increasing global use. In this work, we explore zero-shot cross-lingual generalization of …

[HTML][HTML] Equity in Digital Mental Health Interventions in the United States: Where to Next?

A Robinson, M Flom, VL Forman-Hoffman… - Journal of Medical …, 2024 - jmir.org
Health care technologies have the ability to bridge or hinder equitable care. Advocates of
digital mental health interventions (DMHIs) report that such technologies are poised to …

The multilingual alignment prism: Aligning global and local preferences to reduce harm

A Ahmadian, B Ermis, S Goldfarb-Tarrant… - arXiv preprint arXiv …, 2024 - arxiv.org
A key concern with the concept of" alignment" is the implicit question of" alignment to what?".
AI systems are increasingly used across the world, yet safety alignment is often focused on …