[PDF][PDF] Multi-fact: Assessing multilingual llms' multi-regional knowledge using factscore

S Shafayat, E Kim, J Oh, A Oh - arXiv preprint arXiv …, 2024 - globalaicultures.github.io
Abstract Large Language Models (LLMs) are prone to factuality hallucination, generating
text that contradicts established knowledge. While extensive research has addressed this in …

Evaluating cultural adaptability of a large language model via simulation of synthetic personas

L Kwok, M Bravansky, LD Griffin - arXiv preprint arXiv:2408.06929, 2024 - arxiv.org
The success of Large Language Models (LLMs) in multicultural environments hinges on
their ability to understand users' diverse cultural backgrounds. We measure this capability by …

Survey of cultural awareness in language models: Text and beyond

S Pawar, J Park, J Jin, A Arora, J Myung… - arXiv preprint arXiv …, 2024 - arxiv.org
Large-scale deployment of large language models (LLMs) in various applications, such as
chatbots and virtual assistants, requires LLMs to be culturally sensitive to the user to ensure …

Generative large language models in automated fact-checking: A survey

I Vykopal, M Pikuliak, S Ostermann, M Šimko - arXiv preprint arXiv …, 2024 - arxiv.org
The dissemination of false information on online platforms presents a serious societal
challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) …

Richer Output for Richer Countries: Uncovering Geographical Disparities in Generated Stories and Travel Recommendations

K Bhagat, K Vasisht, D Pruthi - arXiv preprint arXiv:2411.07320, 2024 - arxiv.org
While a large body of work inspects language models for biases concerning gender, race,
occupation and religion, biases of geographical nature are relatively less explored. Some …

LoFTI: Localization and Factuality Transfer to Indian Locales

SE Simon, SK Mondal, A Singhania, S Sen… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) encode vast amounts of world knowledge acquired via
training on large web-scale datasets crawled from the internet. However, these datasets …

Saxony-Anhalt is the Worst: Bias Towards German Federal States in Large Language Models

A Kruspe, M Stillman - German Conference on Artificial Intelligence …, 2024 - Springer
Recent research demonstrates geographic biases in various Large Language Models that
reflects common human biases, which are presumably present in the training data. We …

Multi-FAct: Assessing Factuality of Multilingual LLMs using FActScore

S Shafayat, E Kim, J Oh, A Oh - First Conference on Language …, 2024 - openreview.net
Evaluating the factuality of long-form large language model (LLM)-generated text is an
important challenge. Recently there has been a surge of interest in factuality evaluation for …

Advancing Fair and Data-Efficient Deep Learning Models for Computer Vision

MM Afzal - 2024 - search.proquest.com
In recent years, deep learning and computer vision have driven significant advancements in
visual recognition tasks. However, these models often overlook a critical aspect: fairness …

Towards Responsible AI: Safeguarding Privacy, Integrity, and Fairness

MS Mirza - 2024 - search.proquest.com
The widespread adoption of machine learning models into digital platforms, spanning
general-purpose applications such as chatbots, professional tools like code generation, and …