Out of one, many: Using language models to simulate human samples

LP Argyle, EC Busby, N Fulda, JR Gubler… - Political …, 2023 - cambridge.org
We propose and explore the possibility that language models can be studied as effective
proxies for specific human subpopulations in social science research. Practical and …

Quantifying and alleviating political bias in language models

R Liu, C Jia, J Wei, G Xu, S Vosoughi - Artificial Intelligence, 2022 - Elsevier
Current large-scale language models can be politically biased as a result of the data they
are trained on, potentially causing serious problems when they are deployed in real-world …

Diminished diversity-of-thought in a standard large language model

PS Park, P Schoenegger, C Zhu - Behavior Research Methods, 2024 - Springer
We test whether large language models (LLMs) can be used to simulate human participants
in social-science studies. To do this, we ran replications of 14 studies from the Many Labs 2 …

The potential impact of emerging technologies on democratic representation: Evidence from a field experiment

S Kreps, DL Kriner - New Media & Society, 2023 - journals.sagepub.com
Advances in machine learning have led to the creation natural language models that can
mimic human writing style and substance. Here we investigate the challenge that machine …

[HTML][HTML] More human than human: measuring ChatGPT political bias

F Motoki, V Pinho Neto, V Rodrigues - Public Choice, 2024 - Springer
We investigate the political bias of a large language model (LLM), ChatGPT, which has
become popular for retrieving factual information and generating content. Although ChatGPT …

The political biases of chatgpt

D Rozado - Social Sciences, 2023 - mdpi.com
Recent advancements in Large Language Models (LLMs) suggest imminent commercial
applications of such AI systems where they will serve as gateways to interact with …

Using large language models to simulate multiple humans and replicate human subject studies

GV Aher, RI Arriaga, AT Kalai - International Conference on …, 2023 - proceedings.mlr.press
We introduce a new type of test, called a Turing Experiment (TE), for evaluating to what
extent a given language model, such as GPT models, can simulate different aspects of …

Large language models and political science

M Linegar, R Kocielnik, RM Alvarez - Frontiers in Political Science, 2023 - frontiersin.org
Large Language Models (LLMs) are a type of artificial intelligence that uses information from
very large datasets to model the use of language and generate content. While LLMs like …

AI language models cannot replace human research participants

J Harding, W D'Alessandro, NG Laskowski, R Long - Ai & Society, 2023 - Springer
Generative artificial intelligence has the potential to transform many of our projects, from art
and education to business and security. AI's promise in these areas comes largely from its …

Generative language models exhibit social identity biases

T Hu, Y Kyrychenko, S Rathje, N Collier… - arXiv preprint arXiv …, 2023 - arxiv.org
The surge in popularity of large language models has given rise to concerns about biases
that these models could learn from humans. In this study, we investigate whether ingroup …