Negation has been shown to be a major bottleneck for masked language models, such as
BERT. However, whether this finding still holds for larger-sized auto-regressive language …

State-of-the-art text-to-speech (TTS) systems have utilized pretrained language models
(PLMs) to enhance prosody and create more natural-sounding speech. However, while …

Some variants of self-supervised denoising objectives for pre-training encoder-decoder
language models have been reported to have a negligible impact on downstream …

The ability of large language models (LLMs) to" learn in context" based on the provided
prompt has led to an explosive growth in their use, culminating in the proliferation of AI …

What would it take for a natural language model to understand a novel, such as The Lord of
the Rings? Among other things, such a model must be able to:(a) identify and record new …

Language model probing is often used to test specific capabilities of models. However,
conclusions from such studies may be limited when the probing benchmarks are small and …

BERT, a groundbreaking large language model, has excelled in natural language
processing tasks such as question answering. Motivated by a desire to understand BERT's …

This thesis explores the evolving landscape of Natural Language Processing (NLP) and its
intersection with societal biases, focusing on the LGBTQIA+ community. With the rise of …