Bidirectional Encoder Representations from Transformers (BERT) has gained increasing
attention from researchers and practitioners as it has proven to be an invaluable technique …

Sentiment analysis is the process of using natural language processing, computational
linguistics, and other text analysis techniques to identify and extract subjective information in …

Pre-trained language models (LMs) are currently integral to many natural language
processing systems. Although multilingual LMs were also introduced to serve many …

In this paper, we explore the effects of language variants, data sizes, and fine-tuning task
types in Arabic pre-trained language models. To do so, we build three pre-trained language …

Transfer learning with a unified Transformer framework (T5) that converts all language
problems into a text-to-text format was recently proposed as a simple and effective transfer …

We describe findings of the third Nuanced Arabic Dialect Identification Shared Task (NADI
2022). NADI aims at advancing state of the art Arabic NLP, including on Arabic dialects. It …

Pretraining Bidirectional Encoder Representations from Transformers (BERT) for
downstream NLP tasks is a non-trival task. We pretrained 5 BERT models that differ in the …

ChatGPT's emergence heralds a transformative phase in NLP, particularly demonstrated
through its excellent performance on many English benchmarks. However, the model's …

We introduce a generic, language-independent method to collect a large percentage of
offensive and hate tweets regardless of their topics or genres. We harness the extralinguistic …

THE TERM NATURAL language refers to any system of symbolic communication (spoken,
signed, or written) that has evolved naturally in humans without intentional human planning …