Large language models (LLMs) have significantly advanced the field of natural language
processing (NLP), providing a highly useful, task-agnostic foundation for a wide range of …

Multi-task learning (MTL) has shown considerable practical benefits, particularly when using
pre-trained language models (PLMs). While this is commonly achieved by simultaneously …

2 Ling, et al. in very recent years on the domain specialization of LLMs, which, however,
calls for a comprehensive and systematic review to better summarizes and guide this …

Transfer learning has recently become the dominant paradigm of natural language
processing. Models pre-trained on unlabeled data can be fine-tuned for downstream tasks …

Abstract Information propagation is the process through which data are transmitted within a
system. The growth of large-scale web datasets has led to explosive growth in information …

In this thesis, we explore the development of methods for efficientcontinual learning, to
enable the sequential acquisition of knowledge by artificial intelligence (AI) systems as they …