Large language models (LLMs) have garnered unprecedented advancements across
diverse fields, ranging from natural language processing to computer vision and beyond …

Low-Rank Adaptation (LoRA) offers an efficient way to fine-tune large language models
(LLMs). Its modular and plug-and-play nature allows the integration of various domain …

The growing number of parameter-efficient adaptations of a base large language model
(LLM) calls for studying whether we can reuse such trained adapters to improve …

In multi-task learning, the conventional approach involves training a model on multiple tasks
simultaneously. However, the training signals from different tasks can interfere with one …

Abstract Information propagation is the process through which data are transmitted within a
system. The growth of large-scale web datasets has led to explosive growth in information …