Applications of Distributed Machine Learning for the Internet-of-Things: A Comprehensive Survey
The emergence of new services and applications in emerging wireless networks (eg,
beyond 5G and 6G) has shown a growing demand for the usage of artificial intelligence (AI) …
beyond 5G and 6G) has shown a growing demand for the usage of artificial intelligence (AI) …
Model merging in llms, mllms, and beyond: Methods, theories, applications and opportunities
Model merging is an efficient empowerment technique in the machine learning community
that does not require the collection of raw training data and does not require expensive …
that does not require the collection of raw training data and does not require expensive …
Retrieval-augmented mixture of lora experts for uploadable machine learning
Low-Rank Adaptation (LoRA) offers an efficient way to fine-tune large language models
(LLMs). Its modular and plug-and-play nature allows the integration of various domain …
(LLMs). Its modular and plug-and-play nature allows the integration of various domain …
Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering
Low-Rank Adaptation (LoRA) has emerged as a popular technique for fine-tuning large
language models (LLMs) to various domains due to its modular design and widespread …
language models (LLMs) to various domains due to its modular design and widespread …
Instance-Level Dynamic LoRAs Composition for Cross-Task Generalization
Large language models perform well on tasks that have undergone fine-tuning of
instructions, but their performance on completely unseen tasks is often less than ideal. To …
instructions, but their performance on completely unseen tasks is often less than ideal. To …
Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning
Efficient fine-tuning plays a fundamental role in modern large models, with low-rank
adaptation emerging as a particularly promising approach. However, the existing variants of …
adaptation emerging as a particularly promising approach. However, the existing variants of …
Attack on LLMs: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem
Finetuning large language models (LLMs) with LoRA has gained significant popularity due
to its simplicity and effectiveness. Often times, users may even find pluggable community …
to its simplicity and effectiveness. Often times, users may even find pluggable community …