FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning

J Qi, Z Luan, S Huang, C Fung, H Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language models (LLMs) have emerged as important components across various
fields, yet their training requires substantial computation resources and abundant labeled …

Improving Global Generalization and Local Personalization for Federated Learning

L Meng, Z Qi, L Wu, X Du, Z Li, L Cui… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Federated learning aims to facilitate collaborative training among multiple clients with data
heterogeneity in a privacy-preserving manner, which either generates the generalized …

FissionFusion: Fast Geometric Generation and Hierarchical Souping for Medical Image Analysis

S Sanjeev, N Zhaksylyk, I Almakky… - arXiv preprint arXiv …, 2024 - arxiv.org
The scarcity of well-annotated medical datasets requires leveraging transfer learning from
broader datasets like ImageNet or pre-trained models like CLIP. Model soups averages …

Scalable Learned Model Soup on a Single GPU: An Efficient Subspace Training Strategy

T Li, W Jiang, F Liu, X Huang, JT Kwok - arXiv preprint arXiv:2407.03641, 2024 - arxiv.org
Pre-training followed by fine-tuning is widely adopted among practitioners. The performance
can be improved by" model soups"~\cite {wortsman2022model} via exploring various …

Flatness-Aware Gradient Descent for Safe Conversational AI

L Khalatbari, S Hosseini, H Sameti… - Proceedings of the 4th …, 2024 - aclanthology.org
As generative dialog models become ubiquitous in real-world applications, it is paramount
to ensure a harmless generation. There are two major challenges when enforcing safety to …

Counterfactual Explanations and Federated Learning for Enhanced Data Analytics Optimisation

SI Hasan, SF Nimmy, MS Kamal - Applied Multi-objective Optimization, 2024 - Springer
Breast cancer remains a critical problem. Its complexity requires robust methods to
understand the underlying genetic interactions. This research applies a three-part approach …