A comprehensive survey on test-time adaptation under distribution shifts

J Liang, R He, T Tan - International Journal of Computer Vision, 2024 - Springer
Abstract Machine learning methods strive to acquire a robust model during the training
process that can effectively generalize to test samples, even in the presence of distribution …

When foundation model meets federated learning: Motivations, challenges, and future directions

W Zhuang, C Chen, L Lyu - arXiv preprint arXiv:2306.15546, 2023 - arxiv.org
The intersection of the Foundation Model (FM) and Federated Learning (FL) provides mutual
benefits, presents a unique opportunity to unlock new possibilities in AI research, and …

On pitfalls of test-time adaptation

H Zhao, Y Liu, A Alahi, T Lin - arXiv preprint arXiv:2306.03536, 2023 - arxiv.org
Test-Time Adaptation (TTA) has recently emerged as a promising approach for tackling the
robustness challenge under distribution shifts. However, the lack of consistent settings and …

Is heterogeneity notorious? taming heterogeneity to handle test-time shift in federated learning

Y Tan, C Chen, W Zhuang, X Dong… - Advances in Neural …, 2024 - proceedings.neurips.cc
Federated learning (FL) is an effective machine learning paradigm where multiple clients
can train models based on heterogeneous data in a decentralized manner without …

Federated learning for generalization, robustness, fairness: A survey and benchmark

W Huang, M Ye, Z Shi, G Wan, H Li… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Federated learning has emerged as a promising paradigm for privacy-preserving
collaboration among different parties. Recently, with the popularity of federated learning, an …

Fedbr: Improving federated learning on heterogeneous data via local learning bias reduction

Y Guo, X Tang, T Lin - International Conference on Machine …, 2023 - proceedings.mlr.press
Federated Learning (FL) is a way for machines to learn from data that is kept locally, in order
to protect the privacy of clients. This is typically done using local SGD, which helps to …

PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees

C Xie, DA Huang, W Chu, D Xu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Personalized Federated Learning (pFL) has emerged as a promising solution to
tackle data heterogeneity across clients in FL. However existing pFL methods either (1) …

Adaptive test-time personalization for federated learning

W Bao, T Wei, H Wang, J He - Advances in Neural …, 2024 - proceedings.neurips.cc
Personalized federated learning algorithms have shown promising results in adapting
models to various distribution shifts. However, most of these methods require labeled data …

Fedios: Decoupling orthogonal subspaces for personalization in feature-skew federated learning

L Gao, Z Li, Y Lu, C Wu - arXiv preprint arXiv:2311.18559, 2023 - arxiv.org
Personalized federated learning (pFL) enables collaborative training among multiple clients
to enhance the capability of customized local models. In pFL, clients may have …

ZooPFL: Exploring black-box foundation models for personalized federated learning

W Lu, H Yu, J Wang, D Teney, H Wang, Y Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
When personalized federated learning (FL) meets large foundation models, new challenges
arise from various limitations in resources. In addition to typical limitations such as data …