Dataset distillation: A comprehensive review

R Yu, S Liu, X Wang - IEEE Transactions on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Recent success of deep learning is largely attributed to the sheer amount of data used for
training deep neural networks. Despite the unprecedented success, the massive data …

A comprehensive survey of dataset distillation

S Lei, D Tao - IEEE Transactions on Pattern Analysis and …, 2023 - ieeexplore.ieee.org
Deep learning technology has developed unprecedentedly in the last decade and has
become the primary choice in many application domains. This progress is mainly attributed …

Federated learning for generalization, robustness, fairness: A survey and benchmark

W Huang, M Ye, Z Shi, G Wan, H Li… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Federated learning has emerged as a promising paradigm for privacy-preserving
collaboration among different parties. Recently, with the popularity of federated learning, an …

Gpt-fl: Generative pre-trained model-assisted federated learning

T Zhang, T Feng, S Alam, D Dimitriadis… - arXiv preprint arXiv …, 2023 - arxiv.org
In this work, we propose GPT-FL, a generative pre-trained model-assisted federated
learning (FL) framework. At its core, GPT-FL leverages generative pre-trained models to …

A holistic view of label noise transition matrix in deep learning and beyond

LIN Yong, R Pi, W Zhang, X Xia, J Gao… - The Eleventh …, 2022 - openreview.net
In this paper, we explore learning statistically consistent classifiers under label noise by
estimating the noise transition matrix T. We first provide a holistic view of existing T …

Dataset distillation by automatic training trajectories

D Liu, J Gu, H Cao, C Trinitis, M Schulz - arXiv preprint arXiv:2407.14245, 2024 - arxiv.org
Dataset Distillation is used to create a concise, yet informative, synthetic dataset that can
replace the original dataset for training purposes. Some leading methods in this domain …

Towards open federated learning platforms: Survey and vision from technical and legal perspectives

M Duan, Q Li, L Jiang, B He - arXiv preprint arXiv:2307.02140, 2023 - arxiv.org
Traditional Federated Learning (FL) follows a server-dominated cooperation paradigm
which narrows the application scenarios of FL and decreases the enthusiasm of data …

PoisonedFL: Model Poisoning Attacks to Federated Learning via Multi-Round Consistency

Y Xie, M Fang, NZ Gong - arXiv preprint arXiv:2404.15611, 2024 - arxiv.org
Model poisoning attacks are critical security threats to Federated Learning (FL). Existing
model poisoning attacks suffer from two key limitations: 1) they achieve suboptimal …

Self-guided noise-free data generation for efficient zero-shot learning

J Gao, R Pi, Y Lin, H Xu, J Ye, Z Wu, W Zhang… - arXiv preprint arXiv …, 2022 - arxiv.org
There is a rising interest in further exploring the zero-shot learning potential of large pre-
trained language models (PLMs). A new paradigm called data-generation-based zero-shot …

Distilling Ensemble Surrogates for Federated Data-Driven Many-Task Optimization

X Wang, Y Jin - IEEE Transactions on Evolutionary …, 2024 - ieeexplore.ieee.org
Blackbox optimization problems are commonly seen in the real world, ranging from
experimental design to hyperparameter tuning of machine learning models. In numerous …