A perspective survey on deep transfer learning for fault diagnosis in industrial scenarios: Theories, applications and challenges

W Li, R Huang, J Li, Y Liao, Z Chen, G He… - … Systems and Signal …, 2022 - Elsevier
Abstract Deep Transfer Learning (DTL) is a new paradigm of machine learning, which can
not only leverage the advantages of Deep Learning (DL) in feature representation, but also …

How to dp-fy ml: A practical guide to machine learning with differential privacy

N Ponomareva, H Hazimeh, A Kurakin, Z Xu… - Journal of Artificial …, 2023 - jair.org
Abstract Machine Learning (ML) models are ubiquitous in real-world applications and are a
constant focus of research. Modern ML models have become more complex, deeper, and …

Symbolic discovery of optimization algorithms

X Chen, C Liang, D Huang, E Real… - Advances in neural …, 2024 - proceedings.neurips.cc
We present a method to formulate algorithm discovery as program search, and apply it to
discover optimization algorithms for deep neural network training. We leverage efficient …

Diffusion-lm improves controllable text generation

X Li, J Thickstun, I Gulrajani… - Advances in Neural …, 2022 - proceedings.neurips.cc
Controlling the behavior of language models (LMs) without re-training is a major open
problem in natural language generation. While recent works have demonstrated successes …

Quantum optimization of maximum independent set using Rydberg atom arrays

S Ebadi, A Keesling, M Cain, TT Wang, H Levine… - Science, 2022 - science.org
Realizing quantum speedup for practically relevant, computationally hard problems is a
central challenge in quantum information science. Using Rydberg atom arrays with up to …

New tools for automated cryo-EM single-particle analysis in RELION-4.0

D Kimanius, L Dong, G Sharov, T Nakane… - Biochemical …, 2021 - portlandpress.com
We describe new tools for the processing of electron cryo-microscopy (cryo-EM) images in
the fourth major release of the RELION software. In particular, we introduce VDAM, a …

Transformers learn to implement preconditioned gradient descent for in-context learning

K Ahn, X Cheng, H Daneshmand… - Advances in Neural …, 2024 - proceedings.neurips.cc
Motivated by the striking ability of transformers for in-context learning, several works
demonstrate that transformers can implement algorithms like gradient descent. By a careful …

Federated learning on non-IID data: A survey

H Zhu, J Xu, S Liu, Y Jin - Neurocomputing, 2021 - Elsevier
Federated learning is an emerging distributed machine learning framework for privacy
preservation. However, models trained in federated learning usually have worse …

A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics

E Haghighat, M Raissi, A Moure, H Gomez… - Computer Methods in …, 2021 - Elsevier
We present the application of a class of deep learning, known as Physics Informed Neural
Networks (PINN), to inversion and surrogate modeling in solid mechanics. We explain how …

A field guide to federated optimization

J Wang, Z Charles, Z Xu, G Joshi, HB McMahan… - arXiv preprint arXiv …, 2021 - arxiv.org
Federated learning and analytics are a distributed approach for collaboratively learning
models (or statistics) from decentralized data, motivated by and designed for privacy …