Domain generalization: A survey

K Zhou, Z Liu, Y Qiao, T Xiang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Generalization to out-of-distribution (OOD) data is a capability natural to humans yet
challenging for machines to reproduce. This is because most learning algorithms strongly …

Shortcut learning in deep neural networks

R Geirhos, JH Jacobsen, C Michaelis… - Nature Machine …, 2020 - nature.com
Deep learning has triggered the current rise of artificial intelligence and is the workhorse of
today's machine intelligence. Numerous success stories have rapidly spread all over …

Non-stationary transformers: Exploring the stationarity in time series forecasting

Y Liu, H Wu, J Wang, M Long - Advances in Neural …, 2022 - proceedings.neurips.cc
Transformers have shown great power in time series forecasting due to their global-range
modeling ability. However, their performance can degenerate terribly on non-stationary real …

Generalized out-of-distribution detection: A survey

J Yang, K Zhou, Y Li, Z Liu - arXiv preprint arXiv:2110.11334, 2021 - arxiv.org
Out-of-distribution (OOD) detection is critical to ensuring the reliability and safety of machine
learning systems. For instance, in autonomous driving, we would like the driving system to …

Deep long-tailed learning: A survey

Y Zhang, B Kang, B Hooi, S Yan… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Deep long-tailed learning, one of the most challenging problems in visual recognition, aims
to train well-performing deep models from a large number of images that follow a long-tailed …

Towards out-of-distribution generalization: A survey

J Liu, Z Shen, Y He, X Zhang, R Xu, H Yu… - arXiv preprint arXiv …, 2021 - arxiv.org
Traditional machine learning paradigms are based on the assumption that both training and
test data follow the same statistical pattern, which is mathematically referred to as …

Intriguing properties of vision transformers

MM Naseer, K Ranasinghe, SH Khan… - Advances in …, 2021 - proceedings.neurips.cc
Vision transformers (ViT) have demonstrated impressive performance across numerous
machine vision tasks. These models are based on multi-head self-attention mechanisms that …

Exact feature distribution matching for arbitrary style transfer and domain generalization

Y Zhang, M Li, R Li, K Jia… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Arbitrary style transfer (AST) and domain generalization (DG) are important yet challenging
visual learning tasks, which can be cast as a feature distribution matching problem. With the …

Generalizing to unseen domains: A survey on domain generalization

J Wang, C Lan, C Liu, Y Ouyang, T Qin… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Machine learning systems generally assume that the training and testing distributions are
the same. To this end, a key requirement is to develop models that can generalize to unseen …

Test-time classifier adjustment module for model-agnostic domain generalization

Y Iwasawa, Y Matsuo - Advances in Neural Information …, 2021 - proceedings.neurips.cc
This paper presents a new algorithm for domain generalization (DG),\textit {test-time
template adjuster (T3A)}, aiming to robustify a model to unknown distribution shift. Unlike …