Understanding and improving early stopping for learning with noisy labels

Y Bai, E Yang, B Han, Y Yang, J Li… - Advances in …, 2021 - proceedings.neurips.cc
The memorization effect of deep neural network (DNN) plays a pivotal role in many state-of-
the-art label-noise learning methods. To exploit this property, the early stopping trick, which …

The curious case of hallucinations in neural machine translation

V Raunak, A Menezes, M Junczys-Dowmunt - arXiv preprint arXiv …, 2021 - arxiv.org
In this work, we study hallucinations in Neural Machine Translation (NMT), which lie at an
extreme end on the spectrum of NMT pathologies. Firstly, we connect the phenomenon of …

Learning with noisy correspondence for cross-modal matching

Z Huang, G Niu, X Liu, W Ding… - Advances in Neural …, 2021 - proceedings.neurips.cc
Cross-modal matching, which aims to establish the correspondence between two different
modalities, is fundamental to a variety of tasks such as cross-modal retrieval and vision-and …

Sample selection with uncertainty of losses for learning with noisy labels

X Xia, T Liu, B Han, M Gong, J Yu, G Niu… - arXiv preprint arXiv …, 2021 - arxiv.org
In learning with noisy labels, the sample selection approach is very popular, which regards
small-loss data as correctly labeled during training. However, losses are generated on-the …

A second-order approach to learning with instance-dependent label noise

Z Zhu, T Liu, Y Liu - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
The presence of label noise often misleads the training of deep neural networks. Departing
from the recent literature which largely assumes the label noise rate is only determined by …

Provably end-to-end label-noise learning without anchor points

X Li, T Liu, B Han, G Niu… - … conference on machine …, 2021 - proceedings.mlr.press
In label-noise learning, the transition matrix plays a key role in building statistically
consistent classifiers. Existing consistent estimators for the transition matrix have been …

Ngc: A unified framework for learning with open-world noisy data

ZF Wu, T Wei, J Jiang, C Mao… - Proceedings of the …, 2021 - openaccess.thecvf.com
The existence of noisy data is prevalent in both the training and testing phases of machine
learning systems, which inevitably leads to the degradation of model performance. There …

Fine samples for learning with noisy labels

T Kim, J Ko, JH Choi, SY Yun - Advances in Neural …, 2021 - proceedings.neurips.cc
Modern deep neural networks (DNNs) become frail when the datasets contain noisy
(incorrect) class labels. Robust techniques in the presence of noisy labels can be …

Open-set label noise can improve robustness against inherent label noise

H Wei, L Tao, R Xie, B An - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Learning with noisy labels is a practically challenging problem in weakly supervised
learning. In the existing literature, open-set noises are always considered to be poisonous …

Self-damaging contrastive learning

Z Jiang, T Chen, BJ Mortazavi… - … Conference on Machine …, 2021 - proceedings.mlr.press
The recent breakthrough achieved by contrastive learning accelerates the pace for
deploying unsupervised training on real-world data applications. However, unlabeled data …