Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

Neural collapse: A review on modelling principles and generalization

V Kothapalli - arXiv preprint arXiv:2206.04041, 2022 - arxiv.org
Deep classifier neural networks enter the terminal phase of training (TPT) when training
error reaches zero and tend to exhibit intriguing Neural Collapse (NC) properties. Neural …

Fsce: Few-shot object detection via contrastive proposal encoding

B Sun, B Li, S Cai, Y Yuan… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Emerging interests have been brought to recognize previously unseen objects given very
few training examples, known as few-shot object detection (FSOD). Recent researches …

Supervised contrastive learning

P Khosla, P Teterwak, C Wang… - Advances in neural …, 2020 - proceedings.neurips.cc
Contrastive learning applied to self-supervised representation learning has seen a
resurgence in recent years, leading to state of the art performance in the unsupervised …

Supervised contrastive learning for pre-trained language model fine-tuning

B Gunel, J Du, A Conneau, V Stoyanov - arXiv preprint arXiv:2011.01403, 2020 - arxiv.org
State-of-the-art natural language understanding classification models follow two-stages: pre-
training a large language model on an auxiliary task, and then fine-tuning the model on a …

Fantastic generalization measures and where to find them

Y Jiang, B Neyshabur, H Mobahi, D Krishnan… - arXiv preprint arXiv …, 2019 - arxiv.org
Generalization of deep networks has been of great interest in recent years, resulting in a
number of theoretically and empirically motivated complexity measures. However, most …

Less: Label-efficient semantic segmentation for lidar point clouds

M Liu, Y Zhou, CR Qi, B Gong, H Su… - European conference on …, 2022 - Springer
Semantic segmentation of LiDAR point clouds is an important task in autonomous driving.
However, training deep models via conventional supervised methods requires large …

Learning with fantasy: Semantic-aware virtual contrastive constraint for few-shot class-incremental learning

Z Song, Y Zhao, Y Shi, P Peng… - Proceedings of the …, 2023 - openaccess.thecvf.com
Few-shot class-incremental learning (FSCIL) aims at learning to classify new classes
continually from limited samples without forgetting the old classes. The mainstream …

Contrastive learning for label efficient semantic segmentation

X Zhao, R Vemulapalli, PA Mansfield… - Proceedings of the …, 2021 - openaccess.thecvf.com
Collecting labeled data for the task of semantic segmentation is expensive and time-
consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural …

[HTML][HTML] Applying supervised contrastive learning for the detection of diabetic retinopathy and its severity levels from fundus images

MR Islam, LF Abdulrazak, M Nahiduzzaman… - Computers in biology …, 2022 - Elsevier
Diabetic Retinopathy (DR) is a major complication in human eyes among the diabetic
patients. Early detection of the DR can save many patients from permanent blindness …