The field of deep learning has witnessed significant progress in recent times, particularly in areas such as computer vision (CV), natural language processing (NLP), and speech. The …
C Tan, J Zhang, J Liu, Y Wang, Y Hao - arXiv preprint arXiv:2401.07250, 2024 - arxiv.org
Recently, sharpness-aware minimization (SAM) has attracted a lot of attention because of its surprising effectiveness in improving generalization performance. However, training neural …
This paper rethinks Sharpness-Aware Minimization (SAM), which is originally formulated as a zero-sum game where the weights of a network and a bounded perturbation try to …
J Rostand, CCJ Hsu, CK Lu - Journal of the Chinese Institute of …, 2024 - Taylor & Francis
As advancements push for larger and more complex Artificial Intelligence (AI) models to improve performance, preventing the occurrence of overfitting when training …
Sharpness-Aware Minimization (SAM) enhances generalization by reducing a Max- Sharpness (MaxS). Despite the practical success, we empirically found that the MAxS …
Abstract Contrastive Language-Image Pre-training (CLIP) has shown remarkable success in the field of multimodal learning by enabling joint understanding of text and images. In this …
U Anjum, C Stockman, C Luong, J Zhan - Available at SSRN 4992443 - papers.ssrn.com
In this paper, we propose a novel meta-learning algorithm for learning new tasksfrom a small number of training samples called Domain Generalization SharpnessAware …