Q Shao, L Dong, K Wei, S Sun,
L Xie - arXiv preprint arXiv:2501.13497, 2025 - arxiv.org
Data2vec is a self-supervised learning (SSL) approach that employs a teacher-student
architecture for contextual representation learning via masked prediction, demonstrating …