S3 Attention: Improving Long Sequence Attention with Smoothed Skeleton Sketching

X Wang, T Zhou, J Zhu, J Liu, K Yuan… - IEEE Journal of …, 2024 - ieeexplore.ieee.org
Attention-based models have achieved many remarkable breakthroughs in numerous
applications. However, the quadratic complexity of Attention makes the vanilla …

Structured Sampling for Robust Euclidean Distance Geometry

C Kundu, A Tasissa, HQ Cai - arXiv preprint arXiv:2412.10664, 2024 - arxiv.org
This paper addresses the problem of estimating the positions of points from distance
measurements corrupted by sparse outliers. Specifically, we consider a setting with two …

Accelerating Ill-conditioned Hankel Matrix Recovery via Structured Newton-like Descent

HQ Cai, L Huang, X Lu, J You - arXiv preprint arXiv:2406.07409, 2024 - arxiv.org
This paper studies the robust Hankel recovery problem, which simultaneously removes the
sparse outliers and fulfills missing entries from the partial observation. We propose a novel …