C Si,
W Yu,
P Zhou, Y Zhou… - Advances in Neural …, 2022 - proceedings.neurips.cc
Recent studies show that transformer has strong capability of building long-range
dependencies, yet is incompetent in capturing high frequencies that predominantly convey …