Extensor: An accelerator for sparse tensor algebra

K Hegde, H Asghari-Moghaddam, M Pellauer… - Proceedings of the …, 2019 - dl.acm.org
Generalized tensor algebra is a prime candidate for acceleration via customized ASICs.
Modern tensors feature a wide range of data sparsity, with the density of non-zero elements …

The tensor algebra compiler

F Kjolstad, S Kamil, S Chou, D Lugato… - Proceedings of the …, 2017 - dl.acm.org
Tensor algebra is a powerful tool with applications in machine learning, data analytics,
engineering and the physical sciences. Tensors are often sparse and compound operations …

Compiler support for sparse tensor computations in MLIR

A Bik, P Koanantakool, T Shpeisman… - ACM Transactions on …, 2022 - dl.acm.org
Sparse tensors arise in problems in science, engineering, machine learning, and data
analytics. Programs that operate on such tensors can exploit sparsity to reduce storage …

Format abstraction for sparse tensor algebra compilers

S Chou, F Kjolstad, S Amarasinghe - Proceedings of the ACM on …, 2018 - dl.acm.org
This paper shows how to build a sparse tensor algebra compiler that is agnostic to tensor
formats (data layouts). We develop an interface that describes formats in terms of their …

A survey of accelerating parallel sparse linear algebra

G Xiao, C Yin, T Zhou, X Li, Y Chen, K Li - ACM Computing Surveys, 2023 - dl.acm.org
Sparse linear algebra includes the fundamental and important operations in various large-
scale scientific computing and real-world applications. There exists performance bottleneck …

HiCOO: Hierarchical storage of sparse tensors

J Li, J Sun, R Vuduc - SC18: International Conference for High …, 2018 - ieeexplore.ieee.org
This paper proposes a new storage format for sparse tensors, called Hierarchical
COOrdinate (HiCOO; pronounced:“haiku”). It derives from coordinate (COO) format, arguably …

Randomized algorithms for computation of Tucker decomposition and higher order SVD (HOSVD)

S Ahmadi-Asl, S Abukhovich, MG Asante-Mensah… - IEEE …, 2021 - ieeexplore.ieee.org
Big data analysis has become a crucial part of new emerging technologies such as the
internet of things, cyber-physical analysis, deep learning, anomaly detection, etc. Among …

A sparse iteration space transformation framework for sparse tensor algebra

R Senanayake, C Hong, Z Wang, A Wilson… - Proceedings of the …, 2020 - dl.acm.org
We address the problem of optimizing sparse tensor algebra in a compiler and show how to
define standard loop transformations---split, collapse, and reorder---on sparse iteration …

The sparse abstract machine

O Hsu, M Strange, R Sharma, J Won… - Proceedings of the 28th …, 2023 - dl.acm.org
We propose the Sparse Abstract Machine (SAM), an abstract machine model for targeting
sparse tensor algebra to reconfigurable and fixed-function spatial dataflow accelerators …

Randomized algorithms for low-rank tensor decompositions in the Tucker format

R Minster, AK Saibaba, ME Kilmer - SIAM journal on mathematics of data …, 2020 - SIAM
Many applications in data science and scientific computing involve large-scale datasets that
are expensive to store and manipulate. However, these datasets possess inherent …