Compiler support for sparse tensor computations in MLIR

A Bik, P Koanantakool, T Shpeisman… - ACM Transactions on …, 2022 - dl.acm.org
Sparse tensors arise in problems in science, engineering, machine learning, and data
analytics. Programs that operate on such tensors can exploit sparsity to reduce storage …

A sparse iteration space transformation framework for sparse tensor algebra

R Senanayake, C Hong, Z Wang, A Wilson… - Proceedings of the …, 2020 - dl.acm.org
We address the problem of optimizing sparse tensor algebra in a compiler and show how to
define standard loop transformations---split, collapse, and reorder---on sparse iteration …

The sparse abstract machine

O Hsu, M Strange, R Sharma, J Won… - Proceedings of the 28th …, 2023 - dl.acm.org
We propose the Sparse Abstract Machine (SAM), an abstract machine model for targeting
sparse tensor algebra to reconfigurable and fixed-function spatial dataflow accelerators …

Compilation of sparse array programming models

R Henry, O Hsu, R Yadav, S Chou, K Olukotun… - Proceedings of the …, 2021 - dl.acm.org
This paper shows how to compile sparse array programming languages. A sparse array
programming language is an array programming language that supports element-wise …

Capstan: A vector RDA for sparsity

A Rucker, M Vilim, T Zhao, Y Zhang… - MICRO-54: 54th Annual …, 2021 - dl.acm.org
This paper proposes Capstan: a scalable, parallel-patterns-based, reconfigurable dataflow
accelerator (RDA) for sparse and dense tensor applications. Instead of designing for one …

The EDGE language: Extended general einsums for graph algorithms

TO Odemuyiwa, JS Emer, JD Owens - arXiv preprint arXiv:2404.11591, 2024 - arxiv.org
In this work, we propose a unified abstraction for graph algorithms: the Extended General
Einsums language, or EDGE. The EDGE language expresses graph algorithms in the …

Looplets: A language for structured coiteration

W Ahrens, D Donenfeld, F Kjolstad… - Proceedings of the 21st …, 2023 - dl.acm.org
Real world arrays often contain underlying structure, such as sparsity, runs of repeated
values, or symmetry. Specializing for structure yields significant speedups. But automatically …

Automatic generation of efficient sparse tensor format conversion routines

S Chou, F Kjolstad, S Amarasinghe - Proceedings of the 41st ACM …, 2020 - dl.acm.org
This paper shows how to generate code that efficiently converts sparse tensors between
disparate storage formats (data layouts) such as CSR, DIA, ELL, and many others. We …

FEASTA: A Flexible and Efficient Accelerator for Sparse Tensor Algebra in Machine Learning

K Zhong, Z Zhu, G Dai, H Wang, X Yang… - Proceedings of the 29th …, 2024 - dl.acm.org
Recently, sparse tensor algebra (SpTA) plays an increasingly important role in machine
learning. However, due to the unstructured sparsity of SpTA, the general-purpose …

Stardust: Compiling sparse tensor algebra to a reconfigurable dataflow architecture

O Hsu, A Rucker, T Zhao, K Olukotun… - arXiv preprint arXiv …, 2022 - arxiv.org
We introduce Stardust, a compiler that compiles sparse tensor algebra to reconfigurable
dataflow architectures (RDAs). Stardust introduces new user-provided data representation …