Randomized numerical linear algebra: Foundations and algorithms

PG Martinsson, JA Tropp - Acta Numerica, 2020 - cambridge.org
This survey describes probabilistic algorithms for linear algebraic computations, such as
factorizing matrices and solving linear systems. It focuses on techniques that have a proven …

Sketching as a tool for numerical linear algebra

DP Woodruff - … and Trends® in Theoretical Computer Science, 2014 - nowpublishers.com
This survey highlights the recent advances in algorithms for numerical linear algebra that
have come from the technique of linear sketching, whereby given a matrix, one first …

Practical sketching algorithms for low-rank matrix approximation

JA Tropp, A Yurtsever, M Udell, V Cevher - SIAM Journal on Matrix Analysis …, 2017 - SIAM
This paper describes a suite of algorithms for constructing low-rank approximations of an
input matrix from a random linear image, or sketch, of the matrix. These methods can …

Iterative Hessian sketch: Fast and accurate solution approximation for constrained least-squares

M Pilanci, MJ Wainwright - Journal of Machine Learning Research, 2016 - jmlr.org
This paper considers inference of causal structure in a class of graphical models called
conditional DAGs. These are directed acyclic graph (DAG) models with two kinds of …

Randomized numerical linear algebra: A perspective on the field with an eye to software

R Murray, J Demmel, MW Mahoney… - arXiv preprint arXiv …, 2023 - arxiv.org
Randomized numerical linear algebra-RandNLA, for short-concerns the use of
randomization as a resource to develop improved algorithms for large-scale linear algebra …

Tail bounds via generic chaining

S Dirksen - 2015 - projecteuclid.org
We modify Talagrand's generic chaining method to obtain upper bounds for all p-th
moments of the supremum of a stochastic process. These bounds lead to an estimate for the …

Low rank approximation with entrywise l1-norm error

Z Song, DP Woodruff, P Zhong - Proceedings of the 49th Annual ACM …, 2017 - dl.acm.org
We study the ℓ1-low rank approximation problem, where for a given nxd matrix A and
approximation factor α≤ 1, the goal is to output a rank-k matrix  for which‖ A-Â‖ 1≤ α …

Input sparsity time low-rank approximation via ridge leverage score sampling

MB Cohen, C Musco, C Musco - Proceedings of the Twenty-Eighth Annual …, 2017 - SIAM
We present a new algorithm for finding a near optimal low-rank approximation of a matrix A
in O (n nz (A)) time. Our method is based on a recursive sampling scheme for computing a …

Streaming low-rank matrix approximation with an application to scientific simulation

JA Tropp, A Yurtsever, M Udell, V Cevher - SIAM Journal on Scientific …, 2019 - SIAM
This paper argues that randomized linear sketching is a natural tool for on-the-fly
compression of data matrices that arise from large-scale scientific simulations and data …

Optimal embedding dimension for sparse subspace embeddings

S Chenakkod, M Dereziński, X Dong… - Proceedings of the 56th …, 2024 - dl.acm.org
A random m× n matrix S is an oblivious subspace embedding (OSE) with parameters є> 0,
δ∈(0, 1/3) and d≤ m≤ n, if for any d-dimensional subspace W⊆ R n, P (∀ x∈ W (1+ є)− 1 …