Tensor networks for dimensionality reduction and large-scale optimization: Part 2 applications and future perspectives

A Cichocki, AH Phan, Q Zhao, N Lee… - … and Trends® in …, 2017 - nowpublishers.com
Part 2 of this monograph builds on the introduction to tensor networks and their operations
presented in Part 1. It focuses on tensor network models for super-compressed higher-order …

[图书][B] An introduction to optimization on smooth manifolds

N Boumal - 2023 - books.google.com
Optimization on Riemannian manifolds-the result of smooth geometry and optimization
merging into one elegant modern framework-spans many areas of science and engineering …

Global rates of convergence for nonconvex optimization on manifolds

N Boumal, PA Absil, C Cartis - IMA Journal of Numerical …, 2019 - academic.oup.com
We consider the minimization of a cost function f on a manifold using Riemannian gradient
descent and Riemannian trust regions (RTR). We focus on satisfying necessary optimality …

A brief introduction to manifold optimization

J Hu, X Liu, ZW Wen, YX Yuan - … of the Operations Research Society of …, 2020 - Springer
Manifold optimization is ubiquitous in computational and applied mathematics, statistics,
engineering, machine learning, physics, chemistry, etc. One of the main challenges usually …

Reconfigurable intelligent surfaces aided mmWave NOMA: Joint power allocation, phase shifts, and hybrid beamforming optimization

Y Xiu, J Zhao, W Sun, M Di Renzo, G Gui… - IEEE Transactions …, 2021 - ieeexplore.ieee.org
In this paper, a reconfigurable intelligent surface (RIS)-aided millimeter wave (mmWave)
non-orthogonal multiple access (NOMA) system is analyzed. In particular, we consider an …

Proximal gradient method for nonsmooth optimization over the Stiefel manifold

S Chen, S Ma, A Man-Cho So, T Zhang - SIAM Journal on Optimization, 2020 - SIAM
We consider optimization problems over the Stiefel manifold whose objective function is the
summation of a smooth function and a nonsmooth function. Existing methods for solving this …

Simple algorithms for optimization on Riemannian manifolds with constraints

C Liu, N Boumal - Applied Mathematics & Optimization, 2020 - Springer
We consider optimization problems on manifolds with equality and inequality constraints. A
large body of work treats constrained optimization in Euclidean spaces. In this work, we …

Riemannian proximal gradient methods

W Huang, K Wei - Mathematical Programming, 2022 - Springer
In the Euclidean setting the proximal gradient method and its accelerated variants are a
class of efficient algorithms for optimization problems with decomposable objective. In this …

From Nesterov's estimate sequence to Riemannian acceleration

K Ahn, S Sra - Conference on Learning Theory, 2020 - proceedings.mlr.press
We propose the first global accelerated gradient method for Riemannian manifolds. Toward
establishing our results, we revisit Nesterov's estimate sequence technique and develop a …

Projection robust Wasserstein distance and Riemannian optimization

T Lin, C Fan, N Ho, M Cuturi… - Advances in neural …, 2020 - proceedings.neurips.cc
Projection robust Wasserstein (PRW) distance, or Wasserstein projection pursuit (WPP), is a
robust variant of the Wasserstein distance. Recent work suggests that this quantity is more …