[图书][B] An introduction to optimization on smooth manifolds

N Boumal - 2023 - books.google.com
Optimization on Riemannian manifolds-the result of smooth geometry and optimization
merging into one elegant modern framework-spans many areas of science and engineering …

Hyperbolic graph convolutional neural networks

I Chami, Z Ying, C Ré… - Advances in neural …, 2019 - proceedings.neurips.cc
Graph convolutional neural networks (GCNs) embed nodes in a graph into Euclidean space,
which has been shown to incur a large distortion when embedding real-world graphs with …

Poincaré embeddings for learning hierarchical representations

M Nickel, D Kiela - Advances in neural information …, 2017 - proceedings.neurips.cc
Abstract Representation learning has become an invaluable approach for learning from
symbolic data such as text and graphs. However, state-of-the-art embedding methods …

[PDF][PDF] Learning mixed-curvature representations in products of model spaces

A Gu, F Sala, B Gunel, C Ré - International conference on …, 2019 - people.ee.duke.edu
▶ Distortion of a pair of points a, b is| dV (f (a), f (b))− dU (a, b)|/dU (a, b). Average distortion
Davg is the average over all pairs of points.▶ mean Average Precision (mAP). Let G=(V, E) …

Cheap orthogonal constraints in neural networks: A simple parametrization of the orthogonal and unitary group

M Lezcano-Casado… - … Conference on Machine …, 2019 - proceedings.mlr.press
We introduce a novel approach to perform first-order optimization with orthogonal and
unitary constraints. This approach is based on a parametrization stemming from Lie group …

Global rates of convergence for nonconvex optimization on manifolds

N Boumal, PA Absil, C Cartis - IMA Journal of Numerical …, 2019 - academic.oup.com
We consider the minimization of a cost function f on a manifold using Riemannian gradient
descent and Riemannian trust regions (RTR). We focus on satisfying necessary optimality …

[HTML][HTML] A brief introduction to manifold optimization

J Hu, X Liu, ZW Wen, YX Yuan - … of the Operations Research Society of …, 2020 - Springer
Manifold optimization is ubiquitous in computational and applied mathematics, statistics,
engineering, machine learning, physics, chemistry, etc. One of the main challenges usually …

Trivializations for gradient-based optimization on manifolds

M Lezcano Casado - Advances in Neural Information …, 2019 - proceedings.neurips.cc
We introduce a framework to study the transformation of problems with manifold constraints
into unconstrained problems through parametrizations in terms of a Euclidean space. We …

Proximal gradient method for nonsmooth optimization over the Stiefel manifold

S Chen, S Ma, A Man-Cho So, T Zhang - SIAM Journal on Optimization, 2020 - SIAM
We consider optimization problems over the Stiefel manifold whose objective function is the
summation of a smooth function and a nonsmooth function. Existing methods for solving this …

Riemannian conjugate gradient methods: General framework and specific algorithms with convergence analyses

H Sato - SIAM Journal on Optimization, 2022 - SIAM
Conjugate gradient methods are important first-order optimization algorithms both in
Euclidean spaces and on Riemannian manifolds. However, while various types of conjugate …