A dnn optimizer that improves over adabelief by suppression of the adaptive stepsize range

G Zhang, K Niwa, WB Kleijn - arXiv preprint arXiv:2203.13273, 2022 - arxiv.org
We make contributions towards improving adaptive-optimizer performance. Our
improvements are based on suppression of the range of adaptive stepsizes in the AdaBelief …

A DNN Optimizer that Improves over AdaBelief by Suppression of the Adaptive Stepsize Range

G Zhang, K Niwa, W Bastiaan Kleijn - arXiv e-prints, 2022 - ui.adsabs.harvard.edu
We make contributions towards improving adaptive-optimizer performance. Our
improvements are based on suppression of the range of adaptive stepsizes in the AdaBelief …

A DNN Optimizer that Improves over AdaBelief by Suppression of the Adaptive Stepsize Range

G Zhang, K Niwa, WB Kleijn - Transactions on Machine Learning Research - openreview.net
We make contributions towards improving adaptive-optimizer performance. Our
improvements are based on suppression of the range of adaptive stepsizes in the AdaBelief …