Machine learning for combinatorial optimization: a methodological tour d'horizon

Y Bengio, A Lodi, A Prouvost - European Journal of Operational Research, 2021 - Elsevier
This paper surveys the recent attempts, both from the machine learning and operations
research communities, at leveraging machine learning to solve combinatorial optimization …

Deep reinforcement learning: An overview

Y Li - arXiv preprint arXiv:1701.07274, 2017 - arxiv.org
We give an overview of recent exciting achievements of deep reinforcement learning (RL).
We discuss six core elements, six important mechanisms, and twelve applications. We start …

[PDF][PDF] Language models are few-shot learners

TB Brown - arXiv preprint arXiv:2005.14165, 2020 - splab.sdu.edu.cn
We demonstrate that scaling up language models greatly improves task-agnostic, few-shot
performance, sometimes even becoming competitive with prior state-of-the-art fine-tuning …

A survey of deep meta-learning

M Huisman, JN Van Rijn, A Plaat - Artificial Intelligence Review, 2021 - Springer
Deep neural networks can achieve great successes when presented with large data sets
and sufficient computational resources. However, their ability to learn new concepts quickly …

Learning to optimize: A primer and a benchmark

T Chen, X Chen, W Chen, H Heaton, J Liu… - Journal of Machine …, 2022 - jmlr.org
Learning to optimize (L2O) is an emerging approach that leverages machine learning to
develop optimization methods, aiming at reducing the laborious iterations of hand …

Metareg: Towards domain generalization using meta-regularization

Y Balaji, S Sankaranarayanan… - Advances in neural …, 2018 - proceedings.neurips.cc
Training models that generalize to new domains at test time is a problem of fundamental
importance in machine learning. In this work, we encode this notion of domain …

Learning transferable architectures for scalable image recognition

B Zoph, V Vasudevan, J Shlens… - Proceedings of the …, 2018 - openaccess.thecvf.com
Developing neural network image classification models often requires significant
architecture engineering. In this paper, we study a method to learn the model architectures …

Recasting gradient-based meta-learning as hierarchical bayes

E Grant, C Finn, S Levine, T Darrell… - arXiv preprint arXiv …, 2018 - arxiv.org
Meta-learning allows an intelligent agent to leverage prior learning episodes as a basis for
quickly improving performance on a novel task. Bayesian hierarchical modeling provides a …

A survey of transfer learning for convolutional neural networks

R Ribani, M Marengoni - 2019 32nd SIBGRAPI conference on …, 2019 - ieeexplore.ieee.org
Transfer learning is an emerging topic that may drive the success of machine learning in
research and industry. The lack of data on specific tasks is one of the main reasons to use it …

[PDF][PDF] Meta-learning

J Vanschoren - Automated machine learning: methods, systems …, 2019 - library.oapen.org
Meta-learning, or learning to learn, is the science of systematically observing how different
machine learning approaches perform on a wide range of learning tasks, and then learning …