Theory of curriculum learning, with convex loss functions

D Weinshall, D Amir - Journal of Machine Learning Research, 2020 - jmlr.org
Curriculum Learning is motivated by human cognition, where teaching often involves
gradually exposing the learner to examples in a meaningful order, from easy to hard …

Curriculum learning by transfer learning: Theory and experiments with deep networks

D Weinshall, G Cohen, D Amir - International conference on …, 2018 - proceedings.mlr.press
We provide theoretical investigation of curriculum learning in the context of stochastic
gradient descent when optimizing the convex linear regression loss. We prove that the rate …

On the statistical benefits of curriculum learning

Z Xu, A Tewari - International Conference on Machine …, 2022 - proceedings.mlr.press
Curriculum learning (CL) is a commonly used machine learning training strategy. However,
we still lack a clear theoretical understanding of CL's benefits. In this paper, we study the …

A comparative evaluation of curriculum learning with filtering and boosting in supervised classification problems

MR Smith, T Martinez - Computational Intelligence, 2016 - Wiley Online Library
Not all instances in a data set are equally beneficial for inferring a model of the data, and
some instances (such as outliers) can be detrimental. Several machine learning techniques …

Superloss: A generic loss for robust curriculum learning

T Castells, P Weinzaepfel… - Advances in Neural …, 2020 - proceedings.neurips.cc
Curriculum learning is a technique to improve a model performance and generalization
based on the idea that easy samples should be presented before difficult ones during …

Curriculum learning

Y Bengio, J Louradour, R Collobert… - Proceedings of the 26th …, 2009 - dl.acm.org
Humans and animals learn much better when the examples are not randomly presented but
organized in a meaningful order which illustrates gradually more concepts, and gradually …

A mathematical model for curriculum learning

E Cornacchia, E Mossel - arXiv preprint arXiv:2301.13833, 2023 - arxiv.org
Curriculum learning (CL)-training using samples that are generated and presented in a
meaningful order-was introduced in the machine learning context around a decade ago …

Curriculum learning by optimizing learning dynamics

T Zhou, S Wang, J Bilmes - International Conference on …, 2021 - proceedings.mlr.press
We study a novel curriculum learning scheme where in each round, samples are selected to
achieve the greatest progress and fastest learning speed towards the ground-truth on all …

Applying machine learning to improve curriculum design

R Ball, L Duhadway, K Feuz, J Jensen… - Proceedings of the 50th …, 2019 - dl.acm.org
Creating curriculum with an ever-changing student body is difficult. Faculty members in a
given department will have different perspectives on the composition and academic needs …

Minimax curriculum learning: Machine teaching with desirable difficulties and scheduled diversity

T Zhou, J Bilmes - International conference on learning …, 2018 - openreview.net
We introduce and study minimax curriculum learning (MCL), a new method for adaptively
selecting a sequence of training subsets for a succession of stages in machine learning. The …