Theory of curriculum learning, with convex loss functions
D Weinshall, D Amir - Journal of Machine Learning Research, 2020 - jmlr.org
Curriculum Learning is motivated by human cognition, where teaching often involves
gradually exposing the learner to examples in a meaningful order, from easy to hard …
gradually exposing the learner to examples in a meaningful order, from easy to hard …
Curriculum learning by transfer learning: Theory and experiments with deep networks
D Weinshall, G Cohen, D Amir - International conference on …, 2018 - proceedings.mlr.press
We provide theoretical investigation of curriculum learning in the context of stochastic
gradient descent when optimizing the convex linear regression loss. We prove that the rate …
gradient descent when optimizing the convex linear regression loss. We prove that the rate …
On the statistical benefits of curriculum learning
Curriculum learning (CL) is a commonly used machine learning training strategy. However,
we still lack a clear theoretical understanding of CL's benefits. In this paper, we study the …
we still lack a clear theoretical understanding of CL's benefits. In this paper, we study the …
A comparative evaluation of curriculum learning with filtering and boosting in supervised classification problems
MR Smith, T Martinez - Computational Intelligence, 2016 - Wiley Online Library
Not all instances in a data set are equally beneficial for inferring a model of the data, and
some instances (such as outliers) can be detrimental. Several machine learning techniques …
some instances (such as outliers) can be detrimental. Several machine learning techniques …
Superloss: A generic loss for robust curriculum learning
T Castells, P Weinzaepfel… - Advances in Neural …, 2020 - proceedings.neurips.cc
Curriculum learning is a technique to improve a model performance and generalization
based on the idea that easy samples should be presented before difficult ones during …
based on the idea that easy samples should be presented before difficult ones during …
Curriculum learning
Humans and animals learn much better when the examples are not randomly presented but
organized in a meaningful order which illustrates gradually more concepts, and gradually …
organized in a meaningful order which illustrates gradually more concepts, and gradually …
A mathematical model for curriculum learning
E Cornacchia, E Mossel - arXiv preprint arXiv:2301.13833, 2023 - arxiv.org
Curriculum learning (CL)-training using samples that are generated and presented in a
meaningful order-was introduced in the machine learning context around a decade ago …
meaningful order-was introduced in the machine learning context around a decade ago …
Curriculum learning by optimizing learning dynamics
We study a novel curriculum learning scheme where in each round, samples are selected to
achieve the greatest progress and fastest learning speed towards the ground-truth on all …
achieve the greatest progress and fastest learning speed towards the ground-truth on all …
Applying machine learning to improve curriculum design
Creating curriculum with an ever-changing student body is difficult. Faculty members in a
given department will have different perspectives on the composition and academic needs …
given department will have different perspectives on the composition and academic needs …
Minimax curriculum learning: Machine teaching with desirable difficulties and scheduled diversity
We introduce and study minimax curriculum learning (MCL), a new method for adaptively
selecting a sequence of training subsets for a succession of stages in machine learning. The …
selecting a sequence of training subsets for a succession of stages in machine learning. The …