Training Strategies
Curriculum Learning
In brief — site editorial, not from the paper
Orders training examples from easy to hard, so the model builds up competence in stages rather than facing everything at once.
Definition
Curriculum learning structures the ordering of training examples rather than their content, presenting data in an easy-to-hard sequence to improve optimizer trajectory and final convergence [26]. Its Pipeline-Mediated classification is the decisive taxonomic property: curriculum learning never executes a gradient update on the model—it operates strictly as a data-sequencing function upstream of the optimizer. The parametric modification that results from training on a curricularized dataset is performed entirely by the downstream training method; curriculum learning contributes only the temporal ordering of the input stream. This indirect mechanism is the structural reason for Pipeline-Dependent and Pipeline-Dependent: the D4 (Persistence) and D5 (Scope) profile of the resulting model are fully inherited from whichever downstream training method consumes the sequenced data. Compared to Data Augmentation, Data Augmentation synthetically extends the training set (via transformation), while curriculum learning operates on the existing dataset without modification—it changes the sampling order, not the examples. Compared to Active Learning, both share Pipeline-Dependent, but Active Learning introduces a Distributional Gap Bridging component by querying strategically chosen unlabeled samples, while Curriculum Learning's Task Specialization reflects that it optimizes the convergence trajectory rather than the distributional coverage. Because curriculum learning does not independently modify model parameters, it must be documented as a named algorithmic dependency of the primary training event it serves—specifying the difficulty-scoring methodology, sequencing protocol, and any pacing functions—rather than as a standalone change-control entry; the downstream training event inherits the full parametric and structural documentation burden.
Verbatim from the paper — Training Strategies
Nearest profiles
Active Learning (0.08), Data Augmentation (0.08), Semi-SL (0.17), FT (full) (0.70), MTL (0.70)
Computed from the taxonomy data (Gower distance over all six dimensions)
References
- [26] Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston 2009. Curriculum learning. Proceedings of the 26th Annual International Conference on Machine Learning
Numbered as in the paper
Cite this row
Curriculum Learning — six-dimensional profile D1: pipeline-mediated D2: task-specialization D3: pipeline-dependent D4: pipeline-dependent D5: pipeline-dependent D6: dl, fm, llm, ml, mllm Source: arXiv:2608.06246Compare with another technique Find in the explorer