Skip to content

Training Strategies

Curriculum Learning

In brief — site editorial, not from the paper

Orders training examples from easy to hard, so the model builds up competence in stages rather than facing everything at once.

Definition

Curriculum learning structures the ordering of training examples rather than their content, presenting data in an easy-to-hard sequence to improve optimizer trajectory and final convergence [26]. Its Pipeline-Mediated classification is the decisive taxonomic property: curriculum learning never executes a gradient update on the model—it operates strictly as a data-sequencing function upstream of the optimizer. The parametric modification that results from training on a curricularized dataset is performed entirely by the downstream training method; curriculum learning contributes only the temporal ordering of the input stream. This indirect mechanism is the structural reason for Pipeline-Dependent and Pipeline-Dependent: the D4 (Persistence) and D5 (Scope) profile of the resulting model are fully inherited from whichever downstream training method consumes the sequenced data. Compared to Data Augmentation, Data Augmentation synthetically extends the training set (via transformation), while curriculum learning operates on the existing dataset without modification—it changes the sampling order, not the examples. Compared to Active Learning, both share Pipeline-Dependent, but Active Learning introduces a Distributional Gap Bridging component by querying strategically chosen unlabeled samples, while Curriculum Learning's Task Specialization reflects that it optimizes the convergence trajectory rather than the distributional coverage. Because curriculum learning does not independently modify model parameters, it must be documented as a named algorithmic dependency of the primary training event it serves—specifying the difficulty-scoring methodology, sequencing protocol, and any pacing functions—rather than as a standalone change-control entry; the downstream training event inherits the full parametric and structural documentation burden.

Verbatim from the paper — Training Strategies

Nearest profiles

Active Learning (0.08), Data Augmentation (0.08), Semi-SL (0.17), FT (full) (0.70), MTL (0.70)

Computed from the taxonomy data (Gower distance over all six dimensions)

References

  1. [26] Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston 2009. Curriculum learning. Proceedings of the 26th Annual International Conference on Machine Learning

Numbered as in the paper

Cite this row

Curriculum Learning — six-dimensional profile
D1: pipeline-mediated
D2: task-specialization
D3: pipeline-dependent
D4: pipeline-dependent
D5: pipeline-dependent
D6: dl, fm, llm, ml, mllm
Source: arXiv:2608.06246
Compare with another technique Find in the explorer