Skip to content

Training Strategies

Active Learning

In brief — site editorial, not from the paper

Lets the model choose which examples get labelled next, concentrating scarce annotation effort where it will help most.

Definition

Active learning strategically selects the most informative unlabeled samples for oracle annotation, maximizing model improvement per labeled example by targeting the data points the model is most uncertain about [174]. Like Curriculum Learning, it carries Pipeline-Mediated: the model's parameters are updated by a downstream training method, not by the active learning mechanism itself. However, Active Learning diverges from Curriculum Learning on D2 (Goal): where curriculum learning sequences existing labeled data for convergence optimization (Task Specialization only), active learning's query strategy inherently introduces a Distributional Gap Bridging component—by selectively targeting uncertainty-rich, informationally dense regions of the unlabeled distribution, it constructs a labeled dataset whose coverage is deliberately biased toward the model's current capability boundaries. This D2 (Goal) distinction is operationally significant: curriculum learning does not change the statistical composition of the labeled dataset; active learning does, and the algorithmic selection strategy is the direct determinant of the distributional coverage of the resulting training corpus. The Pipeline-Dependent and Pipeline-Dependent coordinates confirm that persistence and structural scope are fully inherited from the downstream training method—but the labeled dataset itself, as an artifact of the active selection process, constitutes an independent data-provenance record that must be documented and audited separately. The active learning acquisition function must be explicitly documented and version-controlled as a system configuration artifact; the selection strategy directly defines the boundaries of the model's validated operational envelope, and any change to the acquisition function constitutes a data-pipeline modification requiring re-evaluation of the distributional coverage of the resulting labeled corpus before downstream training commences.

Verbatim from the paper — Training Strategies

Nearest profiles

Curriculum Learning (0.08), Data Augmentation (0.11), Semi-SL (0.25), FT (full) (0.78), MTL (0.78)

Computed from the taxonomy data (Gower distance over all six dimensions)

References

  1. [174] Burr Settles 2009. Active Learning Literature Survey. University of Wisconsin-Madison Department of Computer Sciences

Numbered as in the paper

Cite this row

Active Learning — six-dimensional profile
D1: pipeline-mediated
D2: distributional-gap-bridging, task-specialization
D3: pipeline-dependent
D4: pipeline-dependent
D5: pipeline-dependent
D6: dl, fm, llm, ml, mllm
Source: arXiv:2608.06246
Compare with another technique Find in the explorer