Training Strategies
Active Learning
In brief — site editorial, not from the paper
Lets the model choose which examples get labelled next, concentrating scarce annotation effort where it will help most.
Definition
Active learning strategically selects the most informative unlabeled samples for oracle annotation, maximizing model improvement per labeled example by targeting the data points the model is most uncertain about [174]. Like Curriculum Learning, it carries Pipeline-Mediated: the model's parameters are updated by a downstream training method, not by the active learning mechanism itself. However, Active Learning diverges from Curriculum Learning on D2 (Goal): where curriculum learning sequences existing labeled data for convergence optimization (Task Specialization only), active learning's query strategy inherently introduces a Distributional Gap Bridging component—by selectively targeting uncertainty-rich, informationally dense regions of the unlabeled distribution, it constructs a labeled dataset whose coverage is deliberately biased toward the model's current capability boundaries. This D2 (Goal) distinction is operationally significant: curriculum learning does not change the statistical composition of the labeled dataset; active learning does, and the algorithmic selection strategy is the direct determinant of the distributional coverage of the resulting training corpus. The Pipeline-Dependent and Pipeline-Dependent coordinates confirm that persistence and structural scope are fully inherited from the downstream training method—but the labeled dataset itself, as an artifact of the active selection process, constitutes an independent data-provenance record that must be documented and audited separately. The active learning acquisition function must be explicitly documented and version-controlled as a system configuration artifact; the selection strategy directly defines the boundaries of the model's validated operational envelope, and any change to the acquisition function constitutes a data-pipeline modification requiring re-evaluation of the distributional coverage of the resulting labeled corpus before downstream training commences.
Verbatim from the paper — Training Strategies
Nearest profiles
Curriculum Learning (0.08), Data Augmentation (0.11), Semi-SL (0.25), FT (full) (0.78), MTL (0.78)
Computed from the taxonomy data (Gower distance over all six dimensions)
References
- [174] Burr Settles 2009. Active Learning Literature Survey. University of Wisconsin-Madison Department of Computer Sciences
Numbered as in the paper
Cite this row
Active Learning — six-dimensional profile D1: pipeline-mediated D2: distributional-gap-bridging, task-specialization D3: pipeline-dependent D4: pipeline-dependent D5: pipeline-dependent D6: dl, fm, llm, ml, mllm Source: arXiv:2608.06246Compare with another technique Find in the explorer