Data-Centric and Privacy-Preserving Methods
Semi-SL
In brief — site editorial, not from the paper
Trains on a small labelled set alongside a large unlabelled one, drawing a learning signal from the unlabelled data rather than leaving it unused.
Definition
Semi-SL leverages abundant unlabeled data alongside a small labeled set, making it highly valuable in domains where annotation is prohibitively expensive. Its Pipeline-Mediated classification groups it with the other data-pipeline strategies, but Semi-SL occupies a structurally distinct position within this group: unlike Curriculum Learning (which sequences existing labeled data) and Data Augmentation (which transforms existing labeled data), Semi-SL introduces unlabeled data—whose labels were never verified by a human or certified oracle—as a training signal source [28, 186]. Semi-SL is uniquely complex because it integrates two distinct data sources (Small Labeled, Unlabeled). Because the unlabeled pool lacks ground-truth verification, its inherent sampling bias and distributional coverage directly shape the model’s learned behavior, creating a structural transparency gap that distinguishes Semi-SL from purely supervised pipelines. Compared to SSL/CPT, which shares the Unlabeled dependency and uses self-supervised objectives directly, Semi-SL is Pipeline-Mediated—it does not itself prescribe an optimization objective or update parameters; it delivers a mixed labeled-and-pseudo-labeled dataset to a downstream training method. SSL/CPT is Parametric Update, defining its own objective and directly executing weight modifications. Because the unlabeled data pool's distributional properties directly determine the scope and boundaries of the downstream model's validated capabilities, the unlabeled corpus must be subjected to the same provenance documentation standards as the labeled set—including source identification, collection methodology, distributional characterization, and bias auditing.
Verbatim from the paper — Data-Centric and Privacy-Preserving Methods
Nearest profiles
Curriculum Learning (0.17), Active Learning (0.25), Data Augmentation (0.25), FT (partial) (0.62), Prompt Learning (0.65)
Computed from the taxonomy data (Gower distance over all six dimensions)
References
- [28] David Berthelot, Nicholas Carlini, Ian Goodfellow, Nicolas Papernot, Avital Oliver, and Colin A Raffel 2019. MixMatch: A Holistic Approach to Semi-Supervised Learning. Advances in Neural Information Processing Systems
- [186] Kihyuk Sohn et al. 2020. FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence. Advances in Neural Information Processing Systems
Numbered as in the paper
Cite this row
Semi-SL — six-dimensional profile D1: pipeline-mediated D2: task-specialization D3: small-labeled, unlabeled D4: pipeline-dependent D5: pipeline-dependent D6: dl, fm, llm, ml, mllm Source: arXiv:2608.06246Compare with another technique Find in the explorer