Skip to content

Data-Centric and Privacy-Preserving Methods

Semi-SL

In brief — site editorial, not from the paper

Trains on a small labelled set alongside a large unlabelled one, drawing a learning signal from the unlabelled data rather than leaving it unused.

Definition

Semi-SL leverages abundant unlabeled data alongside a small labeled set, making it highly valuable in domains where annotation is prohibitively expensive. Its Pipeline-Mediated classification groups it with the other data-pipeline strategies, but Semi-SL occupies a structurally distinct position within this group: unlike Curriculum Learning (which sequences existing labeled data) and Data Augmentation (which transforms existing labeled data), Semi-SL introduces unlabeled data—whose labels were never verified by a human or certified oracle—as a training signal source [28, 186]. Semi-SL is uniquely complex because it integrates two distinct data sources (Small Labeled, Unlabeled). Because the unlabeled pool lacks ground-truth verification, its inherent sampling bias and distributional coverage directly shape the model’s learned behavior, creating a structural transparency gap that distinguishes Semi-SL from purely supervised pipelines. Compared to SSL/CPT, which shares the Unlabeled dependency and uses self-supervised objectives directly, Semi-SL is Pipeline-Mediated—it does not itself prescribe an optimization objective or update parameters; it delivers a mixed labeled-and-pseudo-labeled dataset to a downstream training method. SSL/CPT is Parametric Update, defining its own objective and directly executing weight modifications. Because the unlabeled data pool's distributional properties directly determine the scope and boundaries of the downstream model's validated capabilities, the unlabeled corpus must be subjected to the same provenance documentation standards as the labeled set—including source identification, collection methodology, distributional characterization, and bias auditing.

Verbatim from the paper — Data-Centric and Privacy-Preserving Methods

Nearest profiles

Curriculum Learning (0.17), Active Learning (0.25), Data Augmentation (0.25), FT (partial) (0.62), Prompt Learning (0.65)

Computed from the taxonomy data (Gower distance over all six dimensions)

References

  1. [28] David Berthelot, Nicholas Carlini, Ian Goodfellow, Nicolas Papernot, Avital Oliver, and Colin A Raffel 2019. MixMatch: A Holistic Approach to Semi-Supervised Learning. Advances in Neural Information Processing Systems
  2. [186] Kihyuk Sohn et al. 2020. FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence. Advances in Neural Information Processing Systems

Numbered as in the paper

Cite this row

Semi-SL — six-dimensional profile
D1: pipeline-mediated
D2: task-specialization
D3: small-labeled, unlabeled
D4: pipeline-dependent
D5: pipeline-dependent
D6: dl, fm, llm, ml, mllm
Source: arXiv:2608.06246
Compare with another technique Find in the explorer