Skip to content

Alignment, Reasoning, and Trustworthiness

Adversarial Training

In brief — site editorial, not from the paper

Trains on deliberately perturbed inputs so the model holds up against adversarial examples rather than breaking on small, crafted changes.

Definition

Adversarial training improves model robustness by incorporating adversarially perturbed examples directly into the optimization objective through a min-max formulation [134]. The Parametric Update coordinate reflects the defining operational property: adversarial perturbations are generated dynamically within the optimization loop, meaning the gradient signal itself is adversarially shaped at each training step—this is the mechanistic distinction from Data Augmentation, which modifies training inputs as a static pre-processing step independent of the gradient loop. This distinction is taxonomically consequential: adversarial training is a gradient-coupled technique whose computational cost scales with the inner maximization procedure at each step, while Data Augmentation's cost is absorbed in the data-loading stage. Both share Robustness, but only adversarial training carries Parametric Update with an adversarially shaped gradient signal, rather than the Pipeline-Mediated mechanism of augmentation. The DL, FM, LLM ceiling reflects an active research frontier: cross-modal adversarial robustness for vision-language MLLM architectures lacks standardized post-training protocols and established benchmark coverage, making the MLLM tier currently out of scope. Adversarial training universally trades off standard operational performance against robustness [195]; this Pareto trade-off must be explicitly characterized in the validation record, with the robustness-accuracy frontier documented as a system performance boundary—any deployment threshold revision following adversarial training constitutes a system behavior change requiring separate regression validation.

Verbatim from the paper — Alignment, Reasoning, and Trustworthiness

Nearest profiles

FT (full) (0.21), Training (0.23), DP-FT (0.38), MTL (0.38), Self-Play (0.39)

Computed from the taxonomy data (Gower distance over all six dimensions)

References

  1. [134] Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu 2018. Towards Deep Learning Models Resistant to Adversarial Attacks.
  2. [195] Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Alexander Turner, and Aleksander Madry 2018. Robustness May Be at Odds with Accuracy.

Numbered as in the paper

Cite this row

Adversarial Training — six-dimensional profile
D1: parametric-update
D2: robustness
D3: large-labeled
D4: ad-hoc-permanent, scheduled-permanent
D5: whole-model
D6: dl, fm, llm
Source: arXiv:2608.06246
Compare with another technique Find in the explorer