Alignment, Reasoning, and Trustworthiness
Adversarial Training
In brief — site editorial, not from the paper
Trains on deliberately perturbed inputs so the model holds up against adversarial examples rather than breaking on small, crafted changes.
Definition
Adversarial training improves model robustness by incorporating adversarially perturbed examples directly into the optimization objective through a min-max formulation [134]. The Parametric Update coordinate reflects the defining operational property: adversarial perturbations are generated dynamically within the optimization loop, meaning the gradient signal itself is adversarially shaped at each training step—this is the mechanistic distinction from Data Augmentation, which modifies training inputs as a static pre-processing step independent of the gradient loop. This distinction is taxonomically consequential: adversarial training is a gradient-coupled technique whose computational cost scales with the inner maximization procedure at each step, while Data Augmentation's cost is absorbed in the data-loading stage. Both share Robustness, but only adversarial training carries Parametric Update with an adversarially shaped gradient signal, rather than the Pipeline-Mediated mechanism of augmentation. The DL, FM, LLM ceiling reflects an active research frontier: cross-modal adversarial robustness for vision-language MLLM architectures lacks standardized post-training protocols and established benchmark coverage, making the MLLM tier currently out of scope. Adversarial training universally trades off standard operational performance against robustness [195]; this Pareto trade-off must be explicitly characterized in the validation record, with the robustness-accuracy frontier documented as a system performance boundary—any deployment threshold revision following adversarial training constitutes a system behavior change requiring separate regression validation.
Verbatim from the paper — Alignment, Reasoning, and Trustworthiness
Nearest profiles
FT (full) (0.21), Training (0.23), DP-FT (0.38), MTL (0.38), Self-Play (0.39)
Computed from the taxonomy data (Gower distance over all six dimensions)
References
- [134] Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu 2018. Towards Deep Learning Models Resistant to Adversarial Attacks.
- [195] Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Alexander Turner, and Aleksander Madry 2018. Robustness May Be at Odds with Accuracy.
Numbered as in the paper
Cite this row
Adversarial Training — six-dimensional profile D1: parametric-update D2: robustness D3: large-labeled D4: ad-hoc-permanent, scheduled-permanent D5: whole-model D6: dl, fm, llm Source: arXiv:2608.06246Compare with another technique Find in the explorer