Skip to content

Dimension D6

Model Type

What model is being adapted?

5 categories. Other dimensions: D1 D2 D3 D4 D5

CategoryDefinitionTechniques
DL
Deep Learning
No definition in the appendix. Training, FT (full), FT (partial), PEFT (LoRA, adapters), DA, FSL, Retraining, CL, TIL, DIL, LP, LEACE, Adversarial Training, Meta-Learning, MTL, Self-Play, Curriculum Learning, Active Learning, Data Augmentation, Semi-SL, SSL / CPT, DP-FT, FL, KD, Model Compression, TTA, Calibration, Machine Unlearning
28 technique(s)
FM
Foundation Model
No definition in the appendix. Training, FT (full), FT (partial), PEFT (LoRA, adapters), DA, FSL, Retraining, CL, TIL, DIL, LP, LEACE, Adversarial Training, Meta-Learning, MTL, Curriculum Learning, Active Learning, Data Augmentation, Semi-SL, SSL / CPT, DP-FT, FL, KD, Model Compression, Task Arith. & Model Merging, Long-Context Ext., MoE, Prompt Learning, TTA, Calibration, Cross-Modal Alignment, Machine Unlearning
32 technique(s)
LLM
Large Language Model
No definition in the appendix. Training, FT (full), FT (partial), PEFT (LoRA, adapters), ReFT, Retraining, CL, SFT, RLHF (LLM Alignment), DPO, RLAIF/CAI, RLVR/GRPO, LP, LEACE, Adversarial Training, MTL, Self-Play, Curriculum Learning, Active Learning, Data Augmentation, Semi-SL, SSL / CPT, DP-FT, FL, KD, Model Compression, Task Arith. & Model Merging, Long-Context Ext., MoE, PE, Prompt Learning, APO, RAG, ICL, CE, Test-Time Compute Scaling, Calibration, Machine Unlearning, Knowledge Editing, Activation Steering
40 technique(s)
ML
Machine Learning
No definition in the appendix. Training, Retraining, Curriculum Learning, Active Learning, Data Augmentation, Semi-SL, FL, Calibration
8 technique(s)
MLLM
Multimodal Large Language Model
No definition in the appendix. Training, FT (full), FT (partial), PEFT (LoRA, adapters), ReFT, Retraining, CL, SFT, RLHF (LLM Alignment), DPO, RLAIF/CAI, RLVR/GRPO, LP, LEACE, MTL, Curriculum Learning, Active Learning, Data Augmentation, Semi-SL, SSL / CPT, DP-FT, FL, KD, Model Compression, Task Arith. & Model Merging, Long-Context Ext., MoE, PE, Prompt Learning, APO, RAG, ICL, CE, Test-Time Compute Scaling, Calibration, Cross-Modal Alignment, Modality-Spec. Adapters, Multimodal Instr. Tuning, Machine Unlearning, Knowledge Editing, Activation Steering
41 technique(s)

Category definitions verbatim from the paper's appendix