Inference-Time Adaptation
CE
In brief — site editorial, not from the paper
Manages everything that goes into the model's context — retrieved documents, tools, history — as a maintained, versioned production asset.
Definition
CE is the broader architectural discipline of dynamically assembling an LLM's inference context from multiple retrieved, historical, or real-time data sources—encompassing external document retrieval [67], agent memory [154], user profiles, tool outputs, and conversational history [154] (External Corpus, User Interaction Data). CE differs from PE in the structural locus of design: PE optimizes the content of a static input prompt, while CE designs the automated retrieval pipelines and orchestration systems that dynamically populate the model's context window at inference time. CE's External Corpus, User Interaction Data coordinate strictly distinguishes it from PE (Zero-Shot) by explicitly demanding complex, version-controlled retrieval and state-management infrastructure. Crucially, the live inference query serves solely as an execution trigger and data constraint, never as an on-the-fly parametric gradient signal (3tstOnly)—a strict architectural boundary that fundamentally separates CE from TTA. From a system engineering perspective, CE shifts the validation burden away from artifact-level model testing and toward complex state-machine verification. Because the model's operational envelope is dictated by dynamically retrieved external state, regression testing must rigorously validate the orchestration logic, context truncation algorithms, and data pipeline integrity rather than the static underlying model weights.
Verbatim from the paper — Inference-Time Adaptation
Notes from the table
Highly flexible techniques such as CE (e.g., prompting for step-by-step rationales) and RLHF (e.g., penalizing unexplainable refusals) can dynamically adopt Explainability as a primary goal when engineered specifically to satisfy regulatory transparency mandates.
Nearest profiles
RAG (0.17), APO (0.33), PE (0.36), ICL (0.44), Test-Time Compute Scaling (0.67)
Computed from the taxonomy data (Gower distance over all six dimensions)
References
- [67] Yunfan Gao et al. 2024. Retrieval-Augmented Generation for Large Language Models: A Survey. arXiv
- [154] Joon Sung Park, Joseph O'Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein 2023. Generative Agents: Interactive Simulacra of Human Behavior. Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology
Numbered as in the paper
Cite this row
CE — six-dimensional profile D1: context-injection D2: knowledge-update, personalization D3: external-corpus, user-interaction-data D4: version-persistent D5: input-output-space D6: llm, mllm Source: arXiv:2608.06246Compare with another technique Find in the explorer