Skip to content

Inference-Time Adaptation

CE

In brief — site editorial, not from the paper

Manages everything that goes into the model's context — retrieved documents, tools, history — as a maintained, versioned production asset.

Definition

CE is the broader architectural discipline of dynamically assembling an LLM's inference context from multiple retrieved, historical, or real-time data sources—encompassing external document retrieval [67], agent memory [154], user profiles, tool outputs, and conversational history [154] (External Corpus, User Interaction Data). CE differs from PE in the structural locus of design: PE optimizes the content of a static input prompt, while CE designs the automated retrieval pipelines and orchestration systems that dynamically populate the model's context window at inference time. CE's External Corpus, User Interaction Data coordinate strictly distinguishes it from PE (Zero-Shot) by explicitly demanding complex, version-controlled retrieval and state-management infrastructure. Crucially, the live inference query serves solely as an execution trigger and data constraint, never as an on-the-fly parametric gradient signal (3tstOnly)—a strict architectural boundary that fundamentally separates CE from TTA. From a system engineering perspective, CE shifts the validation burden away from artifact-level model testing and toward complex state-machine verification. Because the model's operational envelope is dictated by dynamically retrieved external state, regression testing must rigorously validate the orchestration logic, context truncation algorithms, and data pipeline integrity rather than the static underlying model weights.

Verbatim from the paper — Inference-Time Adaptation

Notes from the table

Highly flexible techniques such as CE (e.g., prompting for step-by-step rationales) and RLHF (e.g., penalizing unexplainable refusals) can dynamically adopt Explainability as a primary goal when engineered specifically to satisfy regulatory transparency mandates.

Nearest profiles

RAG (0.17), APO (0.33), PE (0.36), ICL (0.44), Test-Time Compute Scaling (0.67)

Computed from the taxonomy data (Gower distance over all six dimensions)

References

  1. [67] Yunfan Gao et al. 2024. Retrieval-Augmented Generation for Large Language Models: A Survey. arXiv
  2. [154] Joon Sung Park, Joseph O'Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein 2023. Generative Agents: Interactive Simulacra of Human Behavior. Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Numbered as in the paper

Cite this row

CE — six-dimensional profile
D1: context-injection
D2: knowledge-update, personalization
D3: external-corpus, user-interaction-data
D4: version-persistent
D5: input-output-space
D6: llm, mllm
Source: arXiv:2608.06246
Compare with another technique Find in the explorer