Agent Status String
Agent Status String – a summary of dynamic metadata inserted at the end of the context: tool call counters, TODO progress, current time, environment state. Analogy – phone status bar.
Theoretical basis: in-context learning is more like retrieval than reasoning – the model is good at finding, but bad at aggregating itself.
Requirements:
- the status string should be maintained by code, not LLM;
- it should cover all possible questions – otherwise it becomes a “false authority”;
- its accuracy is a first-order production metric.
Effect: saves strong models 80–90% of thinking tokens, raises accuracy of weak models by tens of points.
Related: Three Rules for KV Cache Friendliness, Context Compression, Dynamic Tool Loading