Files
analysis_claude_code/s10_system_prompt

s10: Context Assembly — Build Model Input at Runtime

English · 中文 · 日本語

s01 → ... → s08 → s09 → s10s11 → s12 → ... → s20 → s21 → s22

"Model input is assembled, not hardcoded" — Stable sections + runtime state + caching.

Harness Layer: Context assembly — turn stable instructions and dynamic state into model input.


The Problem

From s01 to s09, the system prompt was always one hardcoded line:

SYSTEM = f"You are a coding agent at {WORKDIR}. Use tools to solve tasks."

That worked for s01 — only bash, read, write. But by s09, the agent has memory, compression, skill loading. The prompt needs to describe more and more capabilities:

SYSTEM = (
    f"You are a coding agent at {WORKDIR}. "
    "Use tools to solve tasks. Act, don't explain. "
    "Before starting any multi-step task, use todo_write. "
    "Skills are available via list_skills and load_skill. "
    "Relevant memories are injected below when available. "
    # ... add a capability, add a line
)

Three problems:

  1. Switching projects requires rewriting the entire prompt — no way to know what to change and what to keep
  2. One change can break others — adding a tool description might conflict with earlier instructions
  3. Every request carries everything — even when the current conversation doesn't need certain sections, they waste tokens

The system prompt should be a configuration assembled at runtime based on current state: which tools are enabled, which context is visible, which memories are relevant, and which content must remain stable to hit prompt cache.


The Solution

System Prompt Overview

s10 is a short bridge between context management and recovery. It does not add another storage system or merge s08 with s09. It shows where their outputs meet the model boundary: split the hardcoded SYSTEM into independent sections, assemble them from real runtime state, and cache the result.

Four sections, two loading strategies:

Section Strategy Content Condition
identity always who you are, how to work always present
tools always available tool list enabled_tools
workspace always working directory always present
memory on-demand relevant memory content whether .memory/MEMORY.md exists

Key design: whether a section loads depends on real state (tools exist, files exist), not keywords in messages.


How It Works

PROMPT_SECTIONS: Topic-Keyed Fragments

Split the monolithic string into a dictionary, each key is a topic:

PROMPT_SECTIONS = {
    "identity": "You are a coding agent. Act, don't explain.",
}

Each section is maintained independently. Changing tools doesn't affect identity; adding memory doesn't touch workspace.

assemble_system_prompt: On-Demand Assembly

Not every section is needed every turn. No memory files? Loading the memory section just wastes tokens. Assembly is based on real state in context:

def assemble_system_prompt(context: dict) -> str:
    sections = []

    # Always loaded
    sections.append(PROMPT_SECTIONS["identity"])

    # Dynamic — tools and workspace from context
    tools = ", ".join(context.get("enabled_tools", []))
    if tools:
        sections.append(f"Available tools: {tools}.")
    sections.append(f"Working directory: {context.get('workspace', WORKDIR)}")

    # On-demand — based on real state, not keywords
    memories = context.get("memories", "")
    if memories:
        sections.append(f"Relevant memories:\n{memories}")

    return "\n\n".join(sections)

"Always loaded" sections are needed every turn: identity, tools, workspace. "On-demand" sections are only useful under specific conditions.

Why not load everything? Tokens have cost (system prompt is billed every turn), and fewer instructions means more focused output (irrelevant instructions are noise).

get_system_prompt: Cache to Avoid Re-Assembly

When context hasn't changed (multiple LLM calls in the same turn with the same context), re-assembling is wasteful. Use deterministic serialization to detect changes and return cached result:

def get_system_prompt(context: dict) -> str:
    global _last_context_key, _last_prompt
    key = json.dumps(context, sort_keys=True, ensure_ascii=False, default=str)
    if key == _last_context_key and _last_prompt:
        return _last_prompt
    _last_context_key = key
    _last_prompt = assemble_system_prompt(context)
    return _last_prompt

json.dumps instead of hash(): Python's built-in hash() has process randomization (unsuitable for stable cache keys) and throws unhashable type on nested dicts/lists.

Note: this cache only avoids redundant string assembly within a process. It's not the same as CC's API prompt cache, which uses SYSTEM_PROMPT_DYNAMIC_BOUNDARY to separate static and dynamic parts — the static parts hit global cache and don't invalidate when dynamic content changes.

context: Real State, Not Keyword Guessing

Context reflects the actual runtime state:

def update_context(context: dict, messages: list) -> dict:
    memories = ""
    if MEMORY_INDEX.exists():
        content = MEMORY_INDEX.read_text().strip()
        if content:
            memories = content
    return {
        "enabled_tools": list(TOOL_HANDLERS.keys()),
        "workspace": str(WORKDIR),
        "memories": memories,
    }

enabled_tools lists actually registered tools. memories checks whether .memory/MEMORY.md exists. Section loading is based on this real state, not searching for keywords in messages.

Putting It Together

def agent_loop(messages: list, context: dict):
    system = get_system_prompt(context)
    while True:
        response = client.messages.create(
            model=MODEL, system=system, messages=messages,
            tools=TOOLS, max_tokens=8000)
        # ... tool execution ...
        context = update_context(context, messages)
        system = get_system_prompt(context)

At the start of each loop iteration, get the system prompt. If context changed, re-assemble; if not, return cached version.


Changes From s09

Component Before (s09) After (s10)
prompt Hardcoded SYSTEM string PROMPT_SECTIONS + assemble_system_prompt
caching None get_system_prompt (json.dumps detection + cache)
new functions assemble_system_prompt, get_system_prompt, update_context
tools bash, read_file, write_file (3) bash, read_file, write_file (3) — unchanged
loop Uses fixed SYSTEM Uses get_system_prompt(context)

Try It

cd learn-claude-code
python s10_system_prompt/code.py

Safety note: this focused teaching script still executes the model's bash string with shell=True and omits s03's permission gate. Run it only in a disposable workspace; production harnesses must restore permission and sandbox boundaries.

What to watch for:

  1. Output shows which sections were loaded ([assembled] sections: ... label)
  2. Cache hits show [cache hit] during continued conversation
  3. Creating .memory/MEMORY.md makes the memory section appear on the next turn

Try these prompts:

  1. Read the file README.md (observe the three always-loaded sections)
  2. Create a file called .memory/MEMORY.md with content "- [test](test.md) — test memory" (write a memory index)
  3. Read the file code.py (observe whether the memory section appears)

What's Next

The model input can now be assembled at runtime. But the agent still crashes on errors. Network hiccups, API rate limits, truncated output, context overflow — these aren't bugs, they're normal.

s11 Error Recovery → four recovery paths. Upgrade tokens, compress context, exponential backoff, switch models.