Files
coder/agent/agentcontext/push_test.go
T
Kyle Carberry 1742003785 fix(agent): gate workspace context collection until the agent is ready (#26715)
## Problem

Workspace context surfaced in chat (Coder Agents) is incomplete and racy
on a fresh boot:

- The context panel is missing personal skills (only repo-level skills
under `.claude/skills` show up).
- The MCP section lists `.mcp.json` files but no MCP servers are
registered.
- The Issues panel reports instruction files as unreadable, e.g.
`CLAUDE.md (file: unreadable)` and `.cursorrules (file: unreadable)`
with `symlink resolve: lstat .../AGENTS.md: no such file or directory`.

## Root cause

`agentcontext.Manager` collected and pushed context too eagerly:

- `NewManager` ran an eager resolve at agent `init()`.
- `RunPush` starts as a normal connection routine (`startAgentAPI210`)
with no lifecycle gating, so the first snapshot was pushed
(`Initial=true`) as soon as the agent API connected.

Both happened **before startup scripts finish** and before the lifecycle
reaches `ready`. At that point:

- `CLAUDE.md` / `.cursorrules` symlinks to `AGENTS.md` don't resolve
yet, so `EvalSymlinks` fails and the resolver emits `StatusUnreadable`
"symlink resolve" issues.
- Personal skills haven't synced yet, so they're missing.
- MCP servers connect via `mcpManager.Reload(...)` only **after**
`ready`, so only `.mcp.json` configs appear, with no servers.

That partial, error-laden snapshot is persisted by coderd and can
hydrate a chat.

## Fix

Gate `agentcontext.Manager` until the agent is ready, unconditionally:

- The Manager always starts gated. `NewManager` leaves the zero-value
(version 0) snapshot in place and never walks the filesystem; `RunPush`
withholds version-0 snapshots, so nothing reaches coderd.
- The agent calls `Manager.SetReady()` from the lifecycle transition in
`handleManifest`, right after startup scripts finish (`ready`, or
terminal `start_error` / `start_timeout` so a failed startup still
surfaces whatever context exists).
- On `SetReady`, the Manager performs the first real resolve (version 1)
and broadcasts it; `RunPush` ships it with `Initial=true`. Later changes
(MCP connect, skill edits) re-resolve and push as before.

Eager resolution before `ready` was the bug, not a mode worth
preserving, so the gate is always on rather than an opt-in option. This
aligns the agent-side push with chatd, which already waits for agent
readiness before loading context. No proto/coderd/DB changes: coderd
simply never receives a pre-ready snapshot.

<details>
<summary>Design notes &amp; decisions</summary>

- **Unconditional, not opt-in.** An earlier iteration added the gate as
an opt-in `ManagerOptions.GateUntilReady`. Since the eager
resolve-on-construct was the defect, the option, the eager first
resolve, and the now-dead `resolveLocked` helper were all removed; the
Manager is always gated until `SetReady`.
- **Version 0 is the pre-ready sentinel.** The gated placeholder is just
the zero-value snapshot (version 0); the first real resolve is version
1, so the push loop withholds anything at version 0. An earlier revision
carried a dedicated `Snapshot.Initializing` bool plus an HTTP `/resync`
field, but the push loop was the only consumer and nothing read the HTTP
field, so both were dropped.
- **Defer, don't retry symlinks.** Transient "unreadable" symlinks are
an artifact of collecting before checkout. Deferring until `ready` fixes
all three symptom classes at once and avoids masking genuine post-ready
errors (a broken symlink at `ready` is still reported).
- **Release on terminal startup states too** (`start_error`,
`start_timeout`), so a failed startup still surfaces whatever context
exists instead of gating forever. On reconnect the Manager instance is
reused and stays ready.

</details>

## Tests

- `agentcontext.TestManager_WithholdsCollectionUntilReady` simulates
collection running before startup finishes (broken `CLAUDE.md` /
`.cursorrules` -> `AGENTS.md` symlinks): asserts the gated snapshot is
the empty version-0 placeholder with no resources and no `unreadable`
issues, and that after `SetReady` (target now present) the inventory
resolves cleanly to a single instruction file with no spurious issues.
- `agentcontext.TestRunPush_WaitsForReady` asserts the push loop ships
nothing while gated even when content exists, then ships the full
inventory with `Initial=true` after `SetReady`.
- `agentcontext.TestManager_SetReadyIsIdempotent` covers the version-0
placeholder before ready, the single resolve to version 1 on `SetReady`,
and idempotency across repeated calls.
- Updated `agent.TestAgent_ContextStatePushed`: the first push now
already contains `AGENTS.md` with `Initial=true` and no `UNREADABLE`
resources (no pre-startup empty/partial push).

Validated on the changed packages: `go test -race
./agent/agentcontext/...`, `go test ./agent/ -run
TestAgent_ContextStatePushed`, `golangci-lint run`, `go vet`, `gofmt`
(all clean).

---
🤖 Generated by Coder Agents on behalf of @kylecarbs.
2026-06-25 14:17:50 -06:00

360 lines
9.9 KiB
Go

package agentcontext_test
import (
"context"
"os"
"path/filepath"
"sync"
"testing"
"time"
"github.com/stretchr/testify/require"
"golang.org/x/xerrors"
"github.com/coder/coder/v2/agent/agentcontext"
"github.com/coder/coder/v2/testutil"
"github.com/coder/quartz"
)
// fakePusher records every push and lets the test control the
// returned response and error.
type fakePusher struct {
mu sync.Mutex
requests []*agentcontext.PushRequest
resp *agentcontext.PushResponse
err error
// errOnce is non-nil to simulate a single transient
// failure followed by success.
errOnce error
signal chan struct{}
}
func newFakePusher() *fakePusher {
return &fakePusher{
resp: &agentcontext.PushResponse{Accepted: true},
signal: make(chan struct{}, 16),
}
}
func (p *fakePusher) PushContextState(_ context.Context, req *agentcontext.PushRequest) (*agentcontext.PushResponse, error) {
p.mu.Lock()
defer p.mu.Unlock()
p.requests = append(p.requests, req)
if p.errOnce != nil {
err := p.errOnce
p.errOnce = nil
return nil, err
}
select {
case p.signal <- struct{}{}:
default:
}
return p.resp, p.err
}
func (p *fakePusher) snapshot() []*agentcontext.PushRequest {
p.mu.Lock()
defer p.mu.Unlock()
out := make([]*agentcontext.PushRequest, len(p.requests))
copy(out, p.requests)
return out
}
func TestRunPush_FirstPushIsInitial(t *testing.T) {
t.Parallel()
dir := t.TempDir()
require.NoError(t, os.WriteFile(filepath.Join(dir, "AGENTS.md"), []byte("v1"), 0o600))
m := newTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return dir },
})
p := newFakePusher()
ctx, cancel := context.WithCancel(testutil.Context(t, testutil.WaitShort))
defer cancel()
pushDone := make(chan error, 1)
go func() {
pushDone <- m.RunPush(ctx, p, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
})
}()
// Wait for the first push.
select {
case <-p.signal:
case <-time.After(testutil.WaitShort):
t.Fatalf("expected initial push")
}
requests := p.snapshot()
require.Len(t, requests, 1)
require.True(t, requests[0].Initial, "first push must be initial")
require.Equal(t, uint64(1), requests[0].Version)
cancel()
require.ErrorIs(t, <-pushDone, context.Canceled)
}
func TestRunPush_SubsequentPushOnChange(t *testing.T) {
t.Parallel()
dir := t.TempDir()
require.NoError(t, os.WriteFile(filepath.Join(dir, "AGENTS.md"), []byte("v1"), 0o600))
m := newTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return dir },
})
p := newFakePusher()
ctx, cancel := context.WithCancel(testutil.Context(t, testutil.WaitShort))
defer cancel()
pushDone := make(chan error, 1)
go func() {
pushDone <- m.RunPush(ctx, p, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
})
}()
// Initial push.
<-p.signal
// Trigger a resync via Resync.
require.NoError(t, os.WriteFile(filepath.Join(dir, "AGENTS.md"), []byte("v2"), 0o600))
_, err := m.Resync(ctx)
require.NoError(t, err)
// Second push.
select {
case <-p.signal:
case <-time.After(testutil.WaitShort):
t.Fatalf("expected second push after resync")
}
requests := p.snapshot()
require.GreaterOrEqual(t, len(requests), 2)
require.False(t, requests[1].Initial, "subsequent pushes must not be Initial")
require.NotEqual(t, requests[0].AggregateHash, requests[1].AggregateHash,
"second push must reflect the v2 content, not a duplicate of the first snapshot")
require.Greater(t, requests[1].Version, requests[0].Version,
"version must advance between snapshots")
cancel()
require.ErrorIs(t, <-pushDone, context.Canceled)
}
func TestRunPush_StopsOnUnimplemented(t *testing.T) {
t.Parallel()
m := newTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return t.TempDir() },
})
p := newFakePusher()
p.err = agentcontext.ErrPushUnimplemented
ctx := testutil.Context(t, testutil.WaitShort)
err := m.RunPush(ctx, p, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
})
require.NoError(t, err, "Unimplemented must stop the loop cleanly")
}
func TestRunPush_RetriesTransientError(t *testing.T) {
t.Parallel()
mClock := quartz.NewMock(t)
trap := mClock.Trap().NewTimer()
defer trap.Close()
m := newTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return t.TempDir() },
})
p := newFakePusher()
p.errOnce = xerrors.New("transient")
ctx, cancel := context.WithCancel(testutil.Context(t, testutil.WaitShort))
defer cancel()
pushDone := make(chan error, 1)
go func() {
pushDone <- m.RunPush(ctx, p, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
InitialBackoff: time.Second,
Clock: mClock,
})
}()
// First push hits transient and arms the retry timer. Wait for
// the timer creation, then advance the clock past the backoff.
call := trap.MustWait(ctx)
call.MustRelease(ctx)
mClock.Advance(time.Second).MustWait(ctx)
select {
case <-p.signal:
case <-time.After(testutil.WaitShort):
t.Fatalf("expected push after transient error")
}
require.GreaterOrEqual(t, len(p.snapshot()), 2)
cancel()
<-pushDone
}
// TestRunPush_ClosesOnManagerClose verifies that calling
// Manager.Close terminates an in-flight RunPush even when the
// caller's context is still live. Without this guarantee the
// agent shutdown would leak a push goroutine until the
// surrounding ctx expired.
func TestRunPush_ClosesOnManagerClose(t *testing.T) {
t.Parallel()
m := newTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return t.TempDir() },
})
p := newFakePusher()
ctx := testutil.Context(t, testutil.WaitShort)
done := make(chan error, 1)
go func() {
done <- m.RunPush(ctx, p, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
})
}()
// Wait for the initial push so the loop is parked on the
// change channel, then close the Manager and assert that
// RunPush returns promptly with a nil error.
select {
case <-p.signal:
case <-ctx.Done():
t.Fatalf("initial push never landed: %v", ctx.Err())
}
require.NoError(t, m.Close())
select {
case err := <-done:
require.NoError(t, err)
case <-ctx.Done():
t.Fatalf("RunPush did not return after Manager.Close: %v", ctx.Err())
}
}
// TestRunPush_RejectedResponseProceeds verifies the contract
// that an Accepted=false response is not retried: pushWithRetry
// returns success and RunPush parks on the next change instead
// of re-sending the same snapshot. A regression that added
// retry-on-reject logic would loop here and fail the test.
func TestRunPush_RejectedResponseProceeds(t *testing.T) {
t.Parallel()
dir := t.TempDir()
require.NoError(t, os.WriteFile(filepath.Join(dir, "AGENTS.md"), []byte("v1"), 0o600))
m := newTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return dir },
})
p := newFakePusher()
p.resp = &agentcontext.PushResponse{Accepted: false}
ctx, cancel := context.WithCancel(testutil.Context(t, testutil.WaitShort))
defer cancel()
pushDone := make(chan error, 1)
go func() {
pushDone <- m.RunPush(ctx, p, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
})
}()
// Initial push delivered and accepted=false; loop must park
// on changes, not retry the same payload.
select {
case <-p.signal:
case <-ctx.Done():
t.Fatalf("initial push never landed: %v", ctx.Err())
}
// Trigger a content change so a second push lands. Without
// the change, the loop should remain parked.
require.NoError(t, os.WriteFile(filepath.Join(dir, "AGENTS.md"), []byte("v2"), 0o600))
_, err := m.Resync(ctx)
require.NoError(t, err)
select {
case <-p.signal:
case <-ctx.Done():
t.Fatalf("second push never landed after change: %v", ctx.Err())
}
requests := p.snapshot()
require.GreaterOrEqual(t, len(requests), 2,
"exactly one push per snapshot; rejection must not double-fire")
require.NotEqual(t, requests[0].AggregateHash, requests[1].AggregateHash)
cancel()
require.ErrorIs(t, <-pushDone, context.Canceled)
}
// TestRunPush_WaitsForReady verifies the push loop ships nothing while
// the Manager is gated and ships the complete inventory once SetReady
// fires, so coderd never sees pre-startup partial state.
func TestRunPush_WaitsForReady(t *testing.T) {
t.Parallel()
dir := t.TempDir()
// Content exists from the start, but the Manager is gated: nothing
// is pushed until SetReady.
require.NoError(t, os.WriteFile(filepath.Join(dir, "AGENTS.md"), []byte("rules"), 0o600))
m := newPendingTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return dir },
})
p := newFakePusher()
ctx, cancel := context.WithCancel(testutil.Context(t, testutil.WaitLong))
defer cancel()
pushDone := make(chan error, 1)
go func() {
pushDone <- m.RunPush(ctx, p, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
})
}()
// While gated, no push must be sent even though AGENTS.md exists.
select {
case <-p.signal:
t.Fatal("push loop shipped a snapshot before SetReady")
case <-time.After(testutil.IntervalMedium):
}
require.Empty(t, p.snapshot(), "no push must happen before the gate releases")
// Startup completes; the gate releases and the first real snapshot
// is pushed with Initial=true.
m.SetReady()
select {
case <-p.signal:
case <-time.After(testutil.WaitShort):
t.Fatal("expected a push after SetReady")
}
requests := p.snapshot()
require.NotEmpty(t, requests)
first := requests[0]
require.True(t, first.Initial, "first push after the gate releases must be Initial")
require.NotEmpty(t, first.Resources, "first push must carry the resolved inventory")
require.Empty(t, first.SnapshotError, "first push must not carry a transient snapshot error")
cancel()
require.ErrorIs(t, <-pushDone, context.Canceled)
}
func TestRunPush_NilPusherErrors(t *testing.T) {
t.Parallel()
m := newTestManager(t, agentcontext.ManagerOptions{
WorkingDir: func() string { return t.TempDir() },
})
err := m.RunPush(context.Background(), nil, agentcontext.PushOptions{
Logger: testutil.Logger(t).Named("push"),
})
require.Error(t, err)
}