mirror of
https://github.com/aiclientproxy/proxycast.git
synced 2026-09-24 23:10:56 +08:00
cosoandClaude Sonnet 4.6
0b2d3caa6c
- Add response cache middleware (backed by aster-rust implementation) - Add request deduplication middleware to prevent duplicate in-flight requests - Add capability routing metrics middleware for model/provider fallback tracking - Add idempotency stats (atomic counters) to IdempotencyStore - Expose all four stores in ServerState and surface stats in ServerStatus - Add ResponseCacheSettings to ServerConfig with defaults (600s TTL, 200 max entries) - Add API server observability infrastructure (IdempotencyGuard, RequestDedupGuard, ResponseCacheGuard) - Add inline capability detection for vision/tools/context when routing requests - Register workspace_ensure_ready and workspace_ensure_default_ready commands in runner - Update docs with response_cache configuration example Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>