feat: add agent chat spend limiting (backend) (#23071)

mirror of https://github.com/coder/coder.git synced 2026-09-24 15:04:27 +08:00

Introduces deployment-scoped spend limiting for Coder Agents, enabling
administrators to control LLM costs at global, group, and individual
user levels.

## Changes

- **Database migration (000437)**: `chat_usage_limit_config`
(singleton), `chat_usage_limit_overrides` (per-user),
`chat_usage_limit_group_overrides` (per-group)
- **Single-query limit resolution**: individual override > min(group) >
global default via `ResolveUserChatSpendLimit`
- **Fail-open enforcement** in chatd with documented TOCTOU trade-off
- **Experimental API** under `/api/experimental/chats/usage-limits` for
CRUD on limits
- **`AsChatd` RBAC subject** for narrowly-scoped daemon access (replaces
`AsSystemRestricted`)
- **Generated TypeScript types** for the frontend SDK

## Hierarchy

1. Individual user override (highest)
2. Minimum of group limits
3. Global default
4. Disabled / unlimited

Currency stored as micro-dollars (`1,000,000` = $1.00).

Frontend PR: #23072

This commit is contained in:

Michael Suchacz

2026-03-17 01:24:03 +01:00

committed by

GitHub

parent b69631cb35

commit 1031da9738

31 changed files with 3904 additions and 147 deletions

									
										coderd/database/migrations/000441_chat_usage_limits.down.sql
									
		+4
		
												View File
												
				@@ -0,0 +1,4 @@

				DROP INDEX IF EXISTS idx_chat_messages_owner_spend;

				ALTER TABLE groups DROP COLUMN IF EXISTS chat_spend_limit_micros;

				ALTER TABLE users DROP COLUMN IF EXISTS chat_spend_limit_micros;

				DROP TABLE IF EXISTS chat_usage_limit_config;