Sas Swart b9d237b42c perf: improve memory use and cpu usage for OpenAI requests handled by bridge (#21838) ...

Apply optimizations:
* https://github.com/openai/openai-go/pull/602
* https://github.com/coder/aibridge/pull/160

These reduce CPU time and allocation count for OpenAI `chat/completions`
and `responses` APIs, making the use of OpenAI chat models through AI
Bridge more performant.

In order to test these changes, we add scaletesting support for the
responses API.

2026-02-02 16:16:16 +02:00

..

config.go

perf: improve memory use and cpu usage for OpenAI requests handled by bridge (#21838)

2026-02-02 16:16:16 +02:00

metrics.go

chore: add scaletesting tools for aibridge (#21279)

2026-01-15 17:05:46 +02:00

provider.go

perf: improve memory use and cpu usage for OpenAI requests handled by bridge (#21838)

2026-02-02 16:16:16 +02:00

run.go

perf: improve memory use and cpu usage for OpenAI requests handled by bridge (#21838)

2026-02-02 16:16:16 +02:00

strategy.go

perf: improve memory use and cpu usage for OpenAI requests handled by bridge (#21838)

2026-02-02 16:16:16 +02:00