mirror of
https://github.com/coder/coder.git
synced 2026-09-24 15:04:27 +08:00
feat: support custom bedrock base url (#21582)
Closes https://github.com/coder/aibridge/issues/126 Depends on https://github.com/coder/aibridge/pull/131 --------- Signed-off-by: Danny Kopping <danny@coder.com>
This commit is contained in:
@@ -58,6 +58,11 @@ Set the following when routing [Amazon Bedrock](https://coder.com/docs/reference
|
||||
- `CODER_AIBRIDGE_BEDROCK_MODEL` or `--aibridge-bedrock-model`
|
||||
- `CODER_AIBRIDGE_BEDROCK_SMALL_FAST_MODEL` or `--aibridge-bedrock-small-fast-model`
|
||||
|
||||
> [!NOTE]
|
||||
> `CODER_AIBRIDGE_BEDROCK_BASE_URL` or `--aibridge-bedrock-base-url` may be used instead of `CODER_AIBRIDGE_BEDROCK_REGION`/`--aibridge-bedrock-region`
|
||||
if you would like to specify a URL which does not follow the form of `https://bedrock-runtime.<region>.amazonaws.com` - for example if using a
|
||||
proxy between AI Bridge and AWS Bedrock.
|
||||
|
||||
#### Obtaining Bedrock credentials
|
||||
|
||||
1. **Choose a region** where you want to use Bedrock.
|
||||
|
||||
Generated
+1
@@ -181,6 +181,7 @@ curl -X GET http://coder-server:8080/api/v2/deployment/config \
|
||||
"bedrock": {
|
||||
"access_key": "string",
|
||||
"access_key_secret": "string",
|
||||
"base_url": "string",
|
||||
"model": "string",
|
||||
"region": "string",
|
||||
"small_fast_model": "string"
|
||||
|
||||
Generated
+6
@@ -357,6 +357,7 @@
|
||||
{
|
||||
"access_key": "string",
|
||||
"access_key_secret": "string",
|
||||
"base_url": "string",
|
||||
"model": "string",
|
||||
"region": "string",
|
||||
"small_fast_model": "string"
|
||||
@@ -369,6 +370,7 @@
|
||||
|---------------------|--------|----------|--------------|-------------|
|
||||
| `access_key` | string | false | | |
|
||||
| `access_key_secret` | string | false | | |
|
||||
| `base_url` | string | false | | |
|
||||
| `model` | string | false | | |
|
||||
| `region` | string | false | | |
|
||||
| `small_fast_model` | string | false | | |
|
||||
@@ -384,6 +386,7 @@
|
||||
"bedrock": {
|
||||
"access_key": "string",
|
||||
"access_key_secret": "string",
|
||||
"base_url": "string",
|
||||
"model": "string",
|
||||
"region": "string",
|
||||
"small_fast_model": "string"
|
||||
@@ -749,6 +752,7 @@
|
||||
"bedrock": {
|
||||
"access_key": "string",
|
||||
"access_key_secret": "string",
|
||||
"base_url": "string",
|
||||
"model": "string",
|
||||
"region": "string",
|
||||
"small_fast_model": "string"
|
||||
@@ -2672,6 +2676,7 @@ CreateWorkspaceRequest provides options for creating a new workspace. Only one o
|
||||
"bedrock": {
|
||||
"access_key": "string",
|
||||
"access_key_secret": "string",
|
||||
"base_url": "string",
|
||||
"model": "string",
|
||||
"region": "string",
|
||||
"small_fast_model": "string"
|
||||
@@ -3224,6 +3229,7 @@ CreateWorkspaceRequest provides options for creating a new workspace. Only one o
|
||||
"bedrock": {
|
||||
"access_key": "string",
|
||||
"access_key_secret": "string",
|
||||
"base_url": "string",
|
||||
"model": "string",
|
||||
"region": "string",
|
||||
"small_fast_model": "string"
|
||||
|
||||
Generated
+11
-1
@@ -1742,6 +1742,16 @@ The base URL of the Anthropic API.
|
||||
|
||||
The key to authenticate against the Anthropic API.
|
||||
|
||||
### --aibridge-bedrock-base-url
|
||||
|
||||
| | |
|
||||
|-------------|-----------------------------------------------|
|
||||
| Type | <code>string</code> |
|
||||
| Environment | <code>$CODER_AIBRIDGE_BEDROCK_BASE_URL</code> |
|
||||
| YAML | <code>aibridge.bedrock_base_url</code> |
|
||||
|
||||
The base URL to use for the AWS Bedrock API. Use this setting to specify an exact URL to use. Takes precedence over CODER_AIBRIDGE_BEDROCK_REGION.
|
||||
|
||||
### --aibridge-bedrock-region
|
||||
|
||||
| | |
|
||||
@@ -1750,7 +1760,7 @@ The key to authenticate against the Anthropic API.
|
||||
| Environment | <code>$CODER_AIBRIDGE_BEDROCK_REGION</code> |
|
||||
| YAML | <code>aibridge.bedrock_region</code> |
|
||||
|
||||
The AWS Bedrock API region.
|
||||
The AWS Bedrock API region to use. Constructs a base URL to use for the AWS Bedrock API in the form of 'https://bedrock-runtime.<region>.amazonaws.com'.
|
||||
|
||||
### --aibridge-bedrock-access-key
|
||||
|
||||
|
||||
Reference in New Issue
Block a user