Repository navigation
[Feat] Add GPT-5.6 Sol to Amazon Bedrock #1575
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -428,6 +428,15 @@ export const bedrockModels = { | |
| outputPrice: 6.0, | ||
| description: "GPT-OSS 120B - Production-ready, general-purpose, high-reasoning model", | ||
| }, | ||
| "openai.gpt-5.6-sol": { | ||
| maxTokens: 128_000, | ||
| contextWindow: 1_000_000, | ||
| supportsImages: true, | ||
| supportsPromptCache: false, | ||
|
Comment on lines
+431
to
+435
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
|
||
| inputPrice: 4.4, | ||
| outputPrice: 22.0, | ||
|
Comment on lines
+431
to
+437
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
|
||
| description: "GPT-5.6 Sol - OpenAI's most capable model for coding, cybersecurity, and scientific research", | ||
| }, | ||
| "meta.llama3-3-70b-instruct-v1:0": { | ||
| maxTokens: 8192, | ||
| contextWindow: 128_000, | ||
|
|
@@ -675,6 +684,7 @@ export const BEDROCK_GLOBAL_INFERENCE_MODEL_IDS = [ | |
| "anthropic.claude-opus-5", | ||
| "anthropic.claude-fable-5-1", | ||
| "anthropic.claude-fable-5", | ||
| "openai.gpt-5.6-sol", | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
|
||
| ] as const | ||
|
|
||
| // Amazon Bedrock Service Tier types | ||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Script executed:
Repository: Zoo-Code-Org/Zoo-Code
Length of output: 1674
Script executed:
Repository: Zoo-Code-Org/Zoo-Code
Length of output: 25400
Web query:
AWS Bedrock GPT-5.6 Sol openai.gpt-5.6-sol on demand invocation inference profile us.openai.gpt-5.6-solResult:
Script executed:
Repository: Zoo-Code-Org/Zoo-Code
Length of output: 29702
Require an inference profile for GPT-5.6 Sol.
With both inference options unset, requests use
openai.gpt-5.6-sol. AWS requires a cross-region profile for this model on Bedrock Runtime, so those requests fail. Require a supported profile before sending requests, and update the unset-options test.Script executed:
rg -n 'AWS_INFERENCE_PROFILE_MAPPING|getPrefixForRegion|awsUseCrossRegionInference' packages/types/src/providers/bedrock.ts src/api/providers/bedrock.ts webview-ui/src/components/settings/providers/Bedrock.tsxRepository: Zoo-Code-Org/Zoo-Code
Length of output: 1575
Script executed:
Repository: Zoo-Code-Org/Zoo-Code
Length of output: 24013
Web query:
AWS Bedrock "gpt-5.6-sol" inference profile supported source regions global us profileResult:
Script executed:
Repository: Zoo-Code-Org/Zoo-Code
Length of output: 37237
Script executed:
Repository: Zoo-Code-Org/Zoo-Code
Length of output: 8792
Select Sol inference profiles by model and region.
When cross-region inference is enabled in
ca-central-1and global inference is off, the handler sendsca.openai.gpt-5.6-sol. AWS supportsus.openai.gpt-5.6-solthere, so the request fails. Select the supported geo profile for Canada and identify regions that require global inference.