Skip to content

Commit 0a2fa0a

Browse files
Update GPT-5.4 evals to GPT-6.1 Sol (#50874)
Co-authored-by: helen229 <gaoh@microsoft.com>
1 parent 9d12974 commit 0a2fa0a

10 files changed

Lines changed: 11 additions & 11 deletions

File tree

‎.github/skills/azsdk-common-apiview-feedback-resolution/evals/eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
config:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-apiview-feedback-resolution/evals/trigger.eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
defaults:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-generate-sdk-locally/evals/eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
config:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-pipeline-analysis/evals/trigger.eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
defaults:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-pipeline-fixer/evals/trigger.eval.yaml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,11 +11,11 @@ tags:
1111
defaults:
1212
runs: 1
1313
# Stimuli with a resolvable build reference (URL or build ID) make the agent
14-
# run the full analyze→fix→verify workflow (~90-180s under gpt-5.4),
14+
# run the full analyze→fix→verify workflow (~90-180s under gpt-6.1-sol),
1515
# so the per-stimulus cap matches the Vally scenario evals (5m). Non-build-ref
1616
# routing prompts still complete in ~10-20s.
1717
timeout: "5m"
18-
model: gpt-5.4
18+
model: gpt-6.1-sol
1919
executor: copilot-sdk
2020

2121
scoring:

‎.github/skills/azsdk-common-prepare-release-plan/evals/eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
config:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-prepare-release-plan/evals/schedule-risk.eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
defaults:
1212
runs: 1
1313
timeout: "120s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-prepare-release-plan/evals/trigger.eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
defaults:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-sdk-release/evals/eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
config:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

‎.github/skills/azsdk-common-sdk-release/evals/trigger.eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ tags:
1111
defaults:
1212
runs: 1
1313
timeout: "90s"
14-
model: gpt-5.4
14+
model: gpt-6.1-sol
1515
executor: copilot-sdk
1616

1717
scoring:

0 commit comments

Comments
 (0)