Skip to content

Sync .github/skills directory with azure-sdk-tools for PR 16932 - #10271

Merged
Praveen Kuttappan (praveenkuttappan) merged 1 commit into
mainfrom
sync-.github-skills-fix/skill-eval-environment-skills-6787054-16932
Sep 8, 2026
Merged

Sync .github/skills directory with azure-sdk-tools for PR 16932#10271
Praveen Kuttappan (praveenkuttappan) merged 1 commit into
mainfrom
sync-.github-skills-fix/skill-eval-environment-skills-6787054-16932

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync .github/skills directory with azure-sdk-tools for PR Azure/azure-sdk-tools#16932 See eng/common workflow

Copilot AI balanced review requested due to automatic review settings September 8, 2026 18:36
@azure-sdk-automation
azure-sdk-automation Bot requested a review from a team as a code owner September 8, 2026 18:36
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Sep 8, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
1 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Multiple evals depend on missing skills and will fail during environment setup.

Once you've addressed the issues Copilot identified, you can request another Copilot review.

Pull request overview

Updates skill-routing evaluations with explicit environments, stronger assertions, and clearer prompts.

Changes:

  • Adds per-stimulus skill environments.
  • Strengthens positive and negative routing assertions.
  • Refines prompts distinguishing related skills.
File summaries
File Review
.github/skills/azsdk-common-sdk-release/evals/trigger.eval.yaml Critical: Lines 82 and 93 reference unavailable azure-typespec-author and markdown-token-optimizer skills, causing setup failures.
.github/skills/azsdk-common-prepare-release-plan/evals/trigger.eval.yaml Critical: Line 82 references unavailable azure-typespec-author, causing setup failure.
.github/skills/azsdk-common-pipeline-fixer/evals/trigger.eval.yaml Critical: Lines 91 and 113 reference unavailable azure-typespec-author and skill-authoring skills, causing setup failures.
.github/skills/azsdk-common-pipeline-analysis/evals/trigger.eval.yaml Critical: Lines 86 and 97 reference unavailable skill-authoring and markdown-token-optimizer skills, causing setup failures.
.github/skills/azsdk-common-apiview-feedback-resolution/evals/trigger.eval.yaml Critical: Line 103 references unavailable azure-typespec-author, causing setup failure.
Review details
  • Files reviewed: 5/5 changed files
  • Comments generated: 8
  • Review effort level: Balanced

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread .github/skills/azsdk-common-pipeline-fixer/evals/trigger.eval.yaml
Comment thread .github/skills/azsdk-common-pipeline-fixer/evals/trigger.eval.yaml
Comment thread .github/skills/azsdk-common-sdk-release/evals/trigger.eval.yaml
Comment thread .github/skills/azsdk-common-sdk-release/evals/trigger.eval.yaml
@praveenkuttappan
Praveen Kuttappan (praveenkuttappan) merged commit 4e0e28d into main Sep 8, 2026
10 of 12 checks passed
@praveenkuttappan
Praveen Kuttappan (praveenkuttappan) deleted the sync-.github-skills-fix/skill-eval-environment-skills-6787054-16932 branch September 8, 2026 19:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants