Skip to content

Sync eng/common directory with azure-sdk-tools for PR 16685 #10222

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
azure-sdk-automation wants to merge 2 commits into
base: main
Choose a base branch
from
+1,020 −643
Open

Sync eng/common directory with azure-sdk-tools for PR 16685 #10222

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
302092a
Bump Vally CLI to 0.12.0 for skill-eval and common eval infra
helen229 Aug 6, 2026
6bbf3c5
Update eval-authoring skills and READMEs for Vally 0.12
helen229 Aug 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions eng/common/pipelines/templates/jobs/eval-shard.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -74,6 +74,9 @@ jobs:
npmrcPath: $(Build.SourcesDirectory)/.npmrc
registryUrl: https://pkgs.dev.azure.com/azure-sdk/public/_packaging/azure-sdk-tools/npm/registry/

- script: npm install --global npm@11.11.1 --userconfig $(Build.SourcesDirectory)/.npmrc
displayName: 'Use npm 11.11.1'
Comment thread
helen229 marked this conversation as resolved.

# Installs vally-cli + its pinned copilot-sdk executor into node_modules.
- script: npm ci --userconfig $(Build.SourcesDirectory)/.npmrc
displayName: 'Install Vally CLI + copilot-sdk (pinned)'
Expand Down
3 changes: 2 additions & 1 deletion eng/common/scripts/eval/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ prints a harmless `ExperimentalWarning`. Relative imports use explicit `.ts` spe
## Updating the Vally CLI version

1. Bump `@microsoft/vally-cli` in `package.json`.
2. Run `npm install` locally to refresh `package-lock.json`.
2. Run `npm install --global npm@11.11.1`, then `npm install --package-lock-only --registry https://registry.npmjs.org/` to refresh `package-lock.json`.
Comment thread
helen229 marked this conversation as resolved.
3. Commit both files in the same PR. The eval pipelines' path triggers include
`eng/common/scripts/eval/**`, so CI re-runs against the new version automatically.

Expand All @@ -40,6 +40,7 @@ Reproduce what CI does by installing from the same lockfile and invoking the loc

```sh
cd eng/common/scripts/eval
npm install --global npm@11.11.1
Comment thread
helen229 marked this conversation as resolved.
npm ci
cd ../../../..
./eng/common/scripts/eval/node_modules/.bin/vally lint .
Expand Down
Loading
Loading