Skip to content

CLI Evals

CLI Evals #1

Triggered via schedule August 25, 2026 09:16
Status Success
Total duration 1m 3s
Artifacts

cli-evals.yml

on: schedule
Matrix: evals
Fit to window
Zoom out
Zoom in

Annotations

8 errors and 8 warnings
evals (cli-gpt-5.5-pro, with-skills)
Process completed with exit code 1.
evals (cli-claude-opus-4.6, with-skills)
Process completed with exit code 1.
evals (cli-gpt-5.5-pro, without-skills)
Process completed with exit code 1.
evals (cli-gpt-5.4-medium, without-skills)
Process completed with exit code 1.
evals (cli-claude-opus-4.6, without-skills)
Process completed with exit code 1.
evals (cli-claude-opus-4.7, with-skills)
Process completed with exit code 1.
evals (cli-claude-opus-4.7, without-skills)
Process completed with exit code 1.
evals (cli-gpt-5.4-medium, with-skills)
Process completed with exit code 1.
evals (cli-gpt-5.5-pro, with-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (cli-claude-opus-4.6, with-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (cli-gpt-5.5-pro, without-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (cli-gpt-5.4-medium, without-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (cli-claude-opus-4.6, without-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (cli-claude-opus-4.7, with-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (cli-claude-opus-4.7, without-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
evals (cli-gpt-5.4-medium, with-skills)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/