Skip to content

ci: added new label ci:run-evals for PR #121

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
omkargaikwad23 merged 6 commits into from
May 4, 2026
+8 −4
Merged

ci: added new label ci:run-evals for PR #121

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
078f917
feat: add Cloud Build pipeline and evaluation configuration for Cloud…
omkargaikwad23 May 4, 2026
e8237e8
chore: update secret manager path for MYSQL_DB_PASSWORD in cloudbuild…
omkargaikwad23 May 4, 2026
fa0f857
chore: update dataset prompt phrasing and add skills evaluation confi…
omkargaikwad23 May 4, 2026
fe884ee
explicitly set skills_dir: /workspace/cloud-sql-mysql/skills
omkargaikwad23 May 4, 2026
cabc5f5
chore: rename evals label to ci:run-evals in CI configuration and wor…
omkargaikwad23 May 4, 2026
4563605
Merge branch 'main' into release-please-evalbench-ci
omkargaikwad23 May 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion .github/labels.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,4 +83,8 @@

- name: 'release-please:force-run'
color: bdca82
description: Manually trigger the release please workflow on a PR.
description: Manually trigger the release please workflow on a PR.

- name: 'ci:run-evals'
color: 4285f4
description: Manually trigger the evaluation CI pipeline on a PR.
6 changes: 3 additions & 3 deletions cloudbuild.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,8 +46,8 @@ steps:
PR_TITLE=$(echo "$$PR_DATA" | jq -r '.title')

# Check if execution labels are present
if [[ "$$PR_LABELS" != *"autorelease: pending"* && "$$PR_LABELS" != *"evals"* ]]; then
echo "PR does not have 'autorelease: pending' or 'evals' label. Skipping execution."
if [[ "$$PR_LABELS" != *"autorelease: pending"* && "$$PR_LABELS" != *"ci:run-evals"* ]]; then
echo "PR does not have 'autorelease: pending' or 'ci:run-evals' label. Skipping execution."
exit 0
fi
echo "Execution label detected. Processing release version context..."
Expand All @@ -60,7 +60,7 @@ steps:
export RELEASE_VERSION="pr-$_PR_NUMBER-release-unknown"
fi
else
export RELEASE_VERSION="pr-$_PR_NUMBER-evals"
export RELEASE_VERSION="pr-$_PR_NUMBER-ci-run-evals"
fi

# Workaround for evalbench bug: settings are only applied if path basename matches extension ID
Expand Down
Loading