Fix --use-samples replay for call/dispatch workflow tools and enable replace-label sample schema - #54813
Conversation
Co-authored-by: dsyme <7204669+dsyme@users.noreply.github.com>
--use-samples replay for call/dispatch workflow tools and enable replace-label sample schema
|
❌ Test Quality Sentinel failed during test quality analysis.
|
|
❌ Design Decision Gate 🏗️ failed during design decision gate check.
|
|
🧠 Matt Pocock Skills Reviewer failed during the skills-based review.
|
|
❌ Ponytail Reviewer failed. Please review the logs for details.
|
|
There was a problem hiding this comment.
Pull request overview
Fixes #54811 by making sample replay target workflow-specific MCP tools and enabling replace-label sample validation.
Changes:
- Normalizes dynamic workflow sample tool names and reshapes arguments.
- Adds
replace_labelto both schema catalogs. - Adds regression coverage for replay and validation.
Show a summary per file
| File | Description |
|---|---|
pkg/workflow/samples_replay.go |
Resolves dynamic workflow sample tool names and arguments. |
pkg/workflow/samples_validation_test.go |
Tests dynamic replay and replace-label validation. |
pkg/workflow/js/safe_outputs_tools.json |
Adds the embedded replace_label schema. |
actions/setup/js/safe_outputs_tools.json |
Adds the runtime replace_label schema. |
Review details
💡 Add a code-review agent skill for context-aware, tailored reviews. Learn more in the docs.
- Files reviewed: 4/4 changed files
- Comments generated: 0
- Review effort level: Balanced
|
@copilot this PR looks close, but it still needs a maintainer-ready finish.
Run: https://github.com/github/gh-aw/actions/runs/32591161200
|
Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>
Addressed in f4c1d64:
Verified locally on the new commit: No open review threads on this PR. CI on this new HEAD needs a maintainer re-trigger since my push doesn't re-run workflows. |
|
@copilot this PR still needs forward progress.
Run: https://github.com/github/gh-aw/actions/runs/32595245207
|
…ode-replay-issues # Conflicts: # pkg/workflow/samples_replay.go Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>
Merged in f3df3fd. Fetched origin/main and ran Verified locally on the merge commit: PR mergeable_state is now |
--use-samplescould not deterministically replaycall-workflowanddispatch-workflowbecause replay emitted family tool names (call_workflow/dispatch_workflow) instead of the generated workflow-specific tool names.replace-labelalso could not acceptsamplesat compile time because its MCP tool schema was missing fromsafe_outputs_tools.json.Replay tool-name resolution for dynamic workflow handlers
workflow_name→ normalized dynamic tool name (e.g.,worker-a→worker_a) forcall-workflowanddispatch-workflow.inputspayload is passed as tool argsdispatch-workflowalso carriesrefwhen providedSchema coverage for
replace_labelsamplesreplace_labeltool schema to runtime and embedded tool schema catalogs:actions/setup/js/safe_outputs_tools.jsonpkg/workflow/js/safe_outputs_tools.jsonRegression-focused tests
collectSampleEntriesemits workflow-specific tool names for dynamic workflow samples.replace-labelsample configuration.