feat(pipeline): add --target and --targets flags to pipeline run and pipeline input#1108
Merged
feat(pipeline): add --target and --targets flags to pipeline run and pipeline input#1108
Conversation
…pipeline input Mirrors the --target / --targets options already available on \�gentv eval run\. Allows reusing the same eval.yaml across different targets without duplicating files. Both commands now accept: --target <name> Override target name from targets.yaml --targets <path> Path to targets.yaml (overrides discovery) These values are forwarded directly to selectTarget() via cliTargetName and explicitTargetsPath, the same pathway used by eval run. Fixes #1107
Deploying agentv with
|
| Latest commit: |
07b0f83
|
| Status: | ⚡️ Build in progress... |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds
--targetand--targetsflags toagentv pipeline runandagentv pipeline input, mirroring the options already available onagentv eval run.Problem
agentv pipeline run <eval> --target wtalmspreviously failed withUnknown argumentseven thoughagentv eval run <eval> --target wtalmsworks fine. This made it impossible to reuse the same eval.yaml across different targets in pipeline mode without duplicating the file.Changes
Both
pipeline runandpipeline inputnow accept:--target <name>— override the target name from targets.yaml--targets <path>— path to targets.yaml (overrides discovery)These values are forwarded to
selectTarget()viacliTargetNameandexplicitTargetsPath, the same pathway already used byeval run.Testing
# Previously failed, now works: agentv pipeline run evals/ace-search-subset/n1.eval.yaml --target wtalms --grader-type code agentv pipeline input evals/ace-search-subset/n1.eval.yaml --target wtalmsCloses #1107