Repository navigation
Commit 5fe426d
Feat/pipeline steps v2 backport (#6153)
* feat: Add Zimmer deployment and lineage step types (v2 backport)
Backports the 8 Zimmer pipeline step classes from v3 (PR #6140) to v2:
- EndpointConfigStep, EndpointStep (SageMaker inference deployment)
- InferenceComponentStep (multi-model endpoint support)
- BedrockCustomModelStep, BedrockCustomModelDeploymentStep,
BedrockModelImportStep, BedrockProvisionedModelThroughputStep
- LineageStep (ML governance tracking)
Also adds 8 new values to StepTypeEnum.
Design: each step accepts an opaque 'arguments: Dict[str, Any]' that is
forwarded to the pipeline service verbatim, mirroring the existing SDK
convention used by LambdaStep and CallbackStep. Refer to the corresponding
AWS Create* API references for accepted fields.
Retryability per Zimmer step contract: only EndpointConfigStep is
retryable. Cacheability: EndpointConfigStep and EndpointStep are
structurally cacheable via cache_config.
sim: https://issues.amazon.com/issues/P424919850
---
X-AI-Prompt: Backport the Zimmer pipeline step types from the v3 PR
(#6140) to the v2 SDK on master-v2
X-AI-Tool: kiro-cli
* fix(pipeline): Add client-side argument validation for Zimmer steps
Mirrors the v3 change (commit fbe6fce on feat/zimmer-pipeline-steps):
validate top-level argument keys against the public AWS API input shape
(botocore service model) at step construction and at serialization, and
fail fast on fields SageMaker Pipelines rejects (DataCaptureConfig,
ExplainerConfig on EndpointConfig; DeploymentConfig on Endpoint).
Bedrock member names are PascalCase-converted before comparison.
LineageStep now rejects unrecognized top-level keys.
Values are intentionally not validated: they may be pipeline variables
resolved at compile time. If the installed botocore does not know an
operation, shape validation is skipped and the service remains the
authority.
Adds 8 validation unit tests (32 total).
---
X-AI-Prompt: Mirror the Fortress-driven argument validation change to
the v2 backport branch
X-AI-Tool: kiro-cli
* chore: empty commit to re-trigger CI
Re-trigger the PR check suite (integ tests run issue).
---
X-AI-Prompt: Make dummy commits on v2 and v3 branches to fix an integ
tests run issue
X-AI-Tool: kiro-cli
---------
Co-authored-by: Rishabh Devnani <rdevnani@amazon.com>1 parent eaa80b9 commit 5fe426d
8 files changed
Lines changed: 1441 additions & 0 deletions
File tree
- src/sagemaker/workflow
- tests
- integ/sagemaker/workflow
- unit/sagemaker/workflow
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
0 commit comments