Repository navigation
feat(train): add the interactive Training Sessions client surface #6452
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -53,6 +53,7 @@ Homepage = "https://github.com/aws/sagemaker-python-sdk" | |
| [project.optional-dependencies] | ||
| rft-strands = ["strands-agents"] | ||
| rft-langchain = ["httpx>=0.24.0"] | ||
| tokenizer = ["transformers"] | ||
| test = [ | ||
| "pytest", | ||
| "pytest-cov", | ||
|
|
@@ -63,7 +64,8 @@ test = [ | |
| "scipy", | ||
| "omegaconf", | ||
| "graphene", | ||
| "IPython" | ||
| "IPython", | ||
| "transformers", | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 🟡 Low: |
||
| ] | ||
| notebook = [ | ||
| "ipywidgets>=8.0.0", | ||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -158,4 +158,16 @@ def __getattr__(name): | |
| from sagemaker.train.common_utils.finetune_utils import list_hyperparameters | ||
|
|
||
| return list_hyperparameters | ||
| elif name == "ServiceClient": | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 🟡 Low: The new There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 🟡 Low: Only the three clients ( |
||
| from sagemaker.train.training_session import ServiceClient | ||
|
|
||
| return ServiceClient | ||
| elif name == "TrainingClient": | ||
| from sagemaker.train.training_session import TrainingClient | ||
|
|
||
| return TrainingClient | ||
| elif name == "SamplingClient": | ||
| from sagemaker.train.training_session import SamplingClient | ||
|
|
||
| return SamplingClient | ||
| raise AttributeError(f"module '{__name__}' has no attribute '{name}'") | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🟡 Low:
transformersis added to thetestextra (and as thetokenizerextra).transformersis a heavy dependency that often drags in large transitive packages and markedly increases install time and image size for every CI run of thesagemaker-trainunit suite — even though only theget_tokenizer()/tokenizer tests need it. Consider gating the tokenizer tests behind an importorskip and keepingtransformersout of the defaulttestextra (or pinning a minimum version), so the common unit run doesn't pay for it.