Skip to content

[Feat] DataSetHubFactory - #5607

Closed
gwang111 wants to merge 2 commits into
aws:masterfrom
gwang111:feature/dataset-hub-factory
Closed

gwang111 wants to merge 2 commits into
aws:masterfrom
gwang111:feature/dataset-hub-factory

Conversation

@gwang111

@gwang111 gwang111 commented Mar 6, 2026

Copy link
Copy Markdown
Collaborator

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

gwang111 added 2 commits March 6, 2026 21:04
…odule

Add DataSetHubFactory as an orchestration layer for multi-step DataSet
workflows (transform, split, score, generate). Add DatasetTransformation
with hub-and-spoke format conversion using genqa as the canonical
intermediate. Extend DatasetFormatDetector with detect_format method.
Include unit tests for full coverage of new modules.

---
X-AI-Prompt: add dataset_hub_factory.py and dataset_transformation.py with transform_dataset workflow
X-AI-Tool: Kiro
…ansformation tests

Fixed 20 failing tests across test_dataset_hub_factory.py and
test_dataset_transformation.py. Root cause: lazy imports inside methods
meant mock patches on the hub_factory module couldn't find the target
attributes. Patched at source modules instead (dataset.DataSet,
dataset_transformation.DatasetTransformation, air_hub.AIRHub). Also
fixed test_unsupported_format_raises to use DPO (not in inbound
converters) instead of converse (which is), and fixed detect_format
tests to mock DatasetFormatDetector at its source module.

---
X-AI-Prompt: fix failing unit tests for dataset_hub_factory and dataset_transformation
X-AI-Tool: Kiro

This branch was previously deployed

1 inactive deployment
auto-approve — f2a1b5ce Deployed Mar 6, 2026 by gwang111 via wait-for-approval #344
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants