Skip to content

fix(mlops): read disable_glue_table_creation from OfflineStoreConfig - #6416

Open
AkshayShah03 wants to merge 1 commit into
aws:masterfrom
AkshayShah03:fix/feature-store-disable-glue-catalog
Open

AkshayShah03 wants to merge 1 commit into
aws:masterfrom
AkshayShah03:fix/feature-store-disable-glue-catalog

Conversation

@AkshayShah03

Copy link
Copy Markdown

Issue #, if available: N/A

Description of changes:

create_athena_query (feature_utils.py) and construct_feature_group_to_be_merged (dataset_builder.py) look up disable_glue_table_creation on DataCatalogConfig:

catalog_config = fg.offline_store_config.data_catalog_config
disable_glue = getattr(catalog_config, "disable_glue_table_creation", False) or False

DataCatalogConfig only has table_name, catalog and database. disable_glue_table_creation is a field of OfflineStoreConfig, which is where v2 read it from. The getattr default is therefore always used. A feature group created with DisableGlueTableCreation=True and a custom DataCatalogConfig.Catalog is always queried against AwsDataCatalog.

This change reads the flag from fg.offline_store_config.

Testing:

  • The create_athena_query and construct_feature_group_to_be_merged tests used MagicMock configs, which accept any attribute.
  • They now use real OfflineStoreConfig / DataCatalogConfig shapes, parametrized over both flag values. The True cases fail before this change.
  • tests/unit/sagemaker/mlops/feature_store: 391 passed.
  • The 28 collection errors under feature_processor also happen on master.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

create_athena_query and construct_feature_group_to_be_merged looked up
disable_glue_table_creation on DataCatalogConfig, which has no such field
(it is on OfflineStoreConfig), so the getattr default False was always used.
Feature groups created with DisableGlueTableCreation=True and a custom
DataCatalogConfig.Catalog were therefore always queried against
AwsDataCatalog instead of their catalog.

Read the flag from offline_store_config. The unit tests now use real
OfflineStoreConfig/DataCatalogConfig shapes and cover both values.

This branch had an error being deployed

1 failed deployment
manual-approval — 216106c4 Deployed Oct 10, 2026 by AkshayShah03 via wait-for-approval #1968
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant