Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ resources:
node_type_id: $NODE_TYPE_ID
instance_pool_id: $TEST_INSTANCE_POOL_ID
num_workers: 2
data_security_mode: USER_ISOLATION

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing here says why the mode is pinned: the AWS test account enabled admin protection for no-isolation shared clusters, and the test that actually needs this is run/spark_python_task, which copies this template; deploy/simple itself never runs the job. Without that, a later trim of the "simple" fixture or a switch to $DATA_SECURITY_MODE like the library fixtures use would quietly bring the AWS failure back. Can you add a one-line comment above it with the reason and the dependent test?

spark_conf:
"spark.executor.memory": "2g"

Expand Down
Loading