Skip to content

Commit ec0bd96

Browse files
committed
Add the testing property of pipelines to bundles
1 parent cf934e0 commit ec0bd96

64 files changed

Lines changed: 1477 additions & 136 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
* Fix `-e ./folder` in environment dependencies, which failed before deploy. A local project folder after `-e`, with optional extras such as `-e ./project[test]`, now maps to its deployed folder. ([#7274](https://github.com/databricks/cli/pull/7274))
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
* `bundle plan` now shows a change to a pipeline's `testing` that was made outside the bundle, and `bundle deploy` undoes it. ([#7274](https://github.com/databricks/cli/pull/7274))
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
* Add the `testing` property of pipelines, which sets the test sources and test-only dependencies that `databricks pipelines test` runs with. ([#7274](https://github.com/databricks/cli/pull/7274))
Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
bundle:
2+
name: editable-folder
3+
4+
resources:
5+
jobs:
6+
my_job:
7+
name: my job
8+
tasks:
9+
- task_key: main
10+
python_wheel_task:
11+
package_name: orders
12+
entry_point: main
13+
environment_key: default
14+
environments:
15+
- environment_key: default
16+
spec:
17+
client: "1"
18+
dependencies:
19+
- -e ./project
20+
21+
pipelines:
22+
my_pipeline:
23+
name: my pipeline
24+
environment:
25+
dependencies:
26+
- -e ./project
27+
testing:
28+
sources:
29+
- glob:
30+
include: /Workspace/Shared/orders/tests/**
31+
environment:
32+
dependencies:
33+
- -e ./project[test]
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
Cloud = false
2+
EnvMatrix.DMS = ["", "true"]
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
2+
>>> [CLI] bundle validate -o json
3+
{
4+
"job": [
5+
"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project"
6+
],
7+
"pipeline": [
8+
"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project"
9+
],
10+
"testing": [
11+
"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project[test]"
12+
]
13+
}
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
[project]
2+
name = "orders"
3+
version = "0.1.0"
4+
5+
[project.optional-dependencies]
6+
test = ["faker"]
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
trace $CLI bundle validate -o json | jq '{job: .resources.jobs.my_job.environments[0].spec.dependencies, pipeline: .resources.pipelines.my_pipeline.environment.dependencies, testing: .resources.pipelines.my_pipeline.testing.environment.dependencies}'
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
Cloud = false

‎acceptance/bundle/refschema/output/pipelines.txt‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -867,6 +867,14 @@ resources.pipelines.*.storage string ALL
867867
resources.pipelines.*.tags map[string]string ALL
868868
resources.pipelines.*.tags.* string ALL
869869
resources.pipelines.*.target string ALL
870+
resources.pipelines.*.testing *resources.PipelineTesting ALL
871+
resources.pipelines.*.testing.environment *resources.PipelineTestEnvironment ALL
872+
resources.pipelines.*.testing.environment.dependencies []string ALL
873+
resources.pipelines.*.testing.environment.dependencies[*] string ALL
874+
resources.pipelines.*.testing.sources []resources.PipelineTestSource ALL
875+
resources.pipelines.*.testing.sources[*] resources.PipelineTestSource ALL
876+
resources.pipelines.*.testing.sources[*].glob *pipelines.PathPattern ALL
877+
resources.pipelines.*.testing.sources[*].glob.include string ALL
870878
resources.pipelines.*.trigger *pipelines.PipelineTrigger ALL
871879
resources.pipelines.*.trigger.cron *pipelines.CronTrigger ALL
872880
resources.pipelines.*.trigger.cron.quartz_cron_schedule string ALL

0 commit comments

Comments
 (0)