Skip to content

Deliver observability dashboards via Perses CRs - #1075

Open
vkmc wants to merge 16 commits into
openstack-k8s-operators:mainfrom
vkmc:OSPRH-37817/perses-dashboards
Open

vkmc wants to merge 16 commits into
openstack-k8s-operators:mainfrom
vkmc:OSPRH-37817/perses-dashboards

Conversation

@vkmc

@vkmc vkmc commented Oct 5, 2026 •

Copy link
Copy Markdown
Collaborator

Replace the ConfigMap-based dashboard delivery with perses.dev PersesDatasource and PersesDashboard objects in the openstack namespace and owned by the MetricStorage CR.

The MetricStorage controller reconciles a PersesDatasource pointing at the MetricStorage Prometheus and a PersesDashboard for each implemented, non-disabled dashboard, removes the legacy dashboard ConfigMaps on upgrade, and lets administrators disable individual dashboards by name via MetricStorage.spec.disabledDashboards. UIPlugin management is removed from the operator.

The Perses backend (the Perses instance and its UIPlugin) is managed outside the telemetry-operator. The perses-operator's attachment state is surfaced on the dashboard conditions' messages (and logged on change) but does not gate MetricStorage/Telemetry readiness, since the backend is an external prerequisite the operator does not own.

Dashboard definitions are stored as perses.dev/v1alpha2 PersesDashboard JSON. The objects are created as perses.dev/v1alpha1, the API served by the supported perses-operator v0.2.0: a small adapter moves the v1alpha2 spec.config content into the v1alpha1 inline spec, so no Perses dependency bump is needed.

Only the openstack-cloud and openstack-ceilometer-ipmi dashboards are implemented, as minimal placeholders; conversion of the Grafana dashboards content is delivered separately. As with the legacy delivery, the ceilometer-ipmi dashboard is only created when at least one dataplane nodeset runs the telemetry-power-monitoring service.

Related-To: OSPRH-37817

@openshift-ci
openshift-ci Bot requested review from paramite and vyzigold October 5, 2026 17:12
@coderabbitai

coderabbitai Bot commented Oct 5, 2026 •

Copy link
Copy Markdown

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Central YAML (base), Organization UI (inherited)
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 500dc4b0-0025-4de3-9b05-a06ce0cd0440
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@vkmc
vkmc requested a review from csibbitt October 5, 2026 17:13
@vkmc

vkmc commented Oct 5, 2026

Copy link
Copy Markdown
Collaborator Author

In order to test this in a dev environment, follow the instruction on the README. Precisely:

  • README steps 1–6. Note step 4.a (deploy COO) is required, since it installs the perses.dev CRDs this feature depends on.
  • Deploy this branch's operator. README steps 7–10 (disable Telemetry, scale down operators, make run-with-webhook, re-enable Telemetry)
  • (Missing from the README) The dashboards only render once a Perses backend exists, which COO provisions via a Monitoring UIPlugin
oc apply -f - <<EOF
apiVersion: observability.openshift.io/v1alpha1
kind: UIPlugin
metadata:
  name: monitoring
spec:
  type: Monitoring
  monitoring:
    perses:
      enabled: true
EOF

@vkmc
vkmc force-pushed the OSPRH-37817/perses-dashboards branch from 7b42c43 to 29ad362 Compare October 5, 2026 17:32
@vkmc
vkmc marked this pull request as draft October 6, 2026 15:44
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/0f8eb0d9420748848a2344368a20aef5

✔️ s2i-openstack-container-content-provider SUCCESS in 5h 34m 29s
❌ s2i-deployment-test-telemetry FAILURE in 2h 08m 21s
✔️ telemetry-operator-multinode-cloudkitty-rhoso-19 SUCCESS in 1h 28m 50s
✔️ telemetry-openstack-meta-content-provider-all-services-master SUCCESS in 6h 12m 50s
✔️ telemetry-operator-multinode-cloudkitty-rhoso-18 SUCCESS in 1h 21m 40s
✔️ telemetry-operator-multinode-master SUCCESS in 1h 23m 30s
✔️ openstack-k8s-operators-content-provider SUCCESS in 6h 07m 23s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 29m 21s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 5h 32m 49s
❌ functional-tests-osp18 FAILURE in 2h 10m 18s

Comment thread internal/dashboards/perses_openstack-cloud.go Outdated

@csibbitt csibbitt left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple minor issues, and I don't feel like I'm 100% solid enough on all the operator conventions to be the only Approver, but in general this LGTM, thanks!

Comment thread internal/controller/metricstorage_controller.go
Comment thread internal/controller/metricstorage_controller.go Outdated
Comment thread test/kuttl/tests/metricstorage/07-assert.yaml Outdated
Comment thread test/kuttl/tests/metricstorage/07-errors.yaml Outdated
Comment thread internal/controller/metricstorage_controller.go Outdated
Comment thread internal/controller/metricstorage_controller.go Outdated
@vkmc
vkmc force-pushed the OSPRH-37817/perses-dashboards branch 2 times, most recently from a617368 to 082588c Compare October 9, 2026 16:59
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/b9954cfee1b943998796221b0a70d924

✔️ s2i-openstack-container-content-provider SUCCESS in 8h 10m 33s
❌ s2i-deployment-test-telemetry FAILURE in 2h 10m 18s
✔️ telemetry-operator-multinode-cloudkitty-rhoso-19 SUCCESS in 1h 30m 13s
✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 24m 33s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 31m 35s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 22m 47s
✔️ noop SUCCESS in 0s

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/ad3a0605576d494c888eb40c1f5a2db1

❌ s2i-openstack-container-content-provider FAILURE in 4m 18s
⚠️ s2i-deployment-test-telemetry SKIPPED Skipped due to failed job s2i-openstack-container-content-provider
⚠️ telemetry-operator-multinode-cloudkitty-rhoso-19 SKIPPED Skipped due to failed job s2i-openstack-container-content-provider
✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 17m 51s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 27m 16s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 20m 35s
✔️ noop SUCCESS in 0s

@csibbitt csibbitt left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just commenting to indicate I'm up to date with the current version and I think it's good. Thank you for the changes!

I'm going to go ahead and write the integration and content for the rest of the dashboards and target it to your branch, as we discussed the other day.

Comment thread api/v1beta1/metricstorage_types.go Outdated
@vkmc
vkmc force-pushed the OSPRH-37817/perses-dashboards branch from e587589 to b17f801 Compare October 16, 2026 14:14
@openshift-ci

openshift-ci Bot commented Oct 16, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: vkmc
Once this PR has been reviewed and has the lgtm label, please assign mgirgisf for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/64a69e01075a457c8ad3f0f3424fc477

✔️ s2i-openstack-container-content-provider SUCCESS in 4h 33m 14s
❌ s2i-deployment-test-telemetry FAILURE in 2h 44m 44s
❌ telemetry-operator-multinode-cloudkitty-rhoso-19 NODE_FAILURE Node(set) request 099-0000238353 failed in 0s
✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 37m 41s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 26m 28s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 22m 47s
✔️ noop SUCCESS in 0s

@vkmc
vkmc requested a review from sdatko October 19, 2026 09:46
vkmc added 5 commits October 26, 2026 15:03
Replace the ConfigMap-based dashboard delivery (dashboards stored as ConfigMaps
in the shared openshift-config-managed namespace plus a managed UIPlugin) with
perses.dev PersesDatasource and PersesDashboard objects created in the openstack
namespace and owned by the MetricStorage CR.

The MetricStorage controller reconciles a PersesDatasource pointing at the
MetricStorage Prometheus and a PersesDashboard for each implemented,
non-disabled dashboard, removes the legacy dashboard ConfigMaps on upgrade, and
lets administrators disable individual dashboards by name via
MetricStorage.spec.disabledDashboards. UIPlugin management is removed from the
operator.

The Perses backend (the Perses instance and its UIPlugin) is managed outside the
telemetry-operator. The perses-operator's attachment state is surfaced on the
dashboard conditions' messages (and logged on change) but does not gate
MetricStorage/Telemetry readiness, since the backend is an external prerequisite
the operator does not own.

Only the openstack-cloud dashboard is implemented, as a minimal placeholder;
conversion of the remaining Grafana dashboards is delivered separately.

Related-To: OSPRH-37817
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
Assisted-By: Claude Opus 4.8 <noreply@anthropic.com>
- Make dashboards.PersesDashboards() the single source of truth for
  available T-O dashboards
- Iterate the registry in a stable (sorted) order so the reported
  unattached dashboard, and the derived condition message and log, are
  deterministic regardless of Go map iteration order.
- Move the persesResourceAvailable helper into api/v1beta1/conditions.go
  as the exported PersesResourceAvailable, and relocate its unit test.
- Restructure the metricstorage kuttl step 07 to assert the dashboards
  that should exist instead of asserting the absence of a dashboard no
  code path creates

Related-To: OSPRH-37817
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
Assisted-By: Claude Opus 4.8 <noreply@anthropic.com>
When MetricStorage.spec.prometheusTls is enabled, the Prometheus
datasource is served over HTTPS, but Perses-proxied queries failed with
"x509: certificate signed by unknown authority".

The perses-operator creates a Perses Secret ("<datasource>-secret") from
the datasource's client.tls config, but does not wire it into the prox.
The builder set client.tls (so the CA secret was created) yet never referenced
it from the proxy, so Perses queried Prometheus without the CA.

Set the datasource proxy's secret to that Perses Secret when Prometheus
TLS is enabled, so Perses verifies the Prometheus serving certificate.

Related-To: OSPRH-37817
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
Assisted-By: Claude Opus 4.8 <noreply@anthropic.com>
The DisabledDashboards field doc previously listed example dashboard names
(openstack-cloud, openstack-node, openstack-vm). A later commit replaced
them with generic wording. Restore the examples, which are more helpful,
per review feedback. Regenerate the CRD manifests accordingly.

Related-To: OSPRH-37817
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
Assisted-By: Claude Opus 4.8 <noreply@anthropic.com>
Keep dashboard definitions as perses.dev/v1alpha2 PersesDashboard JSON,
the format emitted by the Grafana-to-Perses conversion tooling and
exported by the Perses UI, while still creating perses.dev/v1alpha1
objects, the API served by the supported perses-operator v0.2.0.

- Add dashboardFromJSON, which adapts a v1alpha2 definition to v1alpha1
  by moving spec.config into the v1alpha1 inline spec. Definitions with
  no spec.config section are rejected instead of yielding an empty
  dashboard.
- Builders now return an error, which the controller surfaces through
  the CreateOrPatch mutate function.
- Store the openstack-cloud placeholder dashboard as JSON.
- Add unit tests for the registry builders and the adapter.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
@vkmc
vkmc force-pushed the OSPRH-37817/perses-dashboards branch from c2bc2f3 to 0623747 Compare October 26, 2026 14:12
@vkmc
vkmc marked this pull request as ready for review October 26, 2026 14:16
vkmc added 8 commits October 26, 2026 15:20
Restore the behaviour of the legacy ConfigMap delivery, where the
ceilometer-ipmi dashboard is only created when at least one dataplane
nodeset runs the telemetry-power-monitoring service.

- Add a placeholder openstack-ceilometer-ipmi PersesDashboard, stored as
  v1alpha2 JSON like openstack-cloud. Its content is delivered with the
  rest of the dashboard conversion.
- Treat the dashboard as disabled when power monitoring is not deployed,
  so it is skipped, and removed if power monitoring is later dropped.
- Extend the metricstorage kuttl test: the ipmi dashboard is absent
  before the power monitoring EDPM resources are deployed (01) and when
  dashboards are disabled (02), present once they are (07), and kept
  when another dashboard is disabled by name (08).

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
- Return a wrapped static ErrDashboardNoSpecConfig error instead of a
  dynamic one when a dashboard JSON definition has no spec.config
  section (err113).
- Use a named gomega import in the dashboards tests (revive
  dot-imports).

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
The PersesDatasource validated the Prometheus serving certificate
against a hard-coded combined-ca-bundle secret, while the MonitoringStack
uses spec.prometheusTls.caBundleSecretName. With a differently named CA
bundle secret, the perses-operator cannot find the CA and dashboard
queries to Prometheus fail.

Use the same CA bundle secret and key as the MonitoringStack, falling
back to the ca.crt in the Prometheus serving certificate secret when no
CA bundle secret is configured. Add unit tests for the datasource.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
The Perses objects use generic names (e.g. the "prometheus" datasource)
in the MetricStorage namespace. The disable paths deleted them by name
regardless of who created them, so an administrator's own PersesDatasource
named "prometheus" was deleted on every reconcile while dashboards were
disabled, and the create path silently took over and overwrote it.

- Add EnsureControlledDeleted, which only deletes a Perses object
  controlled by the MetricStorage, and use it when dashboards are
  disabled, when a dashboard is disabled by name and on CR deletion.
- Add EnsureAdoptable and call it from the PersesDatasource and
  PersesDashboard mutate functions, so an existing object not controlled
  by the MetricStorage is reported as an error instead of adopted.
- Add unit tests for both helpers.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
The legacy ConfigMap-based dashboards live in openshift-config-managed
with no owner references, and were only removed from reconcileNormal,
after several steps that can return early. If the MetricStorage was
deleted after an upgrade before reconcileNormal got that far, the
ConfigMaps were orphaned. Remove them from reconcileDelete as well.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
The kuttl assertions that the legacy ConfigMap-based dashboards are
absent passed vacuously, since nothing created them and the operator no
longer does.

Pre-create all the legacy ConfigMaps in step 00, before the MetricStorage
is deployed, to simulate an upgrade, and assert in 01-errors that the
operator removes them. Drop the redundant ConfigMap assertions from
02-errors and 07-errors.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
Any error while inspecting the dataplane nodesets for the
telemetry-power-monitoring service, e.g. a transient list failure or one
host without a resolvable address, marked the ceilometer-ipmi dashboard
as disabled, deleting it until the next successful reconcile. The legacy
delivery only skipped creating it.

Skip reconciling the dashboard when the nodesets cannot be inspected,
leaving any existing object untouched, and only remove it when no
nodeset runs power monitoring.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
When a PersesDatasource or PersesDashboard with the same name already
exists and is not controlled by the MetricStorage, the error was
returned from createDashboardObjects, so reconcileNormal stopped before
the TLS input validation, network attachments and Prometheus readiness,
and kept retrying with backoff.

Report the conflict on the dashboard conditions and keep reconciling
instead. On a datasource conflict the dashboards, which would reference
the foreign datasource, are skipped; on a dashboard conflict only that
dashboard is skipped.

Also fix markDashboardObjectReady logging the Perses attachment state on
every reconcile: it compared against the current conditions, which Init
resets at the start of each reconcile. Compare against the conditions
saved before Init instead.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
vkmc added 3 commits October 26, 2026 16:57
The PersesDatasource URL hardcoded the metric-storage-prometheus Service,
while the Prometheus Service is named after the MetricStorage instance
(<name>-prometheus). With a MetricStorage not named metric-storage, e.g.
in the kuttl tests, the dashboards queried a Service that does not
exist. Build the URL from the instance name, which also matches the
subject name requested for the Prometheus serving certificate.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
When an existing Perses object with a managed name is not controlled by
the MetricStorage, the reported error now tells the administrator to
delete or rename it so the operator can manage it.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
The metricstorage kuttl test only asserted the Perses objects exist, so
it would still pass if the operator stopped setting the controller
reference that their garbage collection and the ownership-aware
deletion rely on. Assert the PersesDatasource and the openstack-cloud
and ceilometer-ipmi PersesDashboards are controlled by the MetricStorage.

Related-To: OSPRH-37817
Assisted-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Victoria Martinez de la Cruz <victoria@redhat.com>
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/8fa69701b4c244468b128260590cb8a0

✔️ s2i-openstack-container-content-provider SUCCESS in 8h 10m 07s
❌ s2i-deployment-test-telemetry FAILURE in 2h 29m 41s
✔️ telemetry-operator-multinode-cloudkitty-rhoso-19 SUCCESS in 1h 26m 39s
✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 47m 38s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 28m 42s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 26m 23s
✔️ noop SUCCESS in 0s

Warning:
File ansible/tmp/8320c3885e484f7e87ee0549f6541d24 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/6283c7b724ee4bf38c10d3c54021101e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8320c3885e484f7e87ee0549f6541d24 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/6283c7b724ee4bf38c10d3c54021101e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8320c3885e484f7e87ee0549f6541d24 found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b0bbd0db0f374cd687c5fdb7a09f324e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/05f1db23f1d84ec2a47383a11d58a137 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b0bbd0db0f374cd687c5fdb7a09f324e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/05f1db23f1d84ec2a47383a11d58a137 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b0bbd0db0f374cd687c5fdb7a09f324e found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/f45ea221204d4d4db6709724268aa16f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/87cc9d5cb2cb4db9858be37ef9cbe990 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/65e785febdcd4e0f82fdce8e7a82991e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/daa3ad53ce654d0a88b50ac6dacf57e4 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/f45ea221204d4d4db6709724268aa16f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/config found in build home directory during playbook github.com/openstack-k8s-operators/s2i-openstack-containers/playbooks/container-ci/zuul/pre.yaml for job s2i-openstack-container-content-provider. Add to preserve-home-paths if safe, or otherwise remove.

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/38f4e32a240b4bd2bec2a14b0e3b6380

✔️ s2i-openstack-container-content-provider SUCCESS in 3h 10m 05s
❌ s2i-deployment-test-telemetry FAILURE in 2h 35m 14s
✔️ telemetry-operator-multinode-cloudkitty-rhoso-19 SUCCESS in 1h 33m 05s
✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 10m 00s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 34m 42s
✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 21m 14s
✔️ noop SUCCESS in 0s

Warning:
File ansible/tmp/4f3f2fc8048d4b10af1dc7d870b8340f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/cd9800439c8246ddb9edd57c91889592 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/4f3f2fc8048d4b10af1dc7d870b8340f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/cd9800439c8246ddb9edd57c91889592 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/4f3f2fc8048d4b10af1dc7d870b8340f found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-cloudkitty-rhoso-19. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/cc2e4081892249ba9bc39efb72fc1364 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/0dc1f653ced742eba6a4effb395e5b78 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/cc2e4081892249ba9bc39efb72fc1364 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/0dc1f653ced742eba6a4effb395e5b78 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/cc2e4081892249ba9bc39efb72fc1364 found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/71e42f443d0144d09868f4ea051164f8 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/6240146b9d47484984c4aaeca43ca3e1 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b8277ee2428c4624a5116c4aa46cd796 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/a0bf0b343004491bb7215559f4adee36 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/71e42f443d0144d09868f4ea051164f8 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job s2i-deployment-test-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/config found in build home directory during playbook github.com/openstack-k8s-operators/s2i-openstack-containers/playbooks/container-ci/zuul/pre.yaml for job s2i-openstack-container-content-provider. Add to preserve-home-paths if safe, or otherwise remove.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants