Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Appearance settings

[telemetry_chargeback] FVT - Implement data validation capabilities for loki rate#399

Draft
ayefimov-1 wants to merge 6 commits into
masterinfrawatch/feature-verification-tests:masterfrom
alexy_ck_job_8infrawatch/feature-verification-tests:alexy_ck_job_8Copy head branch name to clipboard
Draft

[telemetry_chargeback] FVT - Implement data validation capabilities for loki rate#399
ayefimov-1 wants to merge 6 commits into
masterinfrawatch/feature-verification-tests:masterfrom
alexy_ck_job_8infrawatch/feature-verification-tests:alexy_ck_job_8Copy head branch name to clipboard

Conversation

@ayefimov-1

@ayefimov-1 ayefimov-1 commented Jun 12, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Data validation capabilities for loki rate

  • Retrieves CloudKitty rating totals from Loki
  • Compares synthetic test data against actual Loki results
  • Provides automated pass/fail assertions
  • Ensures end-to-end data integrity

Authored-by: @ayefimov-1
AI Assisted by: Claude

@ayefimov-1
ayefimov-1 marked this pull request as draft June 12, 2026 13:49
@ayefimov-1

ayefimov-1 commented Jun 16, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@ayefimov-1
ayefimov-1 force-pushed the alexy_ck_job_8 branch 3 times, most recently from b5c3e26 to 0609336 Compare June 17, 2026 19:38
@ayefimov-1

ayefimov-1 commented Jun 23, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 1, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/64c06b1eb2d54d29bdb7adfc17236a20

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 49m 02s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 55m 20s
✔️ functional-tests-osp18 SUCCESS in 2h 23m 45s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 1, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/a7dd094165394bf39a44b8782a8d072a

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 46m 06s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 58m 27s
✔️ functional-tests-osp18 SUCCESS in 2h 21m 03s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 6, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/be5f10928b8d44c08e51d89387850016

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 52m 09s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 12m 47s
✔️ functional-tests-osp18 SUCCESS in 2h 24m 22s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 7, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/60d9789e355547c6a9ab671985835ad1

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 47m 26s
❌ functional-chargeback-tests-osp18 FAILURE in 23m 35s
❌ functional-tests-osp18 FAILURE in 24m 21s

@ayefimov-1

ayefimov-1 commented Jul 7, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 7, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/f17a0a1537744dc1bbf69e248c1564fe

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 48m 20s
❌ functional-chargeback-tests-osp18 FAILURE in 25m 04s
❌ functional-tests-osp18 FAILURE in 23m 32s

@ayefimov-1

ayefimov-1 commented Jul 7, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 7, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/31284bd48dd349528c7632bc5592f26c

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 57m 12s
❌ functional-chargeback-tests-osp18 FAILURE in 29m 12s
❌ functional-tests-osp18 FAILURE in 24m 07s

@ayefimov-1

ayefimov-1 commented Jul 7, 2026

Copy link
Copy Markdown
Contributor Author

Added depends-on

Recheck

@ayefimov-1

ayefimov-1 commented Jul 7, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 7, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/8018d2719fa843519e024278616ce277

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 49m 39s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 08m 48s
✔️ functional-tests-osp18 SUCCESS in 2h 20m 14s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 8, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/700e73c960be401f8f626feee070c0d6

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 33m 43s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 01m 24s
❌ functional-tests-osp18 FAILURE in 2h 10m 25s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 8, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/9619a4a747c943029f5217c0acdc3f4c

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 38m 54s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 10m 20s
✔️ functional-tests-osp18 SUCCESS in 2h 14m 51s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 8, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/dd5e62fb399a41759061c981a486ebe8

❌ telemetry-openstack-meta-content-provider-master FAILURE in 20m 02s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

@ayefimov-1

ayefimov-1 commented Jul 8, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 8, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/ab19b92bf02142d4a114bcee4288484a

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 46m 16s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 10m 14s
✔️ functional-tests-osp18 SUCCESS in 2h 19m 57s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 8, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/c289d234191a414cb7111d755ca6ea70

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 3h 44m 25s
❌ functional-chargeback-tests-osp18 TIMED_OUT in 3h 23m 05s
✔️ functional-tests-osp18 SUCCESS in 2h 20m 13s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 9, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/e2627f5817904736a2b95f09ec3f0782

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 3h 45m 24s
❌ functional-chargeback-tests-osp18 TIMED_OUT in 3h 23m 01s
✔️ functional-tests-osp18 SUCCESS in 2h 24m 16s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 9, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/af117b90fc804ed1a532fb53168758c2

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 3h 06m 18s
✔️ telemetry-container-image-content-provider SUCCESS in 2h 43m 28s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 03m 19s
✔️ functional-audit-logging-tests-osp18 SUCCESS in 1h 32m 15s
✔️ functional-tests-osp18 SUCCESS in 2h 19m 51s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 33m 46s
✔️ functional-periodic-telemetry-with-ceph SUCCESS in 2h 41m 51s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 10, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/7b899b74e69941a197253c01367ad8ab

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 57m 35s
✔️ telemetry-container-image-content-provider SUCCESS in 2h 40m 01s
❌ functional-chargeback-tests-osp18 FAILURE in 2h 07m 13s
✔️ functional-audit-logging-tests-osp18 SUCCESS in 1h 37m 56s
✔️ functional-tests-osp18 SUCCESS in 2h 17m 39s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 36m 07s
✔️ functional-periodic-telemetry-with-ceph SUCCESS in 2h 34m 15s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 10, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/c9bd9546b0ad4a16ac5f5ebda9b364e3

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 47m 14s
✔️ telemetry-container-image-content-provider SUCCESS in 2h 46m 51s
✔️ functional-chargeback-tests-osp18 SUCCESS in 2h 08m 30s
✔️ functional-audit-logging-tests-osp18 SUCCESS in 1h 41m 01s
✔️ functional-tests-osp18 SUCCESS in 2h 24m 34s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 48m 17s
❌ functional-periodic-telemetry-with-ceph FAILURE in 31m 54s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 10, 2026

Copy link
Copy Markdown

Zuul encountered a syntax error while parsing its
configuration in the repo openstack-k8s-operators/mysqld_exporter on branch main. The
problem was:

Job telemetry-container-image-content-provider not defined

The problem appears in the "openstack-k8s-operators/mysqld_exporter" project stanza:

project:
name: openstack-k8s-operators/mysqld_exporter
github-check:
jobs:
- telemetry-container-image-content-provider:
override-checkout: master
vars:
container_images:
- src: "{{ ansible_user_dir }}/src/github.com/openstack-k8s-operators/mysqld_exporter"
...

in "openstack-k8s-operators/mysqld_exporter/.zuul.yaml@main", line 2

1 similar comment
@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 10, 2026

Copy link
Copy Markdown

Zuul encountered a syntax error while parsing its
configuration in the repo openstack-k8s-operators/mysqld_exporter on branch main. The
problem was:

Job telemetry-container-image-content-provider not defined

The problem appears in the "openstack-k8s-operators/mysqld_exporter" project stanza:

project:
name: openstack-k8s-operators/mysqld_exporter
github-check:
jobs:
- telemetry-container-image-content-provider:
override-checkout: master
vars:
container_images:
- src: "{{ ansible_user_dir }}/src/github.com/openstack-k8s-operators/mysqld_exporter"
...

in "openstack-k8s-operators/mysqld_exporter/.zuul.yaml@main", line 2

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 10, 2026

Copy link
Copy Markdown

Zuul encountered a syntax error while parsing its
configuration in the repo openstack-k8s-operators/mysqld_exporter on branch main. The
problem was:

Job telemetry-container-image-content-provider not defined

The problem appears in the "openstack-k8s-operators/mysqld_exporter" project stanza:

project:
name: openstack-k8s-operators/mysqld_exporter
github-check:
jobs:
- telemetry-container-image-content-provider:
override-checkout: master
vars:
container_images:
- src: "{{ ansible_user_dir }}/src/github.com/openstack-k8s-operators/mysqld_exporter"
...

in "openstack-k8s-operators/mysqld_exporter/.zuul.yaml@main", line 2

@ayefimov-1

ayefimov-1 commented Jul 10, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 10, 2026

Copy link
Copy Markdown

Zuul encountered a syntax error while parsing its
configuration in the repo openstack-k8s-operators/mysqld_exporter on branch main. The
problem was:

Job telemetry-container-image-content-provider not defined

The problem appears in the "openstack-k8s-operators/mysqld_exporter" project stanza:

project:
name: openstack-k8s-operators/mysqld_exporter
github-check:
jobs:
- telemetry-container-image-content-provider:
override-checkout: master
vars:
container_images:
- src: "{{ ansible_user_dir }}/src/github.com/openstack-k8s-operators/mysqld_exporter"
...

in "openstack-k8s-operators/mysqld_exporter/.zuul.yaml@main", line 2

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 10, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/41520ecaad5447c0b584bdefcd926c6f

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 53m 51s
❌ functional-chargeback-tests-osp18 POST_FAILURE in 24m 13s
✔️ functional-tests-osp18 SUCCESS in 2h 29m 00s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 11, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/440e21b4e1364f62a988c9a5f038877c

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 40m 24s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 33m 02s
✔️ functional-tests-osp18 SUCCESS in 2h 18m 29s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 11, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/fbc82d9cd68f47ddaaa315ac33fb8684

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 40m 24s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 39m 54s
✔️ functional-tests-osp18 SUCCESS in 2h 18m 40s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 11, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/cbe86be6077a4ae680e45a26c84b1b06

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 33m 35s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 34m 26s
✔️ functional-tests-osp18 SUCCESS in 2h 11m 09s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 14, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/658d56848f8a4538a7b80fb4f6fb314c

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 40m 58s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 58m 46s
✔️ functional-tests-osp18 SUCCESS in 2h 17m 38s

@ayefimov-1 @claude
[telemetry_chargeback] Complete CloudKitty chargeback enhancement
2e22bad 
Comprehensive enhancement to telemetry_chargeback role with rate
accumulation, realistic test scenarios, and improved data validation.

Changes include:
- Python fixes: Fix timestep loop and rate calculation field names
- Test scenarios: Add factor conversions and reduce step_seconds for faster tests
- Rate accumulation: Track total_rate_job across scenarios
- Comprehensive reporting: Add loki_total_rate.yml for month-to-date summaries
- Loki query improvements: Add end time parameter for precise queries
- Zuul CI: Remove obsolete job aliases

This builds on PR #412 and provides complete CloudKitty chargeback testing
and validation capabilities.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
ayefimov-1 and others added 5 commits July 14, 2026 13:59
@ayefimov-1 @claude
[telemetry_chargeback] Complete CloudKitty chargeback enhancement
2dfab9f 
Comprehensive enhancement to telemetry_chargeback role with rate
accumulation, realistic test scenarios, and improved data validation.

Changes include:
- Python fixes: Fix timestep loop and rate calculation field names
- Test scenarios: Add factor conversions and reduce step_seconds for faster tests
- Rate accumulation: Track total_rate_job across scenarios
- Comprehensive reporting: Add loki_total_rate.yml for month-to-date summaries
- Loki query improvements: Add end time parameter for precise queries
- Zuul CI: Remove obsolete job aliases

This builds on PR #412 and provides complete CloudKitty chargeback testing
and validation capabilities.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@ayefimov-1
Merge branch 'alexy_ck_job_8' of github.com:infrawatch/feature-verifi…
b086a08 
…cation-tests into alexy_ck_job_8
@ayefimov-1
Fixed removed line from merge conflict
ac404ab
@ayefimov-1
Fixed removed line from merge conflict
b7ebfe6
@ayefimov-1
Merge branch 'alexy_ck_job_8' of github.com:infrawatch/feature-verifi…
e25c9f8 
…cation-tests into alexy_ck_job_8
@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Jul 14, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/60b1f240032644bab79157b93c1f27ab

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 48m 07s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 37m 11s
✔️ functional-tests-osp18 SUCCESS in 2h 21m 57s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@ayefimov-1
Morty Proxy This is a proxified and sanitized view of the page, visit original site.