Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

[release-2.37] chore(e2e): skip feature-level FixedBy assertions#2496

Merged
jvdm merged 1 commit intorelease-2.37stackrox/scanner:release-2.37from
jvdm/skip-fixedby-e2e-check-2.37stackrox/scanner:jvdm/skip-fixedby-e2e-check-2.37Copy head branch name to clipboard
Dec 10, 2025
Merged

[release-2.37] chore(e2e): skip feature-level FixedBy assertions#2496
jvdm merged 1 commit intorelease-2.37stackrox/scanner:release-2.37from
jvdm/skip-fixedby-e2e-check-2.37stackrox/scanner:jvdm/skip-fixedby-e2e-check-2.37Copy head branch name to clipboard

Conversation

@jvdm
Copy link
Contributor

@jvdm jvdm commented Dec 10, 2025

Summary

Backport of #2491 to release-2.37.

  • Skip feature-level FixedBy assertions in E2E tests to eliminate frequent test failures when new advisories are published
  • Per-vulnerability FixedBy validation is preserved, which is more stable and meaningful

Test plan

  • E2E tests pass

The feature-level FixedBy field changes every time a new advisory is
published for a package. This causes frequent E2E test failures that
require manual updates to the test assertions.

Analysis of git history shows that ~74% of commits to testcase_test.go
are updates to FixedBy values - maintenance overhead with minimal test
value since:

1. Per-vulnerability FixedBy is still validated (stable, per-RHSA)
2. Vulnerability detection (correct CVEs/RHSAs) is still tested
3. CVSS metadata (scores, vectors) is still tested
4. Feature identification (name, version, namespace) is still tested

This change mirrors the approach already used in grpc_test.go which
clears FixedBy before comparison.
@jvdm jvdm requested a review from a team as a code owner December 10, 2025 03:04
@jvdm jvdm merged commit 8487cf8 into release-2.37 Dec 10, 2025
39 checks passed
@jvdm jvdm deleted the jvdm/skip-fixedby-e2e-check-2.37 branch December 10, 2025 13:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments

Close sidebar
Morty Proxy This is a proxified and sanitized view of the page, visit original site.