Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Conversation

thisislawatts
Copy link
Member

@thisislawatts thisislawatts commented Oct 8, 2025

This change removes the shellspec-based smoke tests.
These tests were originally added to validate high-level
platform workflows.

Over the past few years, our engineering practices have improved.
We now have more mature monitoring for upstream APIs, making
these tests redundant. The same validation is now handled by
the teams who own those API endpoints.

Additionally, our command-line interface (CLI) now provides
much richer analytics, giving us a clearer understanding of
the end-user experience for all workflows.
This makes a periodically run subset of tests unnecessary.

Finally, the shellspec framework is no longer maintained.
To reduce complexity and cognitive overhead for all contributors,
we are consolidating our testing frameworks to use Jest and Tap.

These tests will not be migrated to Jest,
as their purpose is already fulfilled by other systems.

https://snyksec.atlassian.net/browse/CLI-1162

Pull Request Submission Checklist

  • Follows CONTRIBUTING guidelines
  • Commit messages
    are release-note ready, emphasizing
    what was changed, not how.
  • Includes detailed description of changes
  • Contains risk assessment (Low | Medium | High)
  • Highlights breaking API changes (if applicable)
  • Links to automated tests covering new functionality
  • Includes manual testing instructions (if necessary)
  • Updates relevant GitBook documentation (PR link: ___)
  • Includes product update to be announced in the next stable release notes

What does this PR do?

Where should the reviewer start?

How should this be manually tested?

What's the product update that needs to be communicated to CLI users?

Copy link

snyk-io bot commented Oct 8, 2025

🎉 Snyk checks have passed. No issues have been found so far.

security/snyk check is complete. No issues have been found. (View Details)

license/snyk check is complete. No issues have been found. (View Details)

code/snyk check is complete. No issues have been found. (View Details)

@thisislawatts thisislawatts force-pushed the chore/drop-regression-tests branch from 7c0345d to 20bc85f Compare October 8, 2025 09:19
@thisislawatts thisislawatts marked this pull request as ready for review October 9, 2025 08:08
@thisislawatts thisislawatts requested review from a team as code owners October 9, 2025 08:08
@thisislawatts thisislawatts force-pushed the chore/drop-regression-tests branch 3 times, most recently from 03bb860 to 0ffb494 Compare October 10, 2025 10:03
This change removes the shellspec-based smoke tests.
These tests were originally added to validate high-level
platform workflows.

Over the past few years, our engineering practices have improved.
We now have more mature monitoring for upstream APIs, making
these tests redundant. The same validation is now handled by
the teams who own those API endpoints.

Additionally, our command-line interface (CLI) now provides
much richer analytics, giving us a clearer understanding of
the end-user experience for all workflows.
This makes a periodically run subset of tests unnecessary.

Finally, the shellspec framework is no longer maintained.
To reduce complexity and cognitive overhead for all contributors,
we are consolidating our testing frameworks to use Jest and Tap.

These tests will not be migrated to Jest,
as their purpose is already fulfilled by other systems.
@thisislawatts thisislawatts force-pushed the chore/drop-regression-tests branch from 0ffb494 to 791ffb8 Compare October 10, 2025 10:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Morty Proxy This is a proxified and sanitized view of the page, visit original site.