-
Notifications
You must be signed in to change notification settings - Fork 390
chore: Reduce flakiness of test_timeout_in_handler
in CI
#1243
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Honestly, this is one of the tests that could benefit from some event-loop mocking that would make sleeps instant (something like https://vitest.dev/guide/mocking.html#timers). But take my "Approve" and go in peace (for now 😁)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I tried it in #1194, and it didn't help.
I would suggest either skipping this test for now and creating a follow-up issue, or - as we discussed on Slack - since the test passes when run in isolation (I ran it 100 times and it passed every time), let's look into running it in isolation somehow.
55096c1
to
d44beb9
Compare
d44beb9
to
34d2636
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
let's try it
Yes, that would be the best. Unfortunately I could not find any well maintained existing solution for this in Python :-( |
Description
Add marker
run_alone
for running tests in isolation as well.Add the marker
test_timeout_in_handler
to ensure it has enough resources.