Conversation
Apply three targeted changes in avocado: - use a simulated clock, removing scheduler variability in a flaky unit test for the wait utility - measure monotonic time and allow one second of scheduling overhead in a functional test for the wait utility - run sequentially, preventing the deadline from interrupting the passing test’s startup in job timeout functional test The last of the three is indicated by 9 = 8 | 1 status meaning both the job was interrupted and a test failed or errored (passtest ERROR). If we run in serial mode the deadline interrupts while passtest is still queued and is thus subsequently skipped. Signed-off-by: Plamen Dimitrov <plamen.dimitrov@intra2net.com>
|
You are changing one of the avocado utils which has already been migrated to AAutils project https://github.com/avocado-framework/aautils and this utility will be removed after the LTS release. Please make sure that all your proposed changes are already in AAutils and this PR is only backport. For more information about AAutlis migration see https://avocado-framework.readthedocs.io/en/latest/blueprints/BP005.html For a list of migrated utilities see https://avocado-framework.github.io/aautils.html |
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Advanced Run ID: 📒 Files selected for processing (3)
Included review availability: Your plan provides up to 2 included reviews per hour; 1 remains after this review. WalkthroughThe changes improve timeout test stability. The functional job timeout test limits parallel tasks to one. Functional wait timing uses Priority: ⬇️ Low Estimated code review effort: 2 (Simple) | ~10 minutes Merge Risk: ⚪ Minimal · up to The timeout tests now use deterministic scheduling and monotonic timing without introducing an identified merge-blocking risk. 🚥 Pre-merge checks | ✅ 4 | ❌ 1❌ Failed checks (1 warning)
✅ Passed checks (4 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## master #6350 +/- ##
=======================================
Coverage 71.54% 71.54%
=======================================
Files 207 207
Lines 23799 23799
=======================================
Hits 17026 17026
Misses 6773 6773 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
|
@harvey0100 @PraveenPenguin @maramsmurthy I know you have had to rerun jobs in order to deal with flaky tests and I collected three such with fixes proposed here to hopefully let us all have more stable CI jobs. Let me know if you have any other tests that you have observed to have races and occasionally fail. |
Apply three targeted changes in avocado:
The last of the three is indicated by 9 = 8 | 1 status meaning both the job was interrupted and a test failed or errored (passtest ERROR). If we run in serial mode the deadline interrupts while passtest is still queued and is thus subsequently skipped.
Summary by CodeRabbit