Intermittent /acid/acid2/reftest.html | single tracking bug
Categories
(Testing :: web-platform-tests, defect, P3)
Tracking
(firefox-esr128 unaffected, firefox137 unaffected, firefox138 unaffected, firefox139 wontfix)
| Tracking | Status | |
|---|---|---|
| firefox-esr128 | --- | unaffected |
| firefox137 | --- | unaffected |
| firefox138 | --- | unaffected |
| firefox139 | --- | wontfix |
People
(Reporter: jmaher, Unassigned)
References
Details
(Keywords: intermittent-failure, intermittent-testcase)
Attachments
(1 obsolete file)
| Reporter | ||
Comment 1•4 years ago
|
||
Additional information about this bug failures and frequency patterns can be found by running: ./mach test-info failure-report --bug 1785395
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 11•3 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.
Comment 12•3 years ago
|
||
| treeherder | ||
New failure instance: https://treeherder.mozilla.org/logviewer?job_id=415978668&repo=mozilla-beta
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 17•3 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.
Comment 18•3 years ago
|
||
| treeherder | ||
New failure instance: https://treeherder.mozilla.org/logviewer?job_id=422187987&repo=mozilla-beta
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 26•2 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.
Comment 27•2 years ago
|
||
| treeherder | ||
New failure instance: https://treeherder.mozilla.org/logviewer?job_id=436339331&repo=autoland
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Updated•2 years ago
|
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 41•2 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.
Comment 42•2 years ago
|
||
| treeherder | ||
New failure instance: https://treeherder.mozilla.org/logviewer?job_id=473130641&repo=mozilla-central
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 46•1 year ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.
Comment 47•1 year ago
|
||
| treeherder | ||
New failure instance: https://treeherder.mozilla.org/logviewer?job_id=490649442&repo=mozilla-beta
| Comment hidden (Intermittent Failures Robot) |
Comment 49•1 year ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.
| Comment hidden (Intermittent Failures Robot) |
Comment 51•1 year ago
|
||
| treeherder | ||
New failure instance: https://treeherder.mozilla.org/logviewer?job_id=503626183&repo=mozilla-central
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 54•1 year ago
|
||
Something may have regressed here that's worth worrying about...
We have only three reports of test failures for the whole year (which are in fact just unexpected assertion-failures), and then starting on 4/11, we've got multiple failures (not assertion failures, but actual rendering failures) per day.
This isn't platform-specific, either - previous comments show that we've got failures on Android, Linux, and Windows. They all seem to be on slower configurations, though -- either debug or opt-with-ASAN.
The first commit on 4/11 with a reftest failure is autoland 303fc19db920e2b98df3b0e4e345a10550bada6b, with failure log here
Comment 55•1 year ago
|
||
Comment 56•1 year ago
|
||
(In reply to Daniel Holbert [:dholbert] from comment #54)
The first commit on 4/11 with a reftest failure is autoland 303fc19db920e2b98df3b0e4e345a10550bada6b, with failure log here
Aha -- looking at TreeHerder leading up to that commit, it seems someone has already done backfills to previous cycles there (the jobs called "Wr6-303fc19db92-bk"), and it looks a lot like the test failures start on the push for bug 1954597. I'll spin off a dedicated bug for this regression, marked as blocking this intermittent and regressed-by bug 1954597.
Updated•1 year ago
|
Comment 57•1 year ago
|
||
Set release status flags based on info from the regressing bug 1954597
:nika, since you are the author of the regressor, bug 1954597, could you take a look?
For more information, please visit BugBot documentation.
Comment 58•1 year ago
|
||
This is an existing failure. There is already another bug (bug 1961008), which has been created to track the recent regression. Let's remove the regressed by here, and track the work in the other bug.
Updated•1 year ago
|
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
| Comment hidden (Intermittent Failures Robot) |
Comment 63•1 year ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.
| Comment hidden (Intermittent Failures Robot) |
Description
•