Open Bug 1638834 Opened 4 months ago Updated 3 months ago

Frequent /html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html | Testing http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html ==

Categories

(Testing :: Reftest, defect, P5)

defect

Tracking

(Not tracked)

REOPENED

People

(Reporter: intermittent-bug-filer, Assigned: aryx)

Details

(Keywords: intermittent-failure, leave-open, Whiteboard: [comment 14])

Attachments

(1 file)

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=302716145&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DGCrzd3uSy2udH7Yy4njWQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DGCrzd3uSy2udH7Yy4njWQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1


[task 2020-05-18T10:20:59.609Z] 10:20:59 INFO - TEST-START | /html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html
[task 2020-05-18T10:20:59.609Z] 10:20:59 INFO - PID 26721 | 1589797259599 Marionette INFO No differences allowed
[task 2020-05-18T10:20:59.616Z] 10:20:59 INFO - PID 26721 | 1589797259610 Marionette INFO Testing http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html == http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins-ref.html
[task 2020-05-18T10:20:59.755Z] 10:20:59 INFO - PID 26721 | 1589797259747 Marionette INFO Allowed 8-10 pixels different, maximum difference per channel 8-8
[task 2020-05-18T10:20:59.806Z] 10:20:59 INFO - TEST-UNEXPECTED-FAIL | /html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html | Testing http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html == http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins-ref.html
[task 2020-05-18T10:20:59.806Z] 10:20:59 INFO - Found 0 pixels different, maximum difference per channel 0

Summary: Intermittent /html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html | Testing http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html == → Frequent/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html | Testing http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html ==

Mats, do you have insights into this test? At the moment it seems to also frequently fail on older pushes, an underlying infrastructure change has not been identified.

Flags: needinfo?(mats)

INFO - Found 0 pixels different, maximum difference per channel 0

I don't understand why it fails then. Looking at the reftest-analyzer link, it appears there are some pixels around the edges with a different shade of grey? But those aren't part of the viewport that we analyze? I seem to recall we've seen this before and we concluded that it's a bug in the reftest framework or something...

Flags: needinfo?(mats)
Component: DOM: Core & HTML → Reftest
Product: Core → Testing
Assignee: nobody → aryx.bugmail
Status: NEW → ASSIGNED
Attachment #9150128 - Attachment description: Bug 1638834 - Update expectation fore Linux WebRender legend-auto-margins.html. r=jgraham → Bug 1638834 - Update expectation fore Linux WebRender legend-auto-margins.html. r=jgraham DONTBUILD
Pushed by archaeopteryx@coole-files.de:
https://hg.mozilla.org/integration/autoland/rev/72dca1bbfec3
Update expectation fore Linux WebRender legend-auto-margins.html. r=jgraham DONTBUILD
Status: ASSIGNED → RESOLVED
Closed: 4 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla78
Flags: needinfo?(ryanvm)
Status: RESOLVED → REOPENED
Keywords: leave-open
Resolution: FIXED → ---
Whiteboard: [stockwell disable-recommended]
Target Milestone: mozilla78 → ---

Removing ni as I assume the reply is the same as th last part of https://bugzilla.mozilla.org/show_bug.cgi?id=1633850#c27

Flags: needinfo?(ryanvm)
Summary: Frequent/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html | Testing http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html == → Frequent /html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html | Testing http://web-platform.test:8000/html/rendering/non-replaced-elements/the-fieldset-and-legend-elements/legend-auto-margins.html ==

Recent failures are on beta and release and will be fixed with the merge. Removing the stockwell tag.

Whiteboard: [stockwell disable-recommended]
Whiteboard: [stockwell disable-recommended] → [comment 14]
You need to log in before you can comment on or make changes to this bug.