1466002 - Perma - css-invalid/select/select-disabled-fieldset-1.html == css-invalid/select/select-fieldset-ref.html | image comparison, max difference: 9, number of differing pixels: 1

Status: RESOLVED INCOMPLETE

(Core :: Layout: Form Controls, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=181221411&repo=autoland

https://queue.taskcluster.net/v1/task/e6niv7laQxqmQpBsoW6-5w/runs/1/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/e6niv7laQxqmQpBsoW6-5w/runs/1/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2018-05-31T21:40:30.319Z] 21:40:30     INFO -  REFTEST SUITE-START | Running 537 tests
[task 2018-05-31T21:40:30.320Z] 21:40:30     INFO -  REFTEST TEST-START | http://10.0.2.2:8888/tests/layout/reftests/css-invalid/select/select-disabled-fieldset-1.html == http://10.0.2.2:8888/tests/layout/reftests/css-invalid/select/select-fieldset-ref.html
[task 2018-05-31T21:40:30.320Z] 21:40:30     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/reftests/css-invalid/select/select-disabled-fieldset-1.html | 0 / 537 (0%)
[task 2018-05-31T21:40:40.840Z] 21:40:40     INFO -  REFTEST INFO | drawWindow flags = DRAWWINDOW_DRAW_CARET | DRAWWINDOW_DRAW_VIEW | DRAWWINDOW_USE_WIDGET_LAYERS; window size = 800,1118; test browser size = 800,1000
[task 2018-05-31T21:40:40.843Z] 21:40:40     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/reftests/css-invalid/select/select-fieldset-ref.html | 0 / 537 (0%)
[task 2018-05-31T21:40:51.263Z] 21:40:51     INFO -  REFTEST INFO | REFTEST fuzzy test (0, 0) <= (9, 1) <= (8, 1)
[task 2018-05-31T21:40:51.265Z] 21:40:51     INFO -  REFTEST TEST-UNEXPECTED-FAIL | http://10.0.2.2:8888/tests/layout/reftests/css-invalid/select/select-disabled-fieldset-1.html == http://10.0.2.2:8888/tests/layout/reftests/css-invalid/select/select-fieldset-ref.html | image comparison, max difference: 9, number of differing pixels: 1

Comment 2

[Intermittent Failures Robot]

17 failures in 128 pushes (0.133 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 12
* mozilla-inbound: 2
* mozilla-central: 2
* try: 1

Platform breakdown:
* android-4-3-armv7-api16: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1466002&startday=2018-06-01&endday=2018-06-01&tree=trunk

Comment 3

[Dorel Luca [:dluca]]

Looks like the files that failing file was introduced with this push: https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=f5990eb1eb0d2f89f082783a377785e95b40d541&filter-searchStr=Android%204.3%20API16%20%20opt%20Reftests%20test-android-4.3-arm7-api-16%2Fopt-reftest-14%20R(R14)

mreavy: Could you please take a look at this bug?

Comment 4

[Intermittent Failures Robot]

27 failures in 655 pushes (0.041 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 22
* mozilla-inbound: 2
* mozilla-central: 2
* try: 1

Platform breakdown:
* android-4-3-armv7-api16: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1466002&startday=2018-05-28&endday=2018-06-03&tree=trunk

Comment 5

[Maire Reavy [:mreavy]]

Brad - this appears to be a regression from Bug 1461046 - could you investigate?  Thanks

Comment 6

[Brad Werth [:bradwerth]]

I'm not sure there's anything to do here. The reftest expectations were updated in Bug 1461046, but they seem to set expectations that match what the test is doing now: https://searchfox.org/mozilla-central/source/layout/reftests/css-invalid/select/reftest.list#10. Likewise, when I review the intermittent-failures report, I don't see any failures past June 1. This looks resolved to me.

Comment 7

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup