1476724 - Intermittent css-ui-invalid/default-style/button.html == css-ui-invalid/default-style/button-ref.html | image comparison, max difference: 1, number of differing pixels: 1

Status: RESOLVED FIXED

(Core :: Layout: Form Controls, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: cbrindusan [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=188787484&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/OyZDhFBcSr-Bmv6U5O9bvQ/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/OyZDhFBcSr-Bmv6U5O9bvQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2018-07-18T17:15:45.952Z] 17:15:45     INFO - REFTEST TEST-START | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html
[task 2018-07-18T17:15:45.953Z] 17:15:45     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html | 1 / 10 (10%)
[task 2018-07-18T17:15:45.979Z] 17:15:45     INFO - ++DOMWINDOW == 34 (0xd5e7f400) [pid = 2330] [serial = 34] [outer = 0xd905d2e0]
[task 2018-07-18T17:15:46.037Z] 17:15:46     INFO - [2330, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004005: file /builds/worker/workspace/build/src/dom/base/nsContentUtils.cpp, line 4005
[task 2018-07-18T17:15:46.188Z] 17:15:46     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html | 1 / 10 (10%)
[task 2018-07-18T17:15:46.209Z] 17:15:46     INFO - ++DOMWINDOW == 35 (0xd854c800) [pid = 2330] [serial = 35] [outer = 0xd905d2e0]
[task 2018-07-18T17:15:46.482Z] 17:15:46     INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html | image comparison, max difference: 1, number of differing pixels: 1

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

unable to reproduce this failure using test-verify:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&filter-searchStr=linux%20-bf&tochange=38ebcdae9bca37cfdb17c2199030cbe4f2612aa8&fromchange=b28ca0001c8e7f30a65cb18e65f750e460a68580

Comment 2

[Cosmin Sabou [:CosminS]]

This looks to have started with this push: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=72725d9980b366c47b3c1cff39c3a737d0d3c8d8&filter-searchStr=Linux%20debug%20Reftests%20test-linux32%2Fdebug-reftest-1%20R(R1)
https://hg.mozilla.org/integration/mozilla-inbound/rev/72725d9980b366c47b3c1cff39c3a737d0d3c8d8

Range: http://tinyurl.com/yclethmw

Ryan, could you please take a look at this? Thank you.

Comment 3

[Intermittent Failures Robot]

38 failures in 653 pushes (0.058 failures/push) were associated with this bug in the last 7 days. 

This is the #22 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 14
* autoland: 13
* try: 6
* mozilla-central: 5

Platform breakdown:
* linux32: 38

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1476724&startday=2018-07-16&endday=2018-07-22&tree=trunk

Comment 4

[Natalia Csoregi [:nataliaCs]]

There have been 46 failures since the bug was filed, on linux32 debug.

Recent failure log:
https://treeherder.mozilla.org/logviewer.html#?job_id=189772380&repo=autoland&lineNumber=9711

[task 2018-07-24T12:47:00.538Z] 12:47:00     INFO - REFTEST TEST-START | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html
[task 2018-07-24T12:47:00.540Z] 12:47:00     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html | 1 / 10 (10%)
[task 2018-07-24T12:47:00.570Z] 12:47:00     INFO - ++DOMWINDOW == 34 (0xd6f09000) [pid = 2280] [serial = 34] [outer = 0xdd659540]
[task 2018-07-24T12:47:00.627Z] 12:47:00     INFO - [2280, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004005: file /builds/worker/workspace/build/src/dom/base/nsContentUtils.cpp, line 4004
[task 2018-07-24T12:47:00.762Z] 12:47:00     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html | 1 / 10 (10%)
[task 2018-07-24T12:47:00.787Z] 12:47:00     INFO - ++DOMWINDOW == 35 (0xd6f08000) [pid = 2280] [serial = 35] [outer = 0xdd659540]
[task 2018-07-24T12:47:01.059Z] 12:47:01     INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html | image comparison, max difference: 1, number of differing pixels: 1

Comment 5

[Ryan Hunt [:rhunt]]

Attachment: Bug 1476724 - Mark default-style/button.html as fuzzy on debug linux.

Review commit: https://reviewboard.mozilla.org/r/259186/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/259186/

Comment 6

[Ryan Hunt [:rhunt]]

This looks to be an intermittent fuzziness change from enabling tiling on linux that I missed. We should just mark it fuzzy.

Comment 7

[Jeff Muizelaar [:jrmuizel]]

Comment on attachment 8994672 [details]
Bug 1476724 - Mark default-style/button.html as fuzzy on debug linux.

https://reviewboard.mozilla.org/r/259186/#review267008

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/24cf07cf024e
Mark default-style/button.html as fuzzy on debug linux. r=jrmuizel

Comment 9

[Daniel Varga [:dvarga]]

https://hg.mozilla.org/mozilla-central/rev/24cf07cf024e

Comment 10

[Narcis Beleuzu [:NarcisB]]

Fail reappeared on inbound.

Log link: https://treeherder.mozilla.org/logviewer.html#?job_id=190753084&repo=mozilla-inbound&lineNumber=10361

Comment 11

[Bogdan Tara[:bogdan_tara | bogdant]]

This is still happening.

Recent failure: https://treeherder.mozilla.org/logviewer.html#?job_id=190753084&repo=mozilla-inbound&lineNumber=10361

[task 2018-07-29T01:34:11.402Z] 01:34:11     INFO - REFTEST TEST-LOAD | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html | 1 / 10 (10%)
[task 2018-07-29T01:34:11.425Z] 01:34:11     INFO - ++DOMWINDOW == 35 (0xdeab5800) [pid = 1984] [serial = 35] [outer = 0xdf945540]
[task 2018-07-29T01:34:11.686Z] 01:34:11     INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html | image comparison, max difference: 1, number of differing pixels: 1
[task 2018-07-29T01:34:11.687Z] 01:34:11     INFO - REFTEST   IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAA
[task 2018-07-29T01:34:11.689Z] 01:34:11     INFO - REFTEST   IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAyAAAAPoCA
[task 2018-07-29T01:34:11.690Z] 01:34:11     INFO - REFTEST INFO | Saved log: START file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html
[task 2018-07-29T01:34:11.692Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering WaitForTestEnd
[task 2018-07-29T01:34:11.693Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] WaitForTestEnd: Adding listeners
[task 2018-07-29T01:34:11.696Z] 01:34:11     INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2018-07-29T01:34:11.696Z] 01:34:11     INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2018-07-29T01:34:11.697Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2018-07-29T01:34:11.698Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2018-07-29T01:34:11.700Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html
[task 2018-07-29T01:34:11.701Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] SendUpdateCanvasForEvent with 0 rects
[task 2018-07-29T01:34:11.702Z] 01:34:11     INFO - REFTEST INFO | Saved log: Updating canvas for invalidation
[task 2018-07-29T01:34:11.703Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2018-07-29T01:34:11.703Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2018-07-29T01:34:11.707Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html
[task 2018-07-29T01:34:11.708Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] SendUpdateCanvasForEvent with 1 rects
[task 2018-07-29T01:34:11.709Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] Rect: 0 0 800 1000
[task 2018-07-29T01:34:11.709Z] 01:34:11     INFO - REFTEST INFO | Saved log: Updating canvas for invalidation
[task 2018-07-29T01:34:11.710Z] 01:34:11     INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2018-07-29T01:34:11.711Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2018-07-29T01:34:11.711Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: dispatching MozReftestInvalidate
[task 2018-07-29T01:34:11.712Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_REFTEST_WAIT_REMOVAL
[task 2018-07-29T01:34:11.713Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_SPELL_CHECKS
[task 2018-07-29T01:34:11.714Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_APZ_FLUSH
[task 2018-07-29T01:34:11.715Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: APZ flush not required
[task 2018-07-29T01:34:11.716Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FINISH
[task 2018-07-29T01:34:11.718Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: Completed
[task 2018-07-29T01:34:11.719Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2018-07-29T01:34:11.720Z] 01:34:11     INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2018-07-29T01:34:11.720Z] 01:34:11     INFO - REFTEST INFO | Saved log: START file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html
[task 2018-07-29T01:34:11.721Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
[task 2018-07-29T01:34:11.722Z] 01:34:11     INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2018-07-29T01:34:11.723Z] 01:34:11     INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2018-07-29T01:34:11.723Z] 01:34:11     INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2018-07-29T01:34:11.724Z] 01:34:11     INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2018-07-29T01:34:11.725Z] 01:34:11     INFO - REFTEST TEST-END | file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button.html == file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/css-ui-invalid/default-style/button-ref.html
[task 2018-07-29T01:34:11.726Z] 01:34:11     INFO - ++DOMWINDOW == 36 (0xdeabbc00) [pid = 1984] [serial = 36] [outer = 0xdf945540]

Comment 12

[Intermittent Failures Robot]

55 failures in 760 pushes (0.072 failures/push) were associated with this bug in the last 7 days. 

This is the #30 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 22
* mozilla-inbound: 18
* mozilla-central: 11
* try: 4

Platform breakdown:
* linux32: 55

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1476724&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 14

[Ryan Hunt [:rhunt]]

I marked 'layout/reftests/css-invalid/default-style/button.html' as fuzzy when I needed to mark 'layout/reftests/css-ui-invalid/default-style/button.html' as fuzzy. I'll put up a patch to fix this.

Comment 15

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/49bd486c1bda
Follow up. Mark the css-ui-invalid/**/button.html as fuzzy, not css-invalid/**/button.html. r=me

Comment 16

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/49bd486c1bda