1591641 - Intermittent dom/html/reftests/autofocus/select-load.html == dom/html/reftests/autofocus/select-ref.html | image comparison, max difference: 9, number of differing pixels: 3

Status: RESOLVED FIXED

(Core :: DOM: Core & HTML, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: aciure [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=273044556&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/fSWnxq19TfSlFyJPRYRv7g/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/fSWnxq19TfSlFyJPRYRv7g/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-10-26T00:00:38.136Z] 00:00:38 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-load.html == http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html
[task 2019-10-26T00:00:38.137Z] 00:00:38 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-load.html | 7525 / 7933 (94%)
[task 2019-10-26T00:00:38.137Z] 00:00:38 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html | 7525 / 7933 (94%)
[task 2019-10-26T00:00:38.138Z] 00:00:38 WARNING - REFTEST TEST-UNEXPECTED-FAIL | http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-load.html == http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html | image comparison, max difference: 9, number of differing pixels: 3
[task 2019-10-26T00:00:38.148Z] 00:00:38 INFO - REFTEST INFO | Saved log: START http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-load.html
[task 2019-10-26T00:00:38.148Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
[task 2019-10-26T00:00:38.148Z] 00:00:38 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2019-10-26T00:00:38.148Z] 00:00:38 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2019-10-26T00:00:38.149Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2019-10-26T00:00:38.149Z] 00:00:38 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2019-10-26T00:00:38.149Z] 00:00:38 INFO - REFTEST INFO | Saved log: START http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html
[task 2019-10-26T00:00:38.149Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering WaitForTestEnd
[task 2019-10-26T00:00:38.149Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] WaitForTestEnd: Adding listeners
[task 2019-10-26T00:00:38.149Z] 00:00:38 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2019-10-26T00:00:38.149Z] 00:00:38 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] SendUpdateCanvasForEvent with 1 rects
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] Rect: 0 0 800 1000
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: Updating canvas for invalidation
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2019-10-26T00:00:38.150Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: dispatching MozReftestInvalidate
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_REFTEST_WAIT_REMOVAL
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_SPELL_CHECKS
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_APZ_FLUSH
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: done requesting APZ flush
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: apz-repaints-flushed fired
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FINISH
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2019-10-26T00:00:38.151Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html
[task 2019-10-26T00:00:38.152Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] SendUpdateCanvasForEvent with 0 rects
[task 2019-10-26T00:00:38.152Z] 00:00:38 INFO - REFTEST INFO | Saved log: Updating canvas for invalidation
[task 2019-10-26T00:00:38.152Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FINISH
[task 2019-10-26T00:00:38.152Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: Completed
[task 2019-10-26T00:00:38.152Z] 00:00:38 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2019-10-26T00:00:38.152Z] 00:00:38 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2019-10-26T00:00:38.152Z] 00:00:38 INFO - REFTEST TEST-END | http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-load.html == http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html

Comment 1

[Intermittent Failures Robot]

10 failures in 4182 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1591641&startday=2019-10-21&endday=2019-10-27&tree=all

Comment 2

[Intermittent Failures Robot]

16 failures in 787 pushes (0.02 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• try: 2
• mozilla-central: 1

Platform breakdown:

• android-em-7-0-x86_64: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1591641&startday=2019-10-28&endday=2019-10-28&tree=all

Comment 3

[John Dai[:jdai]]

Hi Edwin,
I saw the last change was made by you. Do you think we can add a skip-if for Android platform?

Comment 4

[Edwin Takahashi (:egao | infrequent contributor)]

:jdai - I could add a fuzzy-if condition to keep the test running but have it fail if Android reports parameters outside of the permitted deviation.

Comment 5

[Intermittent Failures Robot]

17 failures in 865 pushes (0.02 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17

Platform breakdown:

• android-em-7-0-x86_64: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1591641&startday=2019-10-29&endday=2019-10-29&tree=all

Comment 6

[Edwin Takahashi (:egao | infrequent contributor)]

I pushed to try with too strict of a condition (fuzzy-if 9-9, 3-3) which caused the chunk to report a failure if deviation was not seen.
https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&selectedJob=273562406&revision=0a280a6a5798b11d8ebea837453570181512f5e8

I've slightly loosened the condition to 0-9, 0-3.
https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&selectedJob=273748131&revision=7567fd9a72a240d481b762d52408949ca31e5dfd

Comment 7

[Edwin Takahashi (:egao | infrequent contributor)]

Attachment: Bug 1591641 - annotate select-load.html with fuzzy-if condition for Android

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e4f25c3f9e66
annotate select-load.html with fuzzy-if condition for Android r=gbrown

Comment 9

[Intermittent Failures Robot]

20 failures in 814 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 1

Platform breakdown:

• android-em-7-0-x86_64: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1591641&startday=2019-10-30&endday=2019-10-30&tree=all

Comment 10

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/e4f25c3f9e66

Comment 11

[Intermittent Failures Robot]

58 failures in 4314 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #29 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 52
• try: 3
• mozilla-central: 2
• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 58

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1591641&startday=2019-10-28&endday=2019-11-03&tree=all