1635733 - Intermittent dom/html/reftests/autofocus/<select-create.html/select-load.html> == dom/html/reftests/autofocus/select-ref.html | image comparison, max difference: 10, number of differing pixels: 5

Status: RESOLVED FIXED

(Core :: DOM: Core & HTML, defect)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=301009559&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/S3bp1Vc8T1y0qWStAlUs1Q/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/S3bp1Vc8T1y0qWStAlUs1Q/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-05-06T11:02:22.308Z] 11:02:22 INFO - REFTEST TEST-START | dom/html/reftests/autofocus/select-create.html == dom/html/reftests/autofocus/select-ref.html
[task 2020-05-06T11:02:22.308Z] 11:02:22 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-create.html | 6849 / 7256 (94%)
[task 2020-05-06T11:02:22.308Z] 11:02:22 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/dom/html/reftests/autofocus/select-ref.html | 6849 / 7256 (94%)
[task 2020-05-06T11:02:22.309Z] 11:02:22 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (10, 5) <= (1, 3)
[task 2020-05-06T11:02:22.310Z] 11:02:22 WARNING - REFTEST TEST-UNEXPECTED-FAIL | dom/html/reftests/autofocus/select-create.html == dom/html/reftests/autofocus/select-ref.html | image comparison, max difference: 10, number of differing pixels: 5
[task 2020-05-06T11:02:22.318Z] 11:02:22 INFO - REFTEST IMAGE 1 (TEST): data:image/png;base64,
[task 2020-05-06T11:02:22.325Z] 11:02:22 INFO - REFTEST IMAGE 2 (REFERENCE): data:image/png;base64,
[task 2020-05-06T11:02:22.325Z] 11:02:22 INFO - REFTEST TEST-END | dom/html/reftests/autofocus/select-create.html == dom/html/reftests/autofocus/select-ref.html

Comment 1

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1635733 - Fuzz two tests that after bug 1311444 have fuzzy outlines on Windows.

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6ead09696c1a
Fuzz two tests that after bug 1311444 have fuzzy outlines on Windows.

Comment 3

[Geoff Brown [:gbrown]]

Most (all?) recent failures here are on Android -- not Windows.

Comment 4

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1635733 - Tweak the fuzz range of two tests on android.

Comment 5

[Emilio Cobos Álvarez (:emilio)]

Huh, I don't know what's up with me today, sorry :(

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/69777ca8022c
Tweak the fuzz range of two tests on android.

Comment 7

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/6ead09696c1a

Comment 8

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/69777ca8022c

Comment 9

[Intermittent Failures Robot]

38 failures in 931 pushes (0.041 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 34
• mozilla-central: 4

Platform breakdown:

• android-em-7-0-x86_64: 38

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635733&startday=2020-05-06&endday=2020-05-06&tree=all

Comment 10

[Intermittent Failures Robot]

40 failures in 5276 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #38 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 34
• mozilla-central: 4
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 40

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635733&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 11

[Andrew Osmond [:aosmond] (he/him)]

Attachment: Bug 1635733 - Increase fuzz for Android on reftest.

Comment 12

[Andrew Osmond [:aosmond] (he/him)]

Attachment: Bug 1635733 - Increase fuzz for Android on reftest.