1644691 - Intermittent bugs/456219-2.html == bugs/456219-2-ref.html | image comparison, max difference: 10, number of differing pixels: 8

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=305773144&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/E07AV5PbSMi9wmamHMZAJg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/E07AV5PbSMi9wmamHMZAJg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2020-06-10T10:36:52.970Z] 10:36:52 INFO - REFTEST TEST-START | layout/reftests/bugs/456219-2.html == layout/reftests/bugs/456219-2-ref.html
[task 2020-06-10T10:36:52.970Z] 10:36:52 INFO - REFTEST TEST-LOAD | http://10.7.205.218:8854/tests/layout/reftests/bugs/456219-2.html | 1328 / 2155 (61%)
[task 2020-06-10T10:36:52.970Z] 10:36:52 INFO - REFTEST TEST-LOAD | http://10.7.205.218:8854/tests/layout/reftests/bugs/456219-2-ref.html | 1328 / 2155 (61%)
[task 2020-06-10T10:36:52.970Z] 10:36:52 INFO - REFTEST INFO | REFTEST fuzzy test (9, 8) <= (10, 8) <= (9, 8)
[task 2020-06-10T10:36:52.970Z] 10:36:52 WARNING - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/bugs/456219-2.html == layout/reftests/bugs/456219-2-ref.html | image comparison, max difference: 10, number of differing pixels: 8
[task 2020-06-10T10:36:53.070Z] 10:36:52 INFO - REFTEST IMAGE 1 (TEST): data:image/png;base64,
[task 2020-06-10T10:36:53.071Z] 10:36:52 INFO - REFTEST IMAGE 2 (REFERENCE): data:image/png;base64,
[task 2020-06-10T10:36:53.071Z] 10:36:52 INFO - REFTEST TEST-END | layout/reftests/bugs/456219-2.html == layout/reftests/bugs/456219-2-ref.html

Comment 1

[Intermittent Failures Robot]

6 failures in 5211 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 2

[Intermittent Failures Robot]

17 failures in 4035 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• try: 4
• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 17

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 3

[Intermittent Failures Robot]

13 failures in 5252 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 1
• try: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 4

[Intermittent Failures Robot]

12 failures in 4516 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-beta: 3
• mozilla-central: 1
• try: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-06-29&endday=2020-07-05&tree=all

Comment 5

[Intermittent Failures Robot]

19 failures in 5265 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 11
• mozilla-beta: 4
• try: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 18
• android-hw-p2-8-0-android-aarch64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 6

[Intermittent Failures Robot]

20 failures in 4014 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 19
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 7

[Intermittent Failures Robot]

17 failures in 4310 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 12
• try: 2
• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 16
• android-hw-p2-8-0-android-aarch64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-07-20&endday=2020-07-26&tree=all

Comment 8

[Intermittent Failures Robot]

16 failures in 4289 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-07-27&endday=2020-08-02&tree=all

Comment 9

[Intermittent Failures Robot]

9 failures in 4618 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-08-03&endday=2020-08-09&tree=all

Comment 10

[Intermittent Failures Robot]

6 failures in 3601 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 4

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-08-10&endday=2020-08-16&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 4100 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-08-17&endday=2020-08-23&tree=all

Comment 12

[Intermittent Failures Robot]

3 failures in 4046 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-08-24&endday=2020-08-30&tree=all

Comment 13

[Intermittent Failures Robot]

3 failures in 2984 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-08-31&endday=2020-09-06&tree=all

Comment 14

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

This started to fail frequently on Android 8.0 Pixel2 AArch64 WebRender opt last night. Can you investigate or update the fuzzy annotation, please?

Comment 15

[Intermittent Failures Robot]

18 failures in 742 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• try: 5
• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 11
• android-hw-p2-8-0-android-aarch64-shippable-qr: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-09-11&endday=2020-09-11&tree=all

Comment 16

[Matt Woodrow (:mattwoodrow)]

Do you know what change caused this to start failing?

Comment 17

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Bisection points to bug 1664084.

Comment 18

[Glenn Watson [:gw]]

Attachment: Bug 1644691 - Update fuzziness for bugs/456219-2.html.

Add an extra pixel of fuzziness for this test - a recent unrelated
change to WR thread timing made this intermittent fail more often.

Comment 19

[Glenn Watson [:gw]]

Added a patch for an extra 1 pixel of fuzziness for this test on WR. Looks like the bisection above is unrelated, but it will cause timing differences due to improved worker thread usage, which would explain why this intermittent changed in frequency.

Comment 20

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8f9f869deed9
Update fuzziness for bugs/456219-2.html. r=mattwoodrow

Comment 21

[Intermittent Failures Robot]

53 failures in 3410 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #12 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 41
• mozilla-central: 6
• try: 6

Platform breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 42
• android-hw-p2-8-0-android-aarch64-shippable-qr: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1644691&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 22

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/8f9f869deed9