1560242 - Intermittent flexbox/flexbox-resizeviewport-1.xhtml == flexbox/flexbox-resizeviewport-1-ref.xhtml | image comparison, max difference: 1, number of differing pixels: 18

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: opoprus [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=252520408&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/Wy11FQm0QDun8n0W6We6LQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/Wy11FQm0QDun8n0W6We6LQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-06-19T23:25:55.410Z] 23:25:55 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/layout/reftests/flexbox/flexbox-resizeviewport-1.xhtml == http://10.0.2.2:8854/tests/layout/reftests/flexbox/flexbox-resizeviewport-1-ref.xhtml
[task 2019-06-19T23:25:55.410Z] 23:25:55 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/layout/reftests/flexbox/flexbox-resizeviewport-1.xhtml | 1996 / 3175 (62%)
[task 2019-06-19T23:25:55.414Z] 23:25:55 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/layout/reftests/flexbox/flexbox-resizeviewport-1-ref.xhtml | 1996 / 3175 (62%)
[task 2019-06-19T23:25:55.415Z] 23:25:55 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (1, 18) <= (1, 5)
[task 2019-06-19T23:25:55.416Z] 23:25:55 INFO - REFTEST TEST-UNEXPECTED-FAIL | http://10.0.2.2:8854/tests/layout/reftests/flexbox/flexbox-resizeviewport-1.xhtml == http://10.0.2.2:8854/tests/layout/reftests/flexbox/flexbox-resizeviewport-1-ref.xhtml | image comparison, max difference: 1, number of differing pixels: 18

Comment 1

[Intermittent Failures Robot]

1 failures in 2581 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560242&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 2

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 3

[Narcis Beleuzu [:NarcisB]]

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=296435185&repo=autoland&lineNumber=17735

Comment 4

[Intermittent Failures Robot]

2 failures in 4823 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560242&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 6

[Razvan Maries]

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=317877625&repo=autoland&lineNumber=9981

Comment 7

[Intermittent Failures Robot]

13 failures in 4130 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 2

Platform breakdown:

• macosx1014-64: 12
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560242&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 8

[Intermittent Failures Robot]

21 failures in 3694 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 19
• mozilla-central: 2

Platform breakdown:

• macosx1014-64: 19
• macosx1014-64-shippable: 1
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560242&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 9

[Intermittent Failures Robot]

16 failures in 4230 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 4
• try: 2
• mozilla-beta: 1

Platform breakdown:

• macosx1014-64: 11
• macosx1014-64-shippable: 4
• macosx1014-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560242&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 10

[Intermittent Failures Robot]

20 failures in 4275 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-beta: 3
• mozilla-central: 3

Platform breakdown:

• macosx1014-64: 17
• macosx1014-64-shippable: 2
• macosx1014-64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560242&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 11

[Intermittent Failures Robot]

12 failures in 4128 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-beta: 2

Platform breakdown:

• macosx1014-64: 10
• macosx1014-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560242&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 12

[Intermittent Failures Robot]

13 failures in 4040 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• try: 1
• mozilla-beta: 1
• mozilla-central: 1

Platform breakdown:

• macosx1014-64: 12
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 13

[Intermittent Failures Robot]

3 failures in 4810 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2

Platform breakdown:

• macosx1014-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 14

[Intermittent Failures Robot]

3 failures in 1479 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• macosx1014-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 15

[Intermittent Failures Robot]

8 failures in 3712 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2
• mozilla-beta: 1
• mozilla-release: 1

Platform breakdown:

• macosx1014-64: 6
• macosx1014-64-devedition: 1
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 16

[Intermittent Failures Robot]

5 failures in 4060 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform breakdown:

• macosx1014-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 17

[Intermittent Failures Robot]

7 failures in 3421 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• try: 2
• mozilla-beta: 1
• mozilla-central: 1

Platform breakdown:

• macosx1014-64: 5
• macosx1014-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 18

[Intermittent Failures Robot]

5 failures in 1450 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform breakdown:

• macosx1014-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-12-21&endday=2020-12-27&tree=all

Comment 19

[Intermittent Failures Robot]

5 failures in 525 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1
• mozilla-central: 2
• try: 1

Platform breakdown:

• macosx1014-64: 3
• macosx1014-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2020-12-28&endday=2021-01-03&tree=all

Comment 20

[Intermittent Failures Robot]

10 failures in 2956 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 7
• mozilla-central: 2

Platform breakdown:

• macosx1014-64-devedition: 1
• macosx1014-64: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 21

[Intermittent Failures Robot]

3 failures in 3810 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• macosx1014-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 22

[Intermittent Failures Robot]

8 failures in 3488 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 2
• try: 1

Platform and build breakdown:

• macosx1014-64: 7
  • debug: 7
• macosx1014-64-devedition: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 23

[Intermittent Failures Robot]

11 failures in 3891 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-beta: 1
• try: 2
• mozilla-central: 1

Platform and build breakdown:

• macosx1014-64: 8
  • debug: 8
• macosx1014-64-devedition: 2
  • opt: 2
• linux1804-64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 24

[Intermittent Failures Robot]

14 failures in 3966 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 4

Platform and build breakdown:

• macosx1014-64: 9
  • debug: 9
• linux1804-64: 4
  • opt: 3
  • debug: 1
• linux1804-64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 25

[Andreea Pavel [:apavel]]

There are 27 total failures in the last 7 days on macosx1014-64 debug
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=329865458&repo=autoland&lineNumber=13286

[task 2021-02-13T04:47:00.683Z] 04:47:00 INFO - REFTEST TEST-START | layout/reftests/flexbox/flexbox-resizeviewport-1.xhtml == layout/reftests/flexbox/flexbox-resizeviewport-1-ref.xhtml
[task 2021-02-13T04:47:00.683Z] 04:47:00 INFO - REFTEST TEST-LOAD | file:///Users/cltbld/tasks/task_1613186744/build/tests/reftest/tests/layout/reftests/flexbox/flexbox-resizeviewport-1.xhtml | 62 / 77 (80%)
[task 2021-02-13T04:47:00.970Z] 04:47:00 INFO - REFTEST TEST-LOAD | file:///Users/cltbld/tasks/task_1613186744/build/tests/reftest/tests/layout/reftests/flexbox/flexbox-resizeviewport-1-ref.xhtml | 62 / 77 (80%)
[task 2021-02-13T04:47:01.097Z] 04:47:01 INFO - REFTEST INFO | REFTEST fuzzy test (0, 0) <= (1, 7) <= (1, 5)
[task 2021-02-13T04:47:01.197Z] 04:47:01 INFO - REFTEST TEST-UNEXPECTED-FAIL | layout/reftests/flexbox/flexbox-resizeviewport-1.xhtml == layout/reftests/flexbox/flexbox-resizeviewport-1-ref.xhtml | image comparison, max difference: 1, number of differing pixels: 7
Daniel can you assing someone to take a look?

Comment 26

[Intermittent Failures Robot]

27 failures in 4322 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

This is the #47 most frequent failure this week.

Repository breakdown:

• autoland: 25
• try: 1
• mozilla-central: 1

Platform and build breakdown:

• macosx1014-64: 25
  • debug: 25
• linux1804-64: 2
  • opt: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 27

[Intermittent Failures Robot]

18 failures in 3737 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 1
• try: 3

Platform and build breakdown:

• macosx1014-64: 13
  • debug: 13
• linux1804-64: 2
  • opt: 2
• macosx1014-64-devedition: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 28

[Daniel Holbert [:dholbert]]

Yeah -- sorry for the delay. This is a fuzzy-pixel antialiasing issue at corners of scrollbars, it looks like. Just needs a fuzzy annotation to account for this. I'll add one in the next day or so.

Comment 29

[Daniel Holbert [:dholbert]]

(Actually there's already a fuzzy annotation that we're hitting & just barely violating, as noted in the log: REFTEST fuzzy test (0, 0) <= (1, 7) <= (1, 5). I'll just bump that 5 threshold up to 7.)

Comment 30

[Daniel Holbert [:dholbert]]

or rather, i'll bump it to 8 -- recent linux failures seem to have 8 mismatching pixels, e.g. this one:
https://treeherder.mozilla.org/jobs?repo=autoland&revision=ef54a7f5c1659b4b16d4da3e7c01a825c5e42ed2&selectedJob=330103122

Comment 31

[Daniel Holbert [:dholbert]]

Attachment: Bug 1560242: Increase fuzzy tolerance for reftest flexbox-resizeviewport-1.xhtml to account for observed fuzziness levels. (no review; just a reftest annotation adjustment)

Comment 32

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/21a6d993ab18
Increase fuzzy tolerance for reftest flexbox-resizeviewport-1.xhtml to account for observed fuzziness levels. (no review; just a reftest annotation adjustment) DONTBUILD

Comment 33

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/21a6d993ab18

Comment 34

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/releases/mozilla-beta/rev/525861b80748

Comment 35

[Intermittent Failures Robot]

16 failures in 4327 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 11
• mozilla-beta: 1
• try: 1

Platform and build breakdown:

• macosx1014-64: 15
  • debug: 15
• macosx1014-64-devedition: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1560242&startday=2021-02-22&endday=2021-02-28&tree=all