1383232 - Intermittent background-repeat/background-repeat-round-roundup.xht | Testing background-repeat/background-repeat-round-roundup.xht == http://web-platform.test:8000/css/css-backgrounds-3/background-repeat/reference/background-repeat-round-roundup.xht

Status: RESOLVED FIXED

(Core :: Layout, defect)

Description

[Treeherder Bug Filer]

Filed by: wkocher [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=116398644&repo=autoland

https://queue.taskcluster.net/v1/task/Y4mFxFjOT92W3v6W6GwGKw/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/Y4mFxFjOT92W3v6W6GwGKw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

Comment 1

[Intermittent Failures Robot]

5 failures in 822 pushes (0.006 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 4
* mozilla-inbound: 1

Platform breakdown:
* linux64-stylo: 2
* linux32: 2
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 2

[Intermittent Failures Robot]

19 failures in 1008 pushes (0.019 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 9
* autoland: 5
* pine: 4
* oak: 1

Platform breakdown:
* linux32: 9
* linux64-stylo: 7
* linux64: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-07-24&endday=2017-07-30&tree=all

Comment 3

[Intermittent Failures Robot]

9 failures in 888 pushes (0.01 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 5
* autoland: 3
* mozilla-central: 1

Platform breakdown:
* linux32: 7
* linux64-stylo: 1
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-07-31&endday=2017-08-06&tree=all

Comment 4

[Intermittent Failures Robot]

13 failures in 901 pushes (0.014 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5
* mozilla-central: 4
* try: 2
* mozilla-beta: 2

Platform breakdown:
* linux64-stylo: 8
* linux64-ccov: 4
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-08-07&endday=2017-08-13&tree=all

Comment 5

[Intermittent Failures Robot]

12 failures in 949 pushes (0.013 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 6
* try: 2
* mozilla-central: 2
* mozilla-inbound: 1
* mozilla-beta: 1

Platform breakdown:
* linux64-stylo: 7
* linux64-ccov: 2
* linux32: 2
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 6

[Intermittent Failures Robot]

17 failures in 908 pushes (0.019 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 9
* try: 2
* mozilla-inbound: 2
* mozilla-central: 2
* mozilla-beta: 2

Platform breakdown:
* linux64-stylo: 9
* linux32: 5
* linux64: 2
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-08-21&endday=2017-08-27&tree=all

Comment 7

[Intermittent Failures Robot]

19 failures in 939 pushes (0.02 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 7
* try: 5
* mozilla-central: 5
* mozilla-inbound: 1
* mozilla-beta: 1

Platform breakdown:
* linux64-stylo: 6
* linux32-stylo: 6
* linux32: 4
* linux64-ccov: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-08-28&endday=2017-09-03&tree=all

Comment 8

[Intermittent Failures Robot]

10 failures in 924 pushes (0.011 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 6
* mozilla-central: 4

Platform breakdown:
* linux32-stylo-disabled: 5
* linux64-ccov: 3
* linux32-stylo: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-09-04&endday=2017-09-10&tree=all

Comment 9

[Intermittent Failures Robot]

8 failures in 1032 pushes (0.008 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 4
* mozilla-beta: 2
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* linux64-ccov: 4
* linux64-stylo-disabled: 1
* linux64-stylo: 1
* linux64: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-09-11&endday=2017-09-17&tree=all

Comment 10

[Intermittent Failures Robot]

15 failures in 943 pushes (0.016 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 5
* mozilla-inbound: 3
* mozilla-release: 2
* mozilla-central: 2
* mozilla-beta: 2
* try: 1

Platform breakdown:
* linux32-stylo-disabled: 4
* linux64-stylo: 3
* linux64: 3
* linux32: 3
* linux64-ccov: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 11

[Intermittent Failures Robot]

11 failures in 885 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 5
* autoland: 4
* mozilla-inbound: 2

Platform breakdown:
* linux32-stylo-disabled: 5
* linux64-ccov: 4
* linux64: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-09-25&endday=2017-10-01&tree=all

Comment 12

[Intermittent Failures Robot]

45 failures in 824 pushes (0.055 failures/push) were associated with this bug in the last 7 days. 

This is the #49 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 20
* mozilla-inbound: 11
* mozilla-central: 9
* try: 4
* mozilla-beta: 1

Platform breakdown:
* linux32: 25
* linux64: 9
* linux32-stylo-disabled: 5
* linux64-stylo-disabled: 3
* linux64-ccov: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 13

[Joel Maher ( :jmaher ) (UTC -8)]

this is failing on all linux platforms in debug mode.

here is a recent log:
https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=135599004&lineNumber=4758

and the reftest analyzer:
https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/AomSiHPhTUOWkYq2SR-vBw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

the reference is blurry and the test image is crisper, but overall they show the same thing except for the edges where the blur shows up.

:jet, can you help prioritize this bug and find a developer to work on it when appropriate?  also for this test case, I would like to ensure it has the proper bugzilla component mapped, can you help me find that?

Comment 14

[Intermittent Failures Robot]

19 failures in 188 pushes (0.101 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 8
* autoland: 6
* mozilla-central: 3
* try: 2

Platform breakdown:
* linux32: 10
* linux64: 5
* linux32-stylo-disabled: 3
* linux64-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-10-11&endday=2017-10-11&tree=all

Comment 15

[Intermittent Failures Robot]

56 failures in 947 pushes (0.059 failures/push) were associated with this bug in the last 7 days. 

This is the #34 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 21
* autoland: 20
* mozilla-central: 8
* try: 7

Platform breakdown:
* linux32: 24
* linux64: 16
* linux32-stylo-disabled: 10
* linux64-stylo-disabled: 4
* linux64-ccov: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-10-09&endday=2017-10-15&tree=all

Comment 16

[Joel Maher ( :jmaher ) (UTC -8)]

checking in here- our failure rate is still high, :jet- have you had a chance to find someone to look into this?  At the current failure rate, I imagine this will hit our limit for disabled-recommended by the end of the month.

Comment 17

[Intermittent Failures Robot]

39 failures in 864 pushes (0.045 failures/push) were associated with this bug in the last 7 days. 

This is the #33 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 16
* mozilla-inbound: 14
* mozilla-central: 7
* try: 1
* mozilla-beta: 1

Platform breakdown:
* linux32: 25
* linux32-stylo-disabled: 6
* linux64: 5
* linux64-ccov: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-10-16&endday=2017-10-22&tree=all

Comment 18

[Joel Maher ( :jmaher ) (UTC -8)]

we have 176 failures in the last 30 days, I suspect we will just disable this soon :(

Comment 19

[Intermittent Failures Robot]

41 failures in 912 pushes (0.045 failures/push) were associated with this bug in the last 7 days. 

This is the #38 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 19
* mozilla-inbound: 12
* mozilla-central: 6
* try: 3
* mozilla-release: 1

Platform breakdown:
* linux32: 14
* linux32-stylo-disabled: 13
* linux64: 8
* linux64-stylo-disabled: 4
* linux64-stylo: 1
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 20

[Intermittent Failures Robot]

6 failures in 169 pushes (0.036 failures/push) were associated with this bug yesterday.    

** This test has failed more than 200 times in the last 30 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* try: 2
* mozilla-central: 2
* autoland: 2

Platform breakdown:
* linux32: 4
* linux64-ccov: 1
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-10-31&endday=2017-10-31&tree=all

Comment 21

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/29e48199dd0d
Disable background-repeat/background-repeat-round-roundup.xht on linux debug for frequent failures. r=me, a=testonly

Comment 22

[Joel Maher ( :jmaher ) (UTC -8)]

Please remember to enable this test while working on a fix for it.

Comment 23

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/29e48199dd0d

Comment 24

[Intermittent Failures Robot]

21 failures in 857 pushes (0.025 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 10
* try: 4
* mozilla-inbound: 3
* mozilla-central: 3
* mozilla-beta: 1

Platform breakdown:
* linux32: 15
* linux32-stylo-disabled: 3
* linux64-stylo-disabled: 1
* linux64-ccov: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-10-30&endday=2017-11-05&tree=all

Comment 25

[Intermittent Failures Robot]

1 failures in 744 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1383232&startday=2017-11-20&endday=2017-11-26&tree=all

Comment 26

[Joel Maher ( :jmaher ) (UTC -8)]

as a reminder this test is still disabled

Comment 27

[Jet Villegas (inactive)]

Attachment: Reftest Analyzer screenshot showing the issue

(In reply to Joel Maher ( :jmaher) (UTC-5) from comment #26)
> as a reminder this test is still disabled

I had another look at the failure here, and attached a screenshot. The first <img="rectangle-96x60.png"> is painted correctly in the TEST and incorrectly in the REFERENCE. The actual background painting that the test is validating is correct.

https://treeherder.mozilla.org/logviewer.html#?job_id=135657791&repo=autoland&lineNumber=5475

Given that, I'm OK with skipping this test on Linux DEBUG. I'd rather not add fuzz to fix this one.

Comment 28

[Joel Maher ( :jmaher ) (UTC -8)]

given that we want to leave this disabled, I am going to resolve this bug.