Intermittent bugs/368020-1.html == bugs/368020-1-ref.html | image comparison, max difference: 32, number of differing pixels: 33

RESOLVED FIXED in Firefox 58

Status

()

RESOLVED FIXED
2 years ago
10 months ago

People

(Reporter: intermittent-bug-filer, Assigned: mantaroh)

Tracking

({intermittent-failure})

unspecified
mozilla59
intermittent-failure
Points:
---

Firefox Tracking Flags

(firefox58 fixed, firefox59 fixed)

Details

(Whiteboard: [stockwell unknown])

Attachments

(1 attachment)

6 failures in 894 pushes (0.007 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 4
* try: 1
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 3
* windows7-32-vm: 1
* linux64: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-04-10&endday=2017-04-16&tree=all
7 failures in 817 pushes (0.009 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 2
* mozilla-central: 2
* try: 1
* graphics: 1
* autoland: 1

Platform breakdown:
* windows7-32: 3
* linux32: 2
* windows7-32-vm: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-04-17&endday=2017-04-23&tree=all
11 failures in 879 pushes (0.013 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 6
* autoland: 3
* mozilla-central: 2

Platform breakdown:
* windows7-32-vm: 4
* windows8-64: 3
* linux64-stylo: 3
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-05-08&endday=2017-05-14&tree=all
10 failures in 777 pushes (0.013 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 6
* try: 2
* mozilla-inbound: 2

Platform breakdown:
* linux64-stylo: 5
* windows7-32-vm: 2
* windows8-64: 1
* windows7-32: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-05-15&endday=2017-05-21&tree=all
11 failures in 891 pushes (0.012 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5
* mozilla-inbound: 3
* mozilla-central: 2
* try: 1

Platform breakdown:
* linux64-stylo: 3
* windows8-64: 2
* windows7-32-vm: 2
* linux64: 2
* linux64-stylo-sequential: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-05-22&endday=2017-05-28&tree=all
17 failures in 820 pushes (0.021 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 11
* mozilla-inbound: 4
* try: 1
* mozilla-central: 1

Platform breakdown:
* linux64-stylo: 10
* linux64-stylo-sequential: 3
* windows7-32-vm: 2
* windows7-32: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-05-29&endday=2017-06-04&tree=all
5 failures in 864 pushes (0.006 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 3
* mozilla-inbound: 2

Platform breakdown:
* windows8-64: 4
* linux64-stylo: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-06-05&endday=2017-06-11&tree=all
2 failures in 814 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 2

Platform breakdown:
* windows7-32: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-06-12&endday=2017-06-18&tree=all
6 failures in 892 pushes (0.007 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 3
* autoland: 3

Platform breakdown:
* windows7-32-vm: 3
* windows8-64: 2
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-06-19&endday=2017-06-25&tree=all
2 failures in 718 pushes (0.003 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* windows8-64: 1
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-06-26&endday=2017-07-02&tree=all
3 failures in 656 pushes (0.005 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* windows7-32-vm: 2
* windows8-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-07-03&endday=2017-07-09&tree=all
8 failures in 720 pushes (0.011 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5
* try: 1
* mozilla-inbound: 1
* mozilla-central: 1

Platform breakdown:
* windows7-32: 4
* windows7-32-vm: 2
* linux64-stylo: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-07-10&endday=2017-07-16&tree=all
2 failures in 822 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* linux64-stylo: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-07-17&endday=2017-07-23&tree=all
8 failures in 1008 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 3
* mozilla-central: 3
* autoland: 2

Platform breakdown:
* windows8-64: 3
* windows7-32: 3
* windows7-32-vm: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-07-24&endday=2017-07-30&tree=all
3 failures in 888 pushes (0.003 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1
* mozilla-beta: 1
* autoland: 1

Platform breakdown:
* linux64: 2
* linux64-stylo: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-07-31&endday=2017-08-06&tree=all
5 failures in 901 pushes (0.006 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 3
* try: 1
* mozilla-inbound: 1

Platform breakdown:
* linux64-stylo: 2
* linux64: 1
* linux32-nightly: 1
* android-4-3-armv7-api15: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-08-07&endday=2017-08-13&tree=all
1 failures in 949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-08-14&endday=2017-08-20&tree=all
2 failures in 908 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 2

Platform breakdown:
* linux64-stylo: 1
* linux32-stylo: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-08-21&endday=2017-08-27&tree=all
3 failures in 939 pushes (0.003 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 2
* try: 1

Platform breakdown:
* windows7-32-stylo: 1
* windows7-32: 1
* linux32-stylo: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-08-28&endday=2017-09-03&tree=all
4 failures in 924 pushes (0.004 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-central: 2
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* windows7-32: 3
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-09-04&endday=2017-09-10&tree=all
3 failures in 1032 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1
* mozilla-beta: 1
* autoland: 1

Platform breakdown:
* windows7-32: 2
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-09-11&endday=2017-09-17&tree=all
1 failures in 943 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-09-18&endday=2017-09-24&tree=all
2 failures in 885 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 2

Platform breakdown:
* windows7-32: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-09-25&endday=2017-10-01&tree=all
5 failures in 947 pushes (0.005 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* try: 2

Platform breakdown:
* windows10-64: 2
* windows7-32: 1
* linux64: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-10-09&endday=2017-10-15&tree=all
2 failures in 864 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* windows10-64: 1
* linux64-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-10-16&endday=2017-10-22&tree=all
2 failures in 912 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows7-32: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-10-23&endday=2017-10-29&tree=all
26 failures in 857 pushes (0.03 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 14
* autoland: 8
* mozilla-central: 2
* mozilla-beta: 2

Platform breakdown:
* linux64: 20
* linux32: 3
* windows7-32: 1
* linux64-stylo-disabled: 1
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-10-30&endday=2017-11-05&tree=all
There were 33 failures related to this bug in the last 7 days. This occurs on Linux opt, asan and debug.

Reftest analyzer is not showing relevant data for this. Here's an example of the log:
https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=142446545&lineNumber=9413
Analyzer example:
https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/NOp_4tiZTLm5sldksv3FVw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

:jet can you take a look at this since it spiked in the last few days?
Flags: needinfo?(bugs)
Whiteboard: [stockwell needswork]
This test is already a fuzzy-if within the pixel thresholds reported in this intermittent failure (max difference: 32, number of differing pixels: 33)

fuzzy-if(winWidget||gtkWidget,32,34) fuzzy-if(skiaContent,1,28) 

http://searchfox.org/mozilla-central/source/layout/reftests/bugs/reftest.list#601

I'd normally just add more fuzz, but that won't fix this if the reftest harness is intermittently ignoring the specified fuzz parameters. Mats: can you tell what's going on here? Thx!
Flags: needinfo?(bugs) → needinfo?(mats)

Comment 30

11 months ago
Line 9412 says: "INFO | REFTEST fuzzy test (0, 0) <= (32, 33) <= (1, 28)".
I'm guessing both gtkWidget AND skiaContent are true and we selected the latter fuzzy-if.

I find "azureSkia":true,"skiaContent":true in the log which seems to indicate that's
what happened.
Flags: needinfo?(mats)
(Assignee)

Comment 31

11 months ago
I looked into this intermittent failure a bit.

In my environment(Ubuntu 17.04 + XVFB), I can reproduce this phenomenon with low probability. (about 0.0199. [4/200])
If I move the 2nd condition to primary condition, this test passes always. (Try count is 20000)

(In reply to Mats Palmgren (:mats) from comment #30)
> Line 9412 says: "INFO | REFTEST fuzzy test (0, 0) <= (32, 33) <= (1, 28)".
> I'm guessing both gtkWidget AND skiaContent are true and we selected the
> latter fuzzy-if.
> 
> I find "azureSkia":true,"skiaContent":true in the log which seems to
> indicate that's
> what happened.

A refests use last fuzzy-if condition if we specify multiple condition and these condition is true.[1][2]

[1] https://searchfox.org/mozilla-central/rev/30ead7d1ae5bf95b8bc0fd67b950cd46ca05e32c/layout/tools/reftest/manifest.jsm#202-206
[2] https://searchfox.org/mozilla-central/rev/30ead7d1ae5bf95b8bc0fd67b950cd46ca05e32c/layout/tools/reftest/manifest.jsm#384-387

So I think we should modify fuzzy-if condition order of this test in this bug.

Mats:
This fuzzy-if condition has modified in bug 1179543.
In this test environment(i.e. azureSkia:true and skiaContent:true), I think we can use the gtkWidget condition, Is this correct?
Flags: needinfo?(mats)

Comment 32

10 months ago
Yeah, maybe we should just swap the order, like so:
fuzzy-if(skiaContent,1,28) fuzzy-if(winWidget||gtkWidget,32,34)
Flags: needinfo?(mats)
Comment hidden (mozreview-request)
(Assignee)

Comment 34

10 months ago
(In reply to Mats Palmgren (:mats) from comment #32)
> Yeah, maybe we should just swap the order, like so:
> fuzzy-if(skiaContent,1,28) fuzzy-if(winWidget||gtkWidget,32,34)

Thanks.

Try:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=ed95c7e42c57c8cdfeea795e294473e72f3c7e7d

Assuming a green try run and my environment, I guess this change is effective to this bug.

Comment 35

10 months ago
mozreview-review
Comment on attachment 8927690 [details]
Bug 1354832 - Sort a fuzzy-if condition of bugs/368020-1.html to descending order.

https://reviewboard.mozilla.org/r/198456/#review203988
Attachment #8927690 - Flags: review?(mats) → review+

Comment 36

10 months ago
Pushed by mantaroh@gmail.com:
https://hg.mozilla.org/integration/autoland/rev/fb7f987c1a28
Sort a fuzzy-if condition of bugs/368020-1.html to descending order. r=mats
58 failures in 849 pushes (0.068 failures/push) were associated with this bug in the last 7 days. 

This is the #29 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 20
* mozilla-inbound: 18
* mozilla-central: 9
* try: 5
* pine: 4
* mozilla-beta: 2

Platform breakdown:
* linux64: 38
* linux32: 8
* windows7-32: 4
* linux64-stylo-disabled: 3
* osx-10-10: 2
* linux32-stylo-disabled: 2
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-11-06&endday=2017-11-12&tree=all

Comment 38

10 months ago
bugherder
https://hg.mozilla.org/mozilla-central/rev/fb7f987c1a28
Status: NEW → RESOLVED
Last Resolved: 10 months ago
status-firefox59: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla59
(Assignee)

Updated

10 months ago
Duplicate of this bug: 1413132
Assignee: nobody → mantaroh
status-firefox58: --- → affected

Comment 40

10 months ago
bugherderuplift
https://hg.mozilla.org/releases/mozilla-beta/rev/ac34dc4fa2d4
status-firefox58: affected → fixed
6 failures in 762 pushes (0.008 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 3
* mozilla-inbound: 1
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* linux64: 5
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-11-13&endday=2017-11-19&tree=all
Whiteboard: [stockwell needswork] → [stockwell unknown]
1 failures in 792 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* windows7-32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354832&startday=2017-11-27&endday=2017-12-03&tree=all
You need to log in before you can comment on or make changes to this bug.