1356144 - stylo: Intermittent TEST-UNEXPECTED-PASS | css-import/445415-1a.xhtml == css-import/445415-1a.xhtml | image comparison

Status: RESOLVED FIXED

Description

[Treeherder Bug Filer]

Filed by: cbook [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=91100662&repo=mozilla-central

https://queue.taskcluster.net/v1/task/G56PGKn3QuSqp9xFiYRpJA/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/G56PGKn3QuSqp9xFiYRpJA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

Comment 1

[Intermittent Failures Robot]

7 failures in 894 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 3
* autoland: 3
* mozilla-central: 1

Platform breakdown:
* linux64-stylo: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1356144&startday=2017-04-10&endday=2017-04-16&tree=all

Comment 2

[Intermittent Failures Robot]

11 failures in 817 pushes (0.013 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 9
* mozilla-inbound: 2

Platform breakdown:
* linux64-stylo: 11

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1356144&startday=2017-04-17&endday=2017-04-23&tree=all

Comment 3

[Intermittent Failures Robot]

7 failures in 883 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* autoland: 3

Platform breakdown:
* linux64-stylo: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1356144&startday=2017-04-24&endday=2017-04-30&tree=all

Comment 4

[Intermittent Failures Robot]

5 failures in 891 pushes (0.006 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5

Platform breakdown:
* linux64-stylo: 4
* linux64-stylo-sequential: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1356144&startday=2017-05-22&endday=2017-05-28&tree=all

Comment 5

[Intermittent Failures Robot]

20 failures in 167 pushes (0.12 failures/push) were associated with this bug yesterday.   

Repository breakdown:
* autoland: 11
* mozilla-inbound: 7
* mozilla-central: 2

Platform breakdown:
* linux64-stylo: 20

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1356144&startday=2017-05-30&endday=2017-05-30&tree=all

Comment 6

[Intermittent Failures Robot]

22 failures in 184 pushes (0.12 failures/push) were associated with this bug yesterday.   

Repository breakdown:
* mozilla-inbound: 12
* autoland: 7
* mozilla-central: 3

Platform breakdown:
* linux64-stylo: 19
* linux64-stylo-sequential: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1356144&startday=2017-05-31&endday=2017-05-31&tree=all

Comment 7

[Joel Maher ( :jmaher ) (UTC-4)]

:bholley, this is a stylo intermittent error, the rate has increased quite a bit- is there someone to look at this?  possibly disable this specific test?  maybe ask :jet to look at this?

Comment 8

[Bobby Holley (:bholley)]

(In reply to Joel Maher ( :jmaher) from comment #7)
> :bholley, this is a stylo intermittent error, the rate has increased quite a
> bit- is there someone to look at this?  possibly disable this specific test?
> maybe ask :jet to look at this?

Given that it's mostly failing (and just an occasional unexpected-pass), marking this test as random for stylo is fine for now.

Comment 9

[Joel Maher ( :jmaher ) (UTC-4)]

Created attachment 8873908 [details] [diff] [review]
random-if test case

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/d4f850a4aa29
stylo: Intermittent css-import/445415-1a.xhtml - mark as random-if. r=gbrown

Comment 11

[Wes Kocher (:KWierso)]

https://hg.mozilla.org/mozilla-central/rev/d4f850a4aa29

Comment 12

[Intermittent Failures Robot]

68 failures in 820 pushes (0.083 failures/push) were associated with this bug in the last 7 days. 

This is the #16 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 34
* mozilla-inbound: 25
* mozilla-central: 9

Platform breakdown:
* linux64-stylo: 64
* linux64-stylo-sequential: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1356144&startday=2017-05-29&endday=2017-06-04&tree=all