1385186 - Intermittent accessible/tests/mochitest/events/test_focus_tabbox.xul | assertion count 1 is more than expected 0 assertions

Status: RESOLVED FIXED

(Core :: Graphics: WebRender, defect, P1)

Description

[Treeherder Bug Filer]

Filed by: cbook [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=118728033&repo=mozilla-central

https://queue.taskcluster.net/v1/task/KQQsN0rDSamXcEblj9SzHQ/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

2 failures in 1008 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 2

Platform breakdown:
* linux64-qr: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-07-24&endday=2017-07-30&tree=all

Comment 2

[Intermittent Failures Robot]

2 failures in 888 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 2

Platform breakdown:
* linux64-qr: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-07-31&endday=2017-08-06&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 1

Platform breakdown:
* linux64-qr: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 4

[Intermittent Failures Robot]

5 failures in 885 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 4
* try: 1

Platform breakdown:
* linux64-qr: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-09-25&endday=2017-10-01&tree=all

Comment 5

[Intermittent Failures Robot]

6 failures in 824 pushes (0.007 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 5
* mozilla-central: 1

Platform breakdown:
* linux64-qr: 6

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 6

[Intermittent Failures Robot]

11 failures in 947 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 6
* mozilla-central: 5

Platform breakdown:
* linux64-qr: 11

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-10-09&endday=2017-10-15&tree=all

Comment 7

[Intermittent Failures Robot]

30 failures in 864 pushes (0.035 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* try: 16
* mozilla-central: 14

Platform breakdown:
* linux64-qr: 30

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-10-16&endday=2017-10-22&tree=all

Comment 8

[Intermittent Failures Robot]

31 failures in 912 pushes (0.034 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 18
* try: 13

Platform breakdown:
* linux64-qr: 29
* linux64-stylo-disabled: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 9

[Kartikaya Gupta (email:[e-mail])]

The two linux64-stylo-disabled instances of this are both misclassifications. So technically this only happened (at most) 29 times last week, just under the 30 times/week threshold.

Comment 10

[Phil Ringnalda (:philor)]

Around a 30% failure rate, but it only runs on mozilla-central and try, and the priority depends on the raw number of failures, not the frequency?

Challenge accepted.

Comment 11

[Intermittent Failures Robot]

42 failures in 171 pushes (0.246 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-central: 42

Platform breakdown:
* linux64-qr: 42

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-10-30&endday=2017-10-30&tree=all

Comment 12

[Joel Maher ( :jmaher ) (UTC -8)]

I think the 42 failures yesterday are related to retriggers:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=515407ebfa1433c31144374313bbfd8b942af41c&filter-searchStr=qr%20a11y

this does help show the 30% failure rate- which is very high- if this were running on inbound/autoland it would be disabled- and 30% failure rate is much higher than 5% visibility for tier-1.

I think post 57 this will be tackled- i.e. I expect in 2 weeks to see a lot of intermittent bugs to get worked on!

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/8db0f7e54aee
Disable high-frequency intermittent failure in linux64-qr a11y mochitests. r=me

Comment 14

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/8db0f7e54aee

Comment 15

[Intermittent Failures Robot]

50 failures in 857 pushes (0.058 failures/push) were associated with this bug in the last 7 days. 

This is the #34 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 45
* try: 5

Platform breakdown:
* linux64-qr: 50

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1385186&startday=2017-10-30&endday=2017-11-05&tree=all