Closed Bug 823076 Opened 12 years ago Closed 9 years ago

Make B2G marionette-webapi a tier 1 testsuite (failure rate closer to 10% than 70%)

Categories

(Remote Protocol :: Marionette, defect)

Product:
Remote Protocol
Component:
Marionette
Platform:
ARM
Gonk (Firefox OS)
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: emorley, Unassigned)

References

Details

Collecting together the issues contributing to the 70%+ failure rate we're seeing at the moment.
Depends on: 823067, 820802, 814551
Summary: Make B2G marionette-webapi a tier 1 testsuite → Make B2G marionette-webapi a tier 1 testsuite (failure rate < 10%)
Depends on: 821966, 802877, 821958
Depends on: 823082
Depends on: 823084
Depends on: 823086
Summary: Make B2G marionette-webapi a tier 1 testsuite (failure rate < 10%) → Make B2G marionette-webapi a tier 1 testsuite (failure rate closer to 10% than 70%)
Depends on: 813292
Depends on: 813305
Depends on: 823090
Depends on: 813978
I'd like to point out that the 70% fail rate is only on m-c and aurora based branches. The mozilla-b2g18 branch is pretty stable green from what I can see.
Depends on: 824045
Depends on: 824048
Depends on: 824059
Depends on: 824075
Depends on: 824079
Depends on: 820739
Depends on: 822274
Depends on: 822277
Depends on: 822278
Depends on: 826182
Depends on: 817352
Depends on: 828208
Depends on: 829546
Depends on: 830632
Depends on: 830635
Depends on: 830636
Depends on: 830929
No longer depends on: 821958
No longer depends on: 821966
No longer depends on: 822274
No longer depends on: 822277
I'm removing dependencies for disabled tests which cause them not to impact TBPL/sheriffing any longer
No longer depends on: 822278
Depends on: 832661
Depends on: 835183
Depends on: 835185
Depends on: 835186
Depends on: 821963
Depends on: 835540
Nearly all the webapi issues are likely the same problem, which can be summed up as: random tests fail after running the telephony tests. In bug 831830 I re-ordered the tests, so that Marionette unit tests are run before the webapi tests. Since this, there have been no failures in non-webapi tests. I will be closing several related bugs. I plan to file another bug to reorder to the webapi tests themselves, to see if we can get rid of some of the other intermittent failures.
Depends on: 842274
Depends on: 842297
Depends on: 842543
Depends on: 843262
Depends on: 843998
Depends on: 843996
No longer depends on: 843998
Depends on: b2g-marionette
Depends on: 837137
Depends on: 847102
Depends on: 847726
Depends on: 848933
Depends on: 849904
Depends on: 850182
Depends on: 851658
Depends on: 851666
Depends on: 852709
Depends on: 855265
Depends on: 855266
Depends on: 855458
No longer depends on: 847102
WebAPI Tests are no longer run so am closing these as wontfix
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WONTFIX
Product: Testing → Remote Protocol
You need to log in before you can comment on or make changes to this bug.