Make B2G marionette-webapi a tier 1 testsuite (failure rate closer to 10% than 70%)

RESOLVED WONTFIX

Status

Testing
Marionette
RESOLVED WONTFIX
4 years ago
2 years ago

People

(Reporter: emorley, Unassigned)

Tracking

Trunk
ARM
Gonk (Firefox OS)
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

4 years ago
Collecting together the issues contributing to the 70%+ failure rate we're seeing at the moment.
(Reporter)

Updated

4 years ago
Depends on: 823067, 820802, 814551
(Reporter)

Updated

4 years ago
Summary: Make B2G marionette-webapi a tier 1 testsuite → Make B2G marionette-webapi a tier 1 testsuite (failure rate < 10%)
(Reporter)

Updated

4 years ago
Depends on: 821966, 802877, 821958
(Reporter)

Updated

4 years ago
Depends on: 823082
(Reporter)

Updated

4 years ago
Depends on: 823084
(Reporter)

Updated

4 years ago
Depends on: 823086
(Reporter)

Updated

4 years ago
Summary: Make B2G marionette-webapi a tier 1 testsuite (failure rate < 10%) → Make B2G marionette-webapi a tier 1 testsuite (failure rate closer to 10% than 70%)
(Reporter)

Updated

4 years ago
Depends on: 813292
(Reporter)

Updated

4 years ago
Depends on: 813305
(Reporter)

Updated

4 years ago
Depends on: 823090

Updated

4 years ago
Depends on: 813978
I'd like to point out that the 70% fail rate is only on m-c and aurora based branches. The mozilla-b2g18 branch is pretty stable green from what I can see.
(Reporter)

Updated

4 years ago
Depends on: 824045
(Reporter)

Updated

4 years ago
Depends on: 824048
(Reporter)

Updated

4 years ago
Depends on: 824059
(Reporter)

Updated

4 years ago
Depends on: 824075
(Reporter)

Updated

4 years ago
Depends on: 824079
(Reporter)

Updated

4 years ago
Depends on: 820739
(Reporter)

Updated

4 years ago
Depends on: 822274
(Reporter)

Updated

4 years ago
Depends on: 822277
(Reporter)

Updated

4 years ago
Depends on: 822278
(Reporter)

Updated

4 years ago
Depends on: 826182
(Reporter)

Updated

4 years ago
Depends on: 817352
(Reporter)

Updated

4 years ago
Depends on: 828208
(Reporter)

Updated

4 years ago
Depends on: 829546
(Reporter)

Updated

4 years ago
Depends on: 830632
(Reporter)

Updated

4 years ago
Depends on: 830635
(Reporter)

Updated

4 years ago
Depends on: 830636
(Reporter)

Updated

4 years ago
Depends on: 830929
No longer depends on: 821958
No longer depends on: 821966
No longer depends on: 822274
No longer depends on: 822277
I'm removing dependencies for disabled tests which cause them not to impact TBPL/sheriffing any longer
No longer depends on: 822278
Depends on: 832661
Depends on: 835183
Depends on: 835185
Depends on: 835186
Depends on: 821963
Depends on: 835540
Nearly all the webapi issues are likely the same problem, which can be summed up as:  random tests fail after running the telephony tests.

In bug 831830 I re-ordered the tests, so that Marionette unit tests are run before the webapi tests.  Since this, there have been no failures in non-webapi tests.  I will be closing several related bugs.

I plan to file another bug to reorder to the webapi tests themselves, to see if we can get rid of some of the other intermittent failures.
Depends on: 842274
Depends on: 842297
Depends on: 842543
Depends on: 843262
(Reporter)

Updated

4 years ago
Depends on: 843998
(Reporter)

Updated

4 years ago
Depends on: 843996
No longer depends on: 843998
(Reporter)

Updated

4 years ago
Depends on: 838047
Depends on: 837137
Blocks: 846091
Depends on: 845291
Depends on: 845625
Depends on: 847102
Depends on: 847726
Depends on: 848933
Depends on: 849904
Depends on: 850182
Depends on: 851658
Depends on: 851666
Depends on: 852709
Depends on: 855265
Depends on: 855266
Depends on: 855458
No longer depends on: 847102
Blocks: 859417
WebAPI Tests are no longer run so am closing these as wontfix
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.