Unhide native Android mochitest-1 once its failure rate <20%

RESOLVED FIXED

Status

defect
RESOLVED FIXED
7 years ago
10 months ago

People

(Reporter: emorley, Assigned: emorley)

Tracking

(Depends on 1 bug)

Trunk
ARM
Android
Dependency tree / graph

Details

(Assignee)

Description

7 years ago
Bug 777436 hid a number of test suites on Android that had a >30% failure rate (figures included all method of failure apart from blue retries). To unhide each suite, I would really like the failure rate to be <20%, given that even 30% was a bit excessive.

Rates from bug 777436 comment 3:

> Native:
> * mochitest-1          38%
> * mochitest-3          39%
> * reftest-2            51%
> * reftest-3            53%
> * robocop              57%
> * remote-trobocheck    36%
> * remote-trobocheck3   41%
> * remote-trobopan      39%
> * remote-ts            52%
> 
> XUL:
> * jsreftest-1          24%
> * jsreftest-2          22%

Which after some test disabling in bug 775227, lowered to:

> Native:
> * mochitest-1: 21 failing, 81 total (26%)
> * mochitest-3: 76 failing, 78 total (97%)
> * robocop    : 39 failing, 81 total (48%)

We'll need to unhide on:
 * mozilla-central
 * mozilla-inbound
 * fx-team
 * services-central
 * try
(Assignee)

Updated

7 years ago
Depends on: 775227
(Assignee)

Comment 1

7 years ago
Post reboot fixes, current stats are:

5 failing, 29 total (17%)

-> Unhiding on all trees.
(Assignee)

Updated

7 years ago
Status: NEW → RESOLVED
Last Resolved: 7 years ago
Resolution: --- → FIXED
(Assignee)

Updated

7 years ago
Assignee: nobody → bmo
Product: Webtools → Tree Management
(Assignee)

Updated

5 years ago
Component: TBPL → Visibility Requests

Updated

10 months ago
Product: Tree Management → Tree Management Graveyard
You need to log in before you can comment on or make changes to this bug.