1120508 - Un-hide Gaia JS Integration tests when they meet visibility standards

Status: RESOLVED FIXED

(Tree Management Graveyard :: Visibility Requests, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

The issues are well known, but it's getting out of hand again. They are nowhere near the 5% threshold for visibility at this point.

Comment 1

[Dale Harvey (:daleharvey)]

Doing a large set of runs @ https://treeherder.mozilla.org/ui/#/jobs?repo=gaia-try&revision=debafd9bb147, each Gij is run 20 times so at absolute most we are aiming for one failure of each type

Comment 2

[Dale Harvey (:daleharvey)]

wow great start, all 4 suites are on perma fail

Comment 3

[Kevin Grandon :kgrandon]

Marking a dependency on bug 1091680, which tracks most of the intermittent issues.

Comment 4

[Dale Harvey (:daleharvey)]

Take 2 @ https://treeherder.mozilla.org/ui/#/jobs?repo=gaia-try&revision=85dea3e0c3d6, the previous perma fail should be fixed

Comment 5

[Dale Harvey (:daleharvey)]

Filed a new bug for a common file-manager issue I am seeing in https://treeherder.mozilla.org/ui/#/jobs?repo=gaia-try&revision=85dea3e0c3d6

Comment 6

[Kevin Grandon :kgrandon]

Currently trying a large try run which should determine if we can unhide these tests: https://treeherder.mozilla.org/#/jobs?repo=b2g-inbound&revision=0934aa7c1a5b&exclusion_state=all

Comment 7

[Kevin Grandon :kgrandon]

Hmm, seems that was bad timing as we must've been suffering from git infra problems (or maybe the fact that I triggered several hundred jobs at once did it).

Going to re-trigger a bunch of jobs on a recent build, but take things a little more slowly: https://treeherder.mozilla.org/#/jobs?repo=b2g-inbound&revision=22e17cdfd47a&exclusion_state=all

Comment 8

[Kevin Grandon :kgrandon]

Link to view only Gij tests: https://treeherder.mozilla.org/#/jobs?repo=b2g-inbound&revision=22e17cdfd47a&exclusion_state=all&filter-searchStr=b2g_ubuntu64_vm%20b2g-inbound%20opt%20test%20gaia-js-integration

Comment 9

[Kevin Grandon :kgrandon]

Ryan - Please see the link in comment 8. With only 1 failure out of ~100 runs I think I'd like to go ahead and request that we get this un-hidden. (If desired we can disable that test as well).

Please let us know if there's anything else that needs to be done before un-hiding these.

Comment 10

[Ryan VanderMeulen [:RyanVM]]

Unhidden across all trunk trees.