1525959 - Green up mochitest under GeckoView

Status: RESOLVED FIXED

(GeckoView :: General, enhancement, P1)

Description

[James Willcox (:snorp) ([e-mail]) (he/him)]

There are a handful of failing tests remaining, we should just skip these in order to get things running.

Comment 1

[James Willcox (:snorp) ([e-mail]) (he/him)]

Attachment: Bug 1525959 - Run GeckoView mochitests on x86_64 emulators in automation r=gbrown

Comment 2

[James Willcox (:snorp) ([e-mail]) (he/him)]

Attachment: Bug 1525959 - Skip some mochitests tests under GeckoView r?#geckoview-reviewers

There are few things that are either Fennec-specific or don't work
currently under GeckoView w/ e10s under TestRunnerActivity. Disable
these so we can get some testing going in automation.

Depends on D19015

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/33ea61c54aea
Run GeckoView mochitests on x86_64 emulators in automation r=gbrown
https://hg.mozilla.org/integration/autoland/rev/503cbc86e442
Skip some mochitests tests under GeckoView r=geckoview-reviewers,esawin

Comment 4

[Andreea Pavel [:apavel]]

Backed out for high frequency android failures

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&revision=503cbc86e44214d78506cac5b303deaee6587432&selectedJob=227991864

Failure logs:

Tier1: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=227991864&repo=autoland&lineNumber=2266

Tier2: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=227957054&repo=autoland&lineNumber=2049
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=227969079&repo=autoland&lineNumber=3451
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=227976902&repo=autoland&lineNumber=1858

Backout: https://hg.mozilla.org/integration/autoland/rev/34f33ae5913ef665fb56884e32ed75a7d4d5e680

Comment 5

[Geoff Brown [:gbrown]]

The tier 1 failures were crashtests? Those should be unrelated to this bug and were resolved by backout of bug 1522324.

We expect frequent tier 2 failures. Is it OK to re-land with tier 2 failures?

Comment 6

[James Willcox (:snorp) ([e-mail]) (he/him)]

(In reply to Geoff Brown [:gbrown] from comment #5)

The tier 1 failures were crashtests? Those should be unrelated to this bug and were resolved by backout of bug 1522324.

We expect frequent tier 2 failures. Is it OK to re-land with tier 2 failures?

Ah, I wasn't sure what was going on with the crashtest -- there were permafails on debug mochitest, though, which I'm working on now.

Comment 7

[Andreea Pavel [:apavel]]

(In reply to Geoff Brown [:gbrown] (away Feb 18, 19) from comment #5)

The tier 1 failures were crashtests? Those should be unrelated to this bug and were resolved by backout of bug 1522324.

We expect frequent tier 2 failures. Is it OK to re-land with tier 2 failures?

Sorry for the lat reply, I've been on PTO. No, tier1 were opt-mochitest-24 failures.

Also, normally for tier2 we don't backout unless they are very frequent (every push) and the developer does not reply.

This should give a better view.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/51efc5e08cee
Run GeckoView mochitests on x86_64 emulators in automation r=gbrown
https://hg.mozilla.org/integration/autoland/rev/75e35acd4f0d
Skip some mochitests tests under GeckoView r=geckoview-reviewers,esawin

Comment 9

[Geoff Brown [:gbrown]]

Oops - https://hg.mozilla.org/integration/autoland/rev/51efc5e08ceeeacb157cfb36a1bc827cbf9a7c8b#l1.15 set only the opt tests as tier 2. /debug is running and failing as tier 1! I think this would be correct:

android-em-7.*: 2

Comment 10

[James Willcox (:snorp) ([e-mail]) (he/him)]

Attachment: Bug 1525959 - Only run mochitest-e10s on GeckoView opt builds r=gbrown

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e767399d23cc
Only run mochitest-e10s on GeckoView opt builds r=gbrown

Comment 12

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/51efc5e08cee
https://hg.mozilla.org/mozilla-central/rev/75e35acd4f0d
https://hg.mozilla.org/mozilla-central/rev/e767399d23cc

Comment 13

[Hiroyuki Ikezoe (:hiro)]

:snorp, where are bugs to re-enable the disabled tests? I just noticed dom/animation/test/mozilla/test_restyles.html was disabled and filed a new bug for that (bug 1583658), if there is already a bug, please duplicate it.

Thank you!

Comment 14

[James Willcox (:snorp) ([e-mail]) (he/him)]

There are a few things scattered around. AFAIK there isn't any single bug that rounds all of that up.