1563766 - Update android x86_64 emulator to r29.0.11, for web-platform tests

Status: RESOLVED FIXED

(Firefox for Android Graveyard :: Testing, task, P2)

Description

[Geoff Brown [:gbrown] (pto Apr 11-18)]

In bug 1556058, the x86_64 emulator used in CI for most test suites has been updated to version 29.0.11, providing significant benefits for mochitest-plain and reftest-plain especially. web-platform tests have not yet been switched over to the new emulator:

https://searchfox.org/mozilla-central/rev/040aa667f419932adf425d92c7438f03230ad96b/taskcluster/ci/test/web-platform.yml#30

but I think it should be possible, and should provide significant benefits for wpt-reftests.

Comment 1

[Geoff Brown [:gbrown] (pto Apr 11-18)]

In try pushes, there are many UNEXPECTED-PASS results, especially in reftests. Correcting for those, there are some new failures, which I haven't sorted through yet:

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=f1dacc2ff315d608106d6b8de23c87d63f0494be

Comment 2

[Geoff Brown [:gbrown] (pto Apr 11-18)]

Attachment: Bug 1563766 - Switch geckoview wpt to emulator 29.0.11; r=

Comment 3

[Geoff Brown [:gbrown] (pto Apr 11-18)]

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=b0381a4fef9edcadd880a72b9b22f8be21a9a6cf

Comment 4

[Geoff Brown [:gbrown] (pto Apr 11-18)]

:maja_zf - Does this look promising? Any concerns? If you have the time/interest, please steal my patch and finish this off while I am away.

Comment 5

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

Thanks, Geoff. Looks promising!

Fresh try push: https://treeherder.mozilla.org/#/jobs?repo=try&revision=ebdd6cf6caba154bc523aa85d311c804b5115231
I'll run wpt-update against its logs and post an update.

Comment 6

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

Now with new metadata: https://treeherder.mozilla.org/#/jobs?repo=try&revision=a4e9fb073e67aecd2eaf7fb776f9e039653aea48

Comment 7

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

Attachment: Bug 1563766 - Update android x86_64 emulator to r29.0.11, for web-platform tests

Comment 8

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

Couple more metadata updates: https://treeherder.mozilla.org/#/jobs?repo=try&revision=f39e35193150e7d91f5f7d608dd69edd05ef82f2

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/da2099e189b0
Switch geckoview wpt to emulator 29.0.11; r=gbrown

Comment 10

[Daniel Varga [:dvarga]]

https://hg.mozilla.org/mozilla-central/rev/da2099e189b0