1160183 - test android 4.3 debug mochitests on c3.xlarge

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Kim Moir [:kmoir] ET]

To support work in bug 1154804

I have my master setup and slave loaned to do this.

Comment 1

[Kim Moir [:kmoir] ET]

running tests now, staging env was hosed for a bit due to too many builders issue from bug 1156425

Comment 2

[Geoff Brown [:gbrown]]

Thanks Kim. There are still some failures that are not related to timing. If you want to eliminate those, the build and/or patches in https://treeherder.mozilla.org/#/jobs?repo=try&revision=9020ea08061b&exclusion_profile=false may be useful.

Comment 3

[Kim Moir [:kmoir] ET]

Here are the results on c3-xlarge so far.  There are still a few left to run. 

http://dev-master2.bb.releng.use1.mozilla.com:8036/one_line_per_build?numbuilds=40

I didn't use the patches in comment #2 before I started them

Comment 4

[Kim Moir [:kmoir] ET]

Attachment: bug1160183.patch

Comment 5

[Kim Moir [:kmoir] ET]

Attachment: bug1160183.patch

patch to enable on try with c3.xlarge for debug mochitests on try

Comment 6

[Kim Moir [:kmoir] ET]

Sorry my master was not showing the completed jobs because I reconfiged for another patch.  It looks like the only failures were m-4, m-16 and all the gl tests

Comment 7

[Geoff Brown [:gbrown]]

I have been having a terrible time trying to eliminate frequent failures from m-1, m-9,and m-10, so that's great news for plain mochitests. gl test failures are puzzling -- those have been running green for me! (But I can't see your results -- cannot access dev-master2.bb.releng.use1.mozilla.com.)

Comment 8

[Kim Moir [:kmoir] ET]

:gbrown you have to be connected to the releng vpn to see the master.  If you don't have access, I will attach logs

Comment 9

[Kim Moir [:kmoir] ET]

Attachment: bug1160183.patch

Comment 10

[Kim Moir [:kmoir] ET]

Attachment: bug1160183wp.patch

Comment 11

[Kim Moir [:kmoir] ET]

Comment on attachment 8602293 [details] [diff] [review]
bug1160183.patch

patch to run Android 4.3 mochitest debug on c3.xlarge to avoid timeouts

Comment 12

[Rail Aliiev [:rail]]

Comment on attachment 8602294 [details] [diff] [review]
bug1160183wp.patch

Review of attachment 8602294 [details] [diff] [review]:
-----------------------------------------------------------------

::: configs/watch_pending.cfg
@@ +28,4 @@
>          "^Android 2.3( Armv6)? Emulator.*(?:plain-reftest|crashtest|jsreftest)": "tst-emulator64",
>          "^Android armv7 API 9.*test (?:(?!plain-reftest|crashtest|jsreftest).)*$": "tst-linux64",
>          "^Android armv7 API 9.*test .*(?:plain-reftest|crashtest|jsreftest)": "tst-emulator64",
> +        "^Android 4.3 armv7 API 11+.*debug test .*(?:mochitest-\d).*": "tst-emulator64", 

I think you need to escape "+" here as it's done below and add "+" after "\\d", something like

"^Android 4.3 armv7 API 11\\+.*debug test .*(?:mochitest-\\d+).*": "tst-emulator64",

Comment 13

[Rail Aliiev [:rail]]

Comment on attachment 8602293 [details] [diff] [review]
bug1160183.patch

Review of attachment 8602293 [details] [diff] [review]:
-----------------------------------------------------------------

LGTM. Can you remove trailing spaces when you land?

Comment 14

[Geoff Brown [:gbrown]]

(In reply to Geoff Brown [:gbrown] from comment #7)
>  gl test failures are puzzling -- those have been running green for me! 

Sorry, not puzzling at all. You need the patch in bug 1140459 for green mochitest-gl on debug.

Comment 15

[Kim Moir [:kmoir] ET]

Attachment: bug1160183wp-2.patch

Comment 16

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/da645ef7dcd9

Comment 17

[Kim Moir [:kmoir] ET]

verified on treeherder