809233 - Get B2G xpcshell tests running on cedar

Status: RESOLVED FIXED

(Testing :: XPCShell Harness, defect, P1)

Description

[Andrew Halberstadt [:ahal]]

Now that mochitests and reftests are running, we're at the point where we want to get xpcshell tests running on cedar so we can get them checked in to mozilla central.

Comment 1

[Andrew Halberstadt [:ahal]]

So we'll need to update mozharness to run xpcshell tests and then enable it on B2G. However we aren't even at the stage where the harness is ready to run on B2G at all. This bug will track the progress towards that point.

Comment 2

[Geoff Brown [:gbrown]]

I have been working on xpcshell-for-android lately; some of those changes might help xpcshell-for-b2g -- see bug 768491 and its dependents.

Comment 3

[Andrew Halberstadt [:ahal]]

This is live on cedar now, but there are two issues that I didn't see when testing locally we'll have to fix.

1) busybox unzip is failing for some reason (bug 818152)
2) it looks like the full set of tests is being run instead of the xpcshell_b2g.ini one
2b) a side effect is that one of the tests that ends up being run times out and the job gets killed

I need to spend a bit of time debugging.

Comment 4

[Andrew Halberstadt [:ahal]]

Issue 2 was trivial: https://hg.mozilla.org/build/mozharness/rev/df25d154ddc6

Comment 5

[Andrew Halberstadt [:ahal]]

Issue 1 is due to using something new in python 2.7 (the talos-r3-fed-xxx slaves have something older). Should be fixed soon.

Comment 6

[Andrew Halberstadt [:ahal]]

Quick update: this is potentially ready to resolve now. Unfortunately wait times on cedar are taking almost an entire work day, so it's been a very slow triaging process. All that should be left though is to figure out if there are any other intermittent oranges, disable them on m-c, fix bug 819399 (trivial) and hand it off to releng to create/enable the proper configs.

Comment 7

[Aki Sasaki (not active)]

Attachment: xpcshell exit code 1 -> INFO

Heads up: my patch in bug 807125 enables emulator xpcshell on all branches through b2g18, so we'll need to either hide it or uplift your fixes.

Let me know if we should limit that list for some reason.

Comment 8

[Andrew Halberstadt [:ahal]]

Comment on attachment 691139 [details] [diff] [review]
xpcshell exit code 1 -> INFO

Review of attachment 691139 [details] [diff] [review]:
-----------------------------------------------------------------

Lgtm. Not sure what you mean by 'limit that list'. Are you talking about the manifest?

Comment 9

[Andrew Halberstadt [:ahal]]

https://hg.mozilla.org/build/mozharness/rev/09fe3cc6ad07

These are running green on cedar and are now ready to go on central, aurora and b2g18

Comment 10

[Aki Sasaki (not active)]

(In reply to Andrew Halberstadt [:ahal] from comment #8)
> Comment on attachment 691139 [details] [diff] [review]
> xpcshell exit code 1 -> INFO
> 
> Review of attachment 691139 [details] [diff] [review]:
> -----------------------------------------------------------------
> 
> Lgtm. Not sure what you mean by 'limit that list'. Are you talking about the
> manifest?

Limit the branches list.
This is where it will run currently: http://hg.mozilla.org/build/buildbot-configs/file/62d4e2db43e4/mozilla-tests/b2g_config.py#l17

Comment 11

[Ed Morley [:emorley]]

B2G xpcshell is burning on all trees apart from cedar.
Hidden on:
mozilla-aurora
mozilla-b2g18
mozilla-central
mozilla-inbound
try

Once they've built it once (TBPL limitation means I cannot do so before), will need to also hide on:
ash
fx-team
services-central

Comment 12

[Ed Morley [:emorley]]

I've filed bug 821249 for unhiding these once various cedar patches landed elsewhere & the runs are green.