1110839 - Schedule Gip on Mulet builds

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[Zac C (:zac)]

Now that mulet builds are running on various branches, the Python UI tests could be scheduled to run on them.

With the exception of the SMS tests which still fail, the tests are mostly green.

The runner will need to be updated to pass:
--app-arg="-chrome" --app-arg="chrome://b2g/content/shell.html"

in with cli.py.

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Jonathan: Do you know what is required to get these running on buildbot? I'd be happy to provide a patch if I could get some assistance.

Comment 2

[Jonathan Griffin (:jgriffin)]

Are these working well for you locally?  If so, let me know what the command-line is, and I can schedule them on cedar (first) so we can green them up, then everywhere once they're green.

Comment 3

[Alexandre Poirot [:ochameau]]

I think they are used to work with just `--app-arg="-chrome" --app-arg="chrome://b2g/content/shell.html"`
arguments.
Alex, could you confirm?

Comment 4

[:gerard-majax]

Yes, that's how I used to run them.

Comment 5

[:gerard-majax]

I can't confirm right now, I'm in the train, but I definitively have been able to run them when I fixed the Gij issues related to the non local network connections. So it should run mostly out of the box.

Comment 6

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I just downloaded the latest nightly Mulet build and successfully ran one of the tests using the following command:

$ gaiatest --binary=/Applications/MuletNightly.app/Contents/MacOS/firefox-bin --profile=/Users/dhunt/workspace/gaia/profile/ --app-arg=-chrome --app-arg=chrome://b2g/content/shell.html --testvars=home.json gaiatest/tests/functional/clock/test_clock_set_alarm.py

Comment 7

[Jonathan Griffin (:jgriffin)]

Thanks, I'll write a scheduling patch.

Comment 8

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Jonathan: Has this been done?

Comment 9

[Geo Mealer [:geo] -- This account is inactive after 2015-07-07]

Per bug 1139029, looks like we've turned Gip off on B2G Desktop OS X (as well as everything else). As Dave mentioned in bug 1139006#c6, any decisions there should probably happen on Mulet's setup as well.

Comment 10

[Geo Mealer [:geo] -- This account is inactive after 2015-07-07]

Gah, amending my comment 9, "turned Gip off (as well as everything else) on B2G Desktop OS X". We're still running on Linux 64.

Comment 11

[Jonathan Griffin (:jgriffin)]

Attachment: Schedule GIP on linux64 mulet on cedar,

Sorry Dave, this slipped through the cracks.

Comment 12

[Jordan Lund (:jlund)]

Comment on attachment 8572738 [details] [diff] [review]
Schedule GIP on linux64 mulet on cedar,

Review of attachment 8572738 [details] [diff] [review]:
-----------------------------------------------------------------

should do the trick :)

Comment 13

[Jonathan Griffin (:jgriffin)]

Comment on attachment 8572738 [details] [diff] [review]
Schedule GIP on linux64 mulet on cedar,

https://hg.mozilla.org/build/buildbot-configs/rev/7f395f01ccd4

Comment 14

[Chris Cooper [:coop] (he/him)]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/7f395f01ccd4

Comment 15

[Jonathan Griffin (:jgriffin)]

Attachment: Override the application option,

This is needed because we're using a config that has application='b2g'.  The other option would be to clone the config file and change it in the copy.

Comment 16

[Jordan Lund (:jlund)]

Comment on attachment 8577028 [details] [diff] [review]
Override the application option,

Review of attachment 8577028 [details] [diff] [review]:
-----------------------------------------------------------------

alternatively, if we suspect there was going to be more differences, we could add another mh config and do:
--cfg', 'marionette/gaia_ui_test_prod_config.py', --cfg', 'marionette/gaia_ui_test_functional.py'

mh config hierarchy will give precedence to the last mentioned config file.

this patch makes sense to me if it's a single item difference.

Comment 17

[Jonathan Griffin (:jgriffin)]

This patch is now obsolete; all of mulet-related jobs are being handled in TaskCluster.  I'm not sure how to schedule things there, but I assume there are docs somewhere.  Flagging catlee for more info.

Comment 18

[Alexandre Poirot [:ochameau]]

I've been able to run them manually on taskcluster by patching something in mozharness (I don't remember what, I think it was something about the binary name being firefox-bin instead of b2g-bin.)
See bug 1030679 comment 7. The taskcluster yml file was enough to run Gip with the small mozharness tweak!

Comment 19

[Jonathan Griffin (:jgriffin)]

Looks like all the necessary changes are to files in the testing/taskcluster dir.

Comment 20

[:gerard-majax]

Gip is being killed.