608784 - update maemkit to only run with a known set of directories

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: set of directories to run on fennec for green mochitests (1.0)

in order to get some mochitests up and running we should have the option to run a set of known tests that are green.  Eventually this set of tests will be everything, but for now it is a subset.

Comment 1

[John Ford [:jhford] CET/CEST Berlin Time]

Comment on attachment 487367 [details] [diff] [review]
set of directories to run on fennec for green mochitests (1.0)

Looks good.  I don't know all the details of how maemkit works internally though.  Lets put this on staging and see how it goes!

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: maemkit.tar to be used in a staging run

this .tar has fresh maemkit + the patch on this bug as well as the patch on bug 611007.  If we could run:
python maemkit-chunked.py --testtype=mochitest
python maemkit-chunked.py --testtype=crashtests

that should exercise this well enough.

Comment 3

[John Ford [:jhford] CET/CEST Berlin Time]

I put this on staging mobile master and enabled all unit test suites.

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

the only thing that is missing is the mochitest-plain test run.  I know this has been turned off on maemo tests for a while now, is there a few places that this is disabled/turned-off that we need to edit?

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

I see this on MobileTest right now!

A quick sanity check of the log files look successful.  I think this is a go.  I will check this in tomorrow unless anybody has any objections.

Also, do we have a known_failure_count for mochitest-plain?  I would like to see if we move that to 0 where we are at with everything.

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

pushed:
http://hg.mozilla.org/qa/maemkit/pushloghtml?changeset=b793afeb95d0

Please update the maemkit.tar.bz2 on production/staging to be a fresh hg pull:
hg clone http://hg.mozilla.org/qa/maemkit
tar -cf maemkit.tar maemkit/
bzip2 maemkit.tar