563535 - Create a daily test-run script which can be used by crontab

Status: RESOLVED FIXED

(Mozilla QA Graveyard :: Mozmill Automation, defect)

Description

[Henrik Skupin [:whimboo][⌚️UTC+1]]

We have to update our crontab scripts on OS X and Linux, and the scheduled tasks on Windows to not start the next tests while the current ones are still running. The best would be to have a wrapper script which executes all tests in a row and only requires a single entry in the crontab.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

I put a script up on github which let us run our daily test-runs against installed builds. All the configuration happens inside an ini file so the script can be used for different platforms.

http://github.com/whimboo/mozmill/commit/8e442ab93357deb664820675ffde4c1a294564c4

Jeff, would be great if you could take a look at it. Thanks.

Comment 2

[Jeff Hammel]

see notes on github: see http://github.com/whimboo/mozmill/commit/8e442ab93357deb664820675ffde4c1a294564c4#commitcomment-81824 and http://github.com/whimboo/mozmill/commit/8e442ab93357deb664820675ffde4c1a294564c4#commitcomment-81816

As stated, I would put whatever config-file parsing directly into the parser(s) (e.g. http://github.com/whimboo/mozmill/blob/8e442ab93357deb664820675ffde4c1a294564c4/scripts/firefox-automation/testrun_bft.py#L48 ) and set the environment variable in the crontab.

But this is all a nice to have and non-blocking.  Looks fine (except for the ('darwin') vs ('darwin',) error which should be fixed).

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

I have fixed the mentioned error and pushed it to the master. Everything works and I will follow up with the remaining items later. Thanks Jeff!

So you would suggest that we also give the testrun class itself the possibility to read an ini file to scan for default values? Sounds like a good idea.

Comment 4

[Jeff Hammel]

(In reply to comment #3)
> I have fixed the mentioned error and pushed it to the master. Everything works
> and I will follow up with the remaining items later. Thanks Jeff!
> 
> So you would suggest that we also give the testrun class itself the possibility
> to read an ini file to scan for default values? Sounds like a good idea.

This is what I would do.  It provides additional functionality and eliminates the need for a front-end script.  You can look at some example code I put up that does something like this: http://k0s.org/hg/ConfigOptionParser/ (there is also a pypi package)

It may/may not be sufficient for your purposes OOTB, but maybe it will give some ideas.

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Move of Mozmill related project bugs to newly created components. You can
filter out those emails by using "Mozmill-Tests-to-MozillaQA" as criteria.

Comment 6

[Henrik Skupin [:whimboo][⌚️UTC+1]]

I don't want to keep this bug longer open. We have such a script for a long time now. It's not perfect but it works. It will soonish replaced by a complete new system, once we transitioned over to probably Selenium.