Setup a machine in the lab to run daily Mozmill and software update tests

RESOLVED FIXED

Status

Testing Graveyard
Mozmill
RESOLVED FIXED
9 years ago
2 years ago

People

(Reporter: whimboo, Assigned: whimboo)

Tracking

Details

Attachments

(1 attachment, 1 obsolete attachment)

(Assignee)

Description

9 years ago
As discussed in my Software Update session during our last All Hands we wanna have a machine in the lab which can perform daily Mozmill and Software Update runs on all platforms.

What we wanna have:
* Host should be running OS X 10.5 or 10.6
* 1st VMWare guest: Ubuntu 9.10
* 2nd VMWare guest: Windows XP
* 3rd VMWare guest: Windows Vista
* 4th VMWare guest: Windows 7

For the daily tests the Linux and one of the Windows machines (I would prefer XP for now) should be constantly run.

I will setup this machine once it has been delivered. Al, can you please file a bug for IT and mark it blocking this bug?
When these are in the lab and setup can we please add them to https://wiki.mozilla.org/MozillaQualityAssurance:QA_Machines#QA_Machines_Inventory?
(Assignee)

Updated

9 years ago
Depends on: 538469
(Assignee)

Updated

9 years ago
Depends on: 539804
(Assignee)

Comment 2

9 years ago
The machine has been setup by Al last week. We have 10.5 and 10.6 available on separate partitions. Further we have VM's for Ubuntu 9.10 and Windows (2000, XP, Vista, and Win7) which I have already prepared with everything we need to run Mozmill tests.

Working items which have to be done:
* Create shell scripts for cron tab execution
* Report to brasstacks (needs fixes to our design views first)

(In reply to comment #1)
> When these are in the lab and setup can we please add them to
> https://wiki.mozilla.org/MozillaQualityAssurance:QA_Machines#QA_Machines_Inventory?

Sure. I have added this machine now.
Status: NEW → ASSIGNED
(Assignee)

Comment 3

9 years ago
The shell script has been created and works for OS X. It needs some tweaks for Windows and eventually Linux too. But sending reports is supported. The first public results are located here:

http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_list/summary/summary
(Assignee)

Comment 4

9 years ago
Created attachment 423799 [details]
Python script for test-runs

Just to make sure everything is ok, I'd like to have a review from Clint.
Attachment #423799 - Flags: review?(ctalbert)
(Assignee)

Updated

9 years ago
Attachment #423799 - Attachment is patch: true
Attachment #423799 - Attachment mime type: text/x-python-script → text/plain
(Assignee)

Updated

9 years ago
Attachment #423799 - Attachment is patch: false
(Assignee)

Comment 5

9 years ago
All machines have been setup to run daily tests. I will call it fixed. Follow-up work will happen on demand. At least we should improve the handling of Mozmill tests which hang.
(Assignee)

Updated

9 years ago
Status: ASSIGNED → RESOLVED
Last Resolved: 9 years ago
Resolution: --- → FIXED

Comment 6

9 years ago
Comment on attachment 423799 [details]
Python script for test-runs


># For MozillaBuild we have to manually set the path to the Mercurial module
>if sys.platform == 'win32':
>    # There is a bug in Mercurial which blocks importing pyd files from an archive
>    #sys.path.append(r'c:\mozilla-build\hg\library.zip')
>    sys.path.append(r'c:\mozilla-build-libs\hg')
Are you sure this is working ^? In a standard mozilla-build you don't get a directory called mozilla-build-libs but I'm not familiar with your operating environment here.


>        # To run the script via crontab on Linux we have to set the display
>        if self.options.display:
>            os.putenv('DISPLAY', self.options.display)
Since this is only needed for linux, it'd probably make sense to put an "if (linux): around it so that we don't randomly set environment variables on platforms we don't intend to set them on.

Other than those two nits, everything seems fine.

Nice work, Henrik.
Attachment #423799 - Flags: review?(ctalbert) → review+
(Assignee)

Comment 7

9 years ago
(In reply to comment #6)
> >    #sys.path.append(r'c:\mozilla-build\hg\library.zip')
> >    sys.path.append(r'c:\mozilla-build-libs\hg')
> Are you sure this is working ^? In a standard mozilla-build you don't get a
> directory called mozilla-build-libs but I'm not familiar with your operating
> environment here.

There is a bug in MozillaBuild which prevents us from using the modules under c:\mozilla-build\hg\library.zip. I investigate this problem with some Mercurial guys. Eventually Mozilla Build uses the wrong version of Mercurial. I revert that once the bug has been fixed.

> Since this is only needed for linux, it'd probably make sense to put an "if
> (linux): around it so that we don't randomly set environment variables on
> platforms we don't intend to set them on.

The display variable is only set when you fold in the --display option to that test. It will only be used on Linux. So it's already working like an if statement.
(Assignee)

Comment 8

9 years ago
Created attachment 426264 [details]
Python script v2

We were able to figure out the issue with Mercurial. What we missed was the Python specific Mercurial build which can be found at http://bitbucket.org/tortoisehg/thg-winbuild/downloads/

Means, we do not have to differentiate between the different OS anymore.
Attachment #423799 - Attachment is obsolete: true
(Assignee)

Updated

9 years ago
Attachment #426264 - Attachment mime type: text/x-python-script → text/plain
(Assignee)

Updated

9 years ago
Depends on: 545432
(Assignee)

Updated

8 years ago
Blocks: 562352
(Assignee)

Updated

8 years ago
Blocks: 562639
No longer blocks: 562352
Product: Testing → Testing Graveyard
You need to log in before you can comment on or make changes to this bug.