580238 - [mozmill] Clone Firefox's MozMill automated update tests for Thunderbird

Status: RESOLVED FIXED

(Mozilla QA Graveyard :: Mozmill Tests, defect)

Description

[Mark Banner (:standard8)]

Attachment: 1.9.1 branch patch

Thunderbird is working on re-using the automated update tests that are run via MozMill on Firefox for Thunderbird's own testing.

This bug will do the patches for the mozmill-tests repositories to set up Thunderbird versions of the files.

There will be three patches, one for each active branch.

Comment 1

[Mark Banner (:standard8)]

Comment on attachment 458653 [details] [diff] [review]
1.9.1 branch patch

Apologies, git diff was turned off. I'll attach a new patch in a bit.

Comment 2

[Mark Banner (:standard8)]

Attachment: 1.9.1 branch patch

Comment 3

[Mark Banner (:standard8)]

Attachment: 1.9.2 branch patch

Comment 4

[Mark Banner (:standard8)]

Attachment: Trunk patch

Ok, so these are all pretty much the same, but hg didn't like me reusing the same patch across the different branches.

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to comment #0)
> Thunderbird is working on re-using the automated update tests that are run via
> MozMill on Firefox for Thunderbird's own testing.
> 
> This bug will do the patches for the mozmill-tests repositories to set up
> Thunderbird versions of the files.

Looking forward to this. Was great to talk to you during the Summit and that those tests will help you to run automated update tests for Thunderbird. I still wonder if it is a good place for thunderbird update tests at all. All stuff in the mozmill-test repository is Firefox specific, and I would assume that once we get problems with shared-modules we will have to find another solution. So I wonder if you would create your own repository for at least the update tests (no idea what else will come in the future).

Comment 6

[Mark Banner (:standard8)]

When the mozmill-test repository was first created, it was deemed to be the one place where tests for all apps would go (although Thunderbird at that time wanted a developer rather than QA focus and therefore chose to put its tests in comm-central).

If we need a separate repo, then I guess we can set one up, I'll have to also work out a way whereby we can keep the parts of those repos that we need in sync.

Comment 7

[Henrik Skupin [:whimboo][⌚️UTC+1]]

We could have those tests in mozmill-tests but I'm a bit uncertain how future work will affect your tests. The shared modules we are using are really Firefox specific and can change at any time. That would mean you will have to have your own repository in any way or have your own set of shared modules under thunderbird. A cleaner way would definitely be another repository.

We have put the shared modules at the top level because no-one else signaled interest in also using our repository. Reverting all that would raise a lot of work, code-wise and documentation.

What I can make sure is to inform you about any update of the SoftwareUpdateAPI to you are aware of changes.

Comment 8

[Mark Banner (:standard8)]

Ok, I've now set up a repository here with the test files cloned and adjusted as required:

http://hg.mozilla.org/users/bugzilla_standard8.plus.com/qa-tests/

Comment 9

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Mass move of Mozmill Test related project bugs to newly created components. You can filter out those emails by using "Mozmill-Tests-to-MozillaQA" as criteria.