488732 - Do multiple unittest runs on a single build

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Chris AtLee [:catlee]]

It would be useful to get multiple test runs of a single build on occasion to be able to track down tests that fail intermittently.  By testing the same build, we can be sure that a change in the code isn't causing a different in test results.

Comment 1

[Chris AtLee [:catlee]]

Attachment: NightlyRebuild scheduler

This scheduler will trigger rebuilds of previous builds on the specified builders, at the given times.  By default it will trigger one rebuild, but be told to rebuild more than once.

Comment 2

[[e-mail] (:bhearsum)]

Comment on attachment 381140 [details] [diff] [review]
NightlyRebuild scheduler

Seems fine to me. Do you think this is something that is upstreamable or is it Mozilla-specific?

Comment 3

[Chris AtLee [:catlee]]

Attachment: Re-test packaged builds on staging once per night

Comment 4

[[e-mail] (:bhearsum)]

Comment on attachment 382111 [details] [diff] [review]
Re-test packaged builds on staging once per night

Looks fine to me

Comment 5

[Chris AtLee [:catlee]]

Attachment: Re-test packaged builds every week.

Comment 6

[Serge Gautherie (:sgautherie)]

Comment on attachment 384204 [details] [diff] [review]
Re-test packaged builds every week.

Nits:

>diff --git a/mozilla2-staging/master-main.cfg b/mozilla2-staging/master-main.cfg
>+            numberOfBuildsToTrigger=1, mergeBuilds=False))

You may use 2 lines.

>diff --git a/mozilla2/master.cfg b/mozilla2/master.cfg
>+            numberOfBuildsToTrigger=2,

(Do you really want '2'?)

Comment 7

[Chris AtLee [:catlee]]

Comment on attachment 381140 [details] [diff] [review]
NightlyRebuild scheduler

changeset:   346:0bc6e7a9f350

Comment 8

[Chris AtLee [:catlee]]

Comment on attachment 384204 [details] [diff] [review]
Re-test packaged builds every week.

changeset:   1225:0c07f03ec90f

Comment 9

[Chris AtLee [:catlee]]

Attachment: disable nightly rebuilds

going to disable this since it's been causing semi-random redness, and nobody is looking at the results anyway.

Comment 10

[Chris AtLee [:catlee]]

Comment on attachment 424282 [details] [diff] [review]
disable nightly rebuilds

changeset:   599:fb5543bb7a4a