Closed Bug 1432872 Opened 2 years ago Closed 2 years ago

Do not run test-verify on beta

Categories

(Testing :: General, enhancement)

enhancement
Not set

Tracking

(firefox59 fixed, firefox60 fixed)

RESOLVED FIXED
mozilla60
Tracking Status
firefox59 --- fixed
firefox60 --- fixed

People

(Reporter: gbrown, Assigned: gbrown)

References

Details

Attachments

(1 file)

As raised in bug 1431154: Some test types (screenshots) don't normally run on beta, so it seems wrong to verify such tests on beta. Also, when we promote changes to beta quickly, a single verification failure may repeat on multiple branches, triggering stockwell triage with minimal value.

Let's skip test-verify outside of [inbound/autoland/central].
Comment on attachment 8945182 [details] [diff] [review]
run test-verify only on central, inbound, autoland, and try

Review of attachment 8945182 [details] [diff] [review]:
-----------------------------------------------------------------

::: taskcluster/ci/test/misc.yml
@@ +70,5 @@
>          by-test-platform:
>              # do not run on ccov; see also the enable_code_coverage transform
>              linux64-ccov/.*: []
> +            # do not run on beta or release: usually just confirms earlier results
> +            default: ['mozilla-central', 'autoland', 'mozilla-inbound', 'try']

Couldn't this be ['trunk', 'try'] instead? Anyway, I'm fine in principle with this change.

::: taskcluster/ci/test/web-platform.yml
@@ +137,5 @@
>          by-test-platform:
>              # do not run on ccov; see also the enable_code_coverage transform
>              linux64-ccov/.*: []
> +            # do not run on beta or release: usually just confirms earlier results
> +            default: ['mozilla-central', 'autoland', 'mozilla-inbound', 'try']  

Likewise.
Attachment #8945182 - Flags: review?(ryanvm) → review+
Thanks! Will change to 'trunk'...
Pushed by gbrown@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/95cfbed0308f
Stop running test-verify on beta and release; r=ryanvm
https://hg.mozilla.org/mozilla-central/rev/95cfbed0308f
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla60
Depends on: 1433403
You need to log in before you can comment on or make changes to this bug.