Open
Bug 1485794
Opened 6 years ago
Updated 2 years ago
[wpt-sync] Sync PR 12657 - Validate pull requests in TaskCluster
Categories
(Testing :: web-platform-tests, enhancement, P4)
Testing
web-platform-tests
Tracking
(Not tracked)
NEW
People
(Reporter: mozilla.org, Unassigned)
References
()
Details
(Whiteboard: [wptsync downstream])
Sync web-platform-tests PR 12657 into mozilla-central (this bug is closed when the sync is complete). PR: https://github.com/web-platform-tests/wpt/pull/12657 Details from upstream follow. Mike Pennisi <mike@mikepennisi.com> wrote: > Validate pull requests in TaskCluster > > Extend the configuration for the TaskCluster service to generate tasks in > response to GitHub pull requests. Each pull request should create one cluster > containing four tasks, all of which operate on the affected tests as identified > by `wpt tests-affected`: > > - run the tests in Chrome and publish the results as a gzipped artifact > - run the tests in Firefox and publish the results as a gzipped artifact > - verify the stability of the tests in Chrome > - verify the stability of the tests in Firefox > > The former two tasks are intended for future use in comparing test results with > data available on https://wpt.fyi. This will be informative only. The latter > two tasks are intended to verify that the affected tests are stable. This will > influence whether or not the pull request may be merged. > > A demonstration of expected functionality is available on Bocoup's fork of WPT: > > - `master` branch (this functionality was implemented previously, and this pull > request is not intended to influence the behavior we see today) > - [`master` branch of WPT fork](https://github.com/bocoup/wpt/commits/master) > - [Task cluster](https://tools.taskcluster.net/groups/dSGgOEa3S9y5ebTLBKIVMw) > - Pull request validation > - [pull request](https://github.com/bocoup/wpt/pull/4) > - [Task cluster](https://tools.taskcluster.net/groups/ZhRXqeYgTZS3C4TifTRzFg) > > It seems wise to vet this in WPT for a bit before allowing the results to > control whether pull requests may be merged. The configuration proposed here > will permit unstable pull requests, but it stores the status of the check in a > dedicated artifact. After some time, we can use this to compare the behavior > between the current TravisCI-powered checks and this new one. If they align, we > can revert the second commit. > > Due to some changes to indentation, using `-w` or the [`?w=1` query string > parameter](?w=1) may make this change set easier to review.
Assignee | ||
Comment 1•6 years ago
|
||
Pushed to try https://treeherder.mozilla.org/#/jobs?repo=try&revision=f36f9199d2a8e4fb192f5a0011d65acd1101d228
Assignee | ||
Comment 2•6 years ago
|
||
Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=e347f18620d2f31e46a70ef9ed522aa512a0f2ee
Assignee | ||
Comment 3•6 years ago
|
||
Pushed to try https://treeherder.mozilla.org/#/jobs?repo=try&revision=f43b58310f1a7a456ea271ff7226439fafa4cc84
Assignee | ||
Comment 4•6 years ago
|
||
Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=57db4446e992d11c75f4225e8ed0b79d292d2356
Assignee | ||
Comment 5•6 years ago
|
||
Pushed to try https://treeherder.mozilla.org/#/jobs?repo=try&revision=a73e3e12a0d71a601a3ba67600f4a8bc9018ec1f
Updated•2 years ago
|
Severity: normal → S3
You need to log in
before you can comment on or make changes to this bug.
Description
•