1989652 - split expensive-to-generate test suites into their own kind

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Description

[[e-mail] (:bhearsum)]

Generating kinds across multiple processes was landed on https://bugzilla.mozilla.org/show_bug.cgi?id=1989038. With that on, we should move out more test types to their own kinds to further parallelize their generation. I have a working patch stack to do this as much as is reasonable. With it applied, the new web-platform-tests are the critical path, which can't be easily segregated any further at this time.

Comment 1

[BMO Github Automation]

Attachment: [mozilla-releng/fxci-config] feat: add new test kinds to os-integration tests (bug 1989652) (#548)

Comment 2

[[e-mail] (:bhearsum)]

Attachment: Bug 1989652: pre: fix taskgraph code that needs to know about the `mochitest` kind r?#taskgraph-reviewers!

This was an oversight in https://bugzilla.mozilla.org/show_bug.cgi?id=1982404 that didn't actually cause issues...but should be fixed.

Comment 3

[[e-mail] (:bhearsum)]

Attachment: Bug 1989652: move reftests to their own kind r?#taskgraph-reviewers!

This was a Claude associated change, but is virtually the same as what was done for mochitests in https://bugzilla.mozilla.org/show_bug.cgi?id=1982404.

Comment 4

[[e-mail] (:bhearsum)]

Attachment: Bug 1989652: move browsertime tests to their own kind r?#taskgraph-reviewers!

This was a Claude associated change, but is virtually the same as what was done for mochitests in https://bugzilla.mozilla.org/show_bug.cgi?id=1982404. Desktop & Mobile would ideally be in their own kinds, but I chose not to, because it was not possible to do without changing PREFIX_BY_KIND.

Comment 5

[[e-mail] (:bhearsum)]

Attachment: Bug 1989652: move web-platform-tests to their own kind r?#taskgraph-reviewers!

This was a Claude associated change, but is virtually the same as what was done for mochitests in https://bugzilla.mozilla.org/show_bug.cgi?id=1982404.

Ideally these would be further split up. This is not possible in part because of how PREFIX_BY_KIND works, most more notably because we need to write out the tests-by-manifest.json.gz artifact for these tests -- and we need to generate all web platform tests in the same process we write that out in.

Comment 6

[[e-mail] (:bhearsum)]

Sanity checking of this stack was done in https://treeherder.mozilla.org/jobs?repo=try&revision=42c45ab951fdef5cc8609b44dee2cd8438e5447b

Comment 7

[BMO Github Automation]

Authored by https://github.com/bhearsum
https://github.com/mozilla-releng/fxci-config/commit/a597f8aafc786d5312243d7b5c39d7f32117e8e2
[main] feat: add new test kinds to os-integration tests (bug 1989652) (#548)

Comment 8

[[e-mail] (:bhearsum)]

no bot, this is not done

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/d5e0bcb86a7a
https://hg.mozilla.org/integration/autoland/rev/1085f60f7df0
pre: fix taskgraph code that needs to know about the `mochitest` kind r=taskgraph-reviewers,jmaher,releng-reviewers,jcristau
https://github.com/mozilla-firefox/firefox/commit/4b677f57e9ae
https://hg.mozilla.org/integration/autoland/rev/3b4dce48d46e
move reftests to their own kind r=taskgraph-reviewers,jmaher
https://github.com/mozilla-firefox/firefox/commit/cb932b884bb5
https://hg.mozilla.org/integration/autoland/rev/7cb7b29bfad6
move browsertime tests to their own kind r=taskgraph-reviewers,perftest-reviewers,jmaher,kshampur
https://github.com/mozilla-firefox/firefox/commit/71a5a983d142
https://hg.mozilla.org/integration/autoland/rev/522d27d2ad86
move web-platform-tests to their own kind r=taskgraph-reviewers,jmaher,perftest-reviewers,kshampur

Comment 10

[Iulian Moraru]

https://hg.mozilla.org/mozilla-central/rev/1085f60f7df0
https://hg.mozilla.org/mozilla-central/rev/3b4dce48d46e
https://hg.mozilla.org/mozilla-central/rev/7cb7b29bfad6
https://hg.mozilla.org/mozilla-central/rev/522d27d2ad86