1693640 - Run devtools fission tests on opt builds on autoland (instead of shippable)

Status: RESOLVED FIXED

(DevTools :: General, task, P3)

Description

[Julian Descottes [:jdescottes]]

We initially decided to run devtools fission mochitests on shippable for autoland when we moved them to tier1, so that we would align with the platforms already used on central.

But shippable builds are more expensive, and we should be able to switch to regular opt builds for autoland.

Comment 1

[Julian Descottes [:jdescottes]]

Attachment: Bug 1693640 - Run devtools fission tests on opt builds on trunk (instead of shippable)

Comment 2

[Julian Descottes [:jdescottes]]

The jobs for devtools fission on linux opt non shippable don't exist for now.
So it's not just a matter of updating the platforms.

Comment 3

[Julian Descottes [:jdescottes]]

Hi Joel,

I see we can't schedule Mochitest Fission jobs on Linux 64 opt platforms, they seem available on shippable builds.
I can't find them either using try fuzzy or using "add new jobs" on treeherder.
I don't know where this is defined though and if it's something we can change?

Example: the job opt-mochitest-devtools-chrome-fis-e10s-1 is not available under test-linux1804-64, only under test-linux1804-64-shippable.

Thanks

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

I don't want to leave the needinfo hanging so long, but unfortunately I don't know how to solve this- I did spent a few hours looking into this and see that this is a problem (also with browser-chrome). My hacking didn't seem to help, so I need to spend more time on this...ideally in the next week I have traction here.

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

I have filed bug 1695083, this should allow things to work normally- I have more testing to do, maybe my initial findings are not going to work out- but I am a lot closer and will continue to find a solution there.

Comment 6

[Julian Descottes [:jdescottes]]

Thanks for taking a look at this Joel! Really appreciated, I had no idea how to make progress here.

Comment 7

[Chris Peterson [:cpeterson]]

Moving from Fission M7 (Beta experiment) to M8 (Release experiment) because switching the DevTools test config on autoland doesn't need to block our Beta experiment.

Comment 8

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1693640 - [ci] Ensure browsertime tp6 ignores non-shippable fission platforms, r?#perftest-reviewers

All the other browsertime tasks ignore non-shippable platforms except for this
one. It was causing problems for a later patch in this stack.

Comment 9

[Phabricator Automation]

Comment on attachment 9206729 [details]
Bug 1693640 - [ci] Ensure browsertime tp6 ignores non-shippable fission platforms, r?#perftest-reviewers

Revision D107107 was moved to bug 1695083. Setting attachment 9206729 [details] to obsolete.

Comment 10

[Andrew Halberstadt [:ahal]]

Once the patches in bug 1695083 land, then opt-mochitest-devtools-chrome-fis will start showing up in ./mach try fuzzy --full. To get them there without --full, they need to be running on central/autoland. Now setting the fission-run-on-projects key here should work.

Comment 11

[Joel Maher ( :jmaher ) (UTC -8)]

:jdescottes, now that bug 1695083 is landed (just now on autoland), your changes should be a lot easier to make.

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bbd0dfa748f5
Run devtools fission tests on opt builds on trunk (instead of shippable) r=jmaher

Comment 13

[Alexandru Michis [:malexandru]]

https://hg.mozilla.org/mozilla-central/rev/bbd0dfa748f5