1723084 - Add a shared try preset for remote protocol

Status: RESOLVED FIXED

(Remote Protocol :: Agent, task, P2)

Description

[Henrik Skupin [:whimboo][⌚️UTC+2]]

I am currently using a local preset for that, which clearly needs to be extended now that also WebDriver BiDi needs to be covered.

remote:
  query:
  - '''pup '
  - '''mochi ''remote !asan !qr !spi'
  selector: fuzzy

It would be nice to add one in https://searchfox.org/mozilla-central/source/tools/tryselect/try_presets.yml so that new contributors can immediately use it.

Things to change:

• We should also include asan or at least debug to catch leaks
• Taking into account that qr builds are now the default
• Clearly run unit tests (xpcshell)
• Also we need to extend the coverage to wdspec (probably all - not sure if we will have dedicated ones for BiDi)

Anything that I missed?

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

As agreed on with Julian we will actually extend the preset for Marionette with the remaining jobs as mentioned above and share it as the remote-protocol preset.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

With the upcoming patch the following 77 test jobs are considered to run by default:

        "source-test-python-marionette-harness-linux1804-64/opt-py3",
        "source-test-python-marionette-harness-windows10-64/opt-py3",
        "source-test-remote-puppeteer",
        "test-android-em-7.0-x86_64-qr/debug-geckoview-reftest-e10s-1",
        "test-android-em-7.0-x86_64-qr/debug-geckoview-web-platform-tests-e10s-1",
        "test-android-em-7.0-x86_64-qr/debug-geckoview-web-platform-tests-reftest-e10s-1",
        "test-android-em-7.0-x86_64-qr/debug-geckoview-xpcshell-e10s-1",
        "test-android-em-7.0-x86_64-qr/debug-geckoview-xpcshell-e10s-2",
        "test-linux1804-64-qr/debug-firefox-ui-functional-local-e10s",
        "test-linux1804-64-qr/debug-firefox-ui-functional-remote-e10s",
        "test-linux1804-64-qr/debug-marionette-e10s",
        "test-linux1804-64-qr/debug-marionette-fis-e10s",
        "test-linux1804-64-qr/debug-mochitest-remote-e10s",
        "test-linux1804-64-qr/debug-reftest-fis-e10s-1",
        "test-linux1804-64-qr/debug-reftest-snapshot-fis-e10s-1",
        "test-linux1804-64-qr/debug-web-platform-tests-fis-e10s-1",
        "test-linux1804-64-qr/debug-web-platform-tests-reftest-fis-e10s-1",
        "test-linux1804-64-qr/debug-web-platform-tests-wdspec-e10s-1",
        "test-linux1804-64-qr/debug-web-platform-tests-wdspec-e10s-2",
        "test-linux1804-64-qr/debug-web-platform-tests-wdspec-e10s-3",
        "test-linux1804-64-qr/debug-web-platform-tests-wdspec-fis-e10s-1",
        "test-linux1804-64-qr/debug-web-platform-tests-wdspec-fis-e10s-2",
        "test-linux1804-64-qr/debug-web-platform-tests-wdspec-fis-e10s-3",
        "test-linux1804-64-qr/debug-xpcshell-e10s-1",
        "test-linux1804-64-qr/debug-xpcshell-e10s-2",
        "test-linux1804-64-qr/debug-xpcshell-e10s-3",
        "test-linux1804-64-qr/debug-xpcshell-e10s-4",
        "test-linux1804-64-qr/debug-xpcshell-e10s-5",
        "test-linux1804-64-qr/debug-xpcshell-e10s-6",
        "test-linux1804-64-shippable-qr/opt-awsy-base-e10s",
        "test-linux1804-64-shippable-qr/opt-awsy-base-fis-e10s",
        "test-linux1804-64-shippable-qr/opt-marionette-headless-e10s",
        "test-linux1804-64-shippable-qr/opt-marionette-headless-fis-e10s",
        "test-macosx1015-64-qr/debug-firefox-ui-functional-local-e10s",
        "test-macosx1015-64-qr/debug-firefox-ui-functional-remote-e10s",
        "test-macosx1015-64-qr/debug-marionette-e10s",
        "test-macosx1015-64-qr/debug-mochitest-browser-chrome-fis-e10s-1",
        "test-macosx1015-64-qr/debug-mochitest-remote-e10s",
        "test-macosx1015-64-qr/debug-mochitest-remote-fis-e10s",
        "test-macosx1015-64-qr/debug-web-platform-tests-wdspec-e10s-1",
        "test-macosx1015-64-qr/debug-web-platform-tests-wdspec-e10s-2",
        "test-macosx1015-64-qr/debug-web-platform-tests-wdspec-e10s-3",
        "test-macosx1015-64-qr/debug-xpcshell-e10s-1",
        "test-macosx1015-64-qr/debug-xpcshell-e10s-2",
        "test-macosx1015-64-shippable-qr/opt-awsy-base-fis-e10s",
        "test-windows10-32-2004-qr/debug-firefox-ui-functional-local-e10s",
        "test-windows10-32-2004-qr/debug-firefox-ui-functional-remote-e10s",
        "test-windows10-32-2004-qr/debug-marionette-e10s",
        "test-windows10-32-2004-qr/debug-mochitest-remote-e10s",
        "test-windows10-32-2004-qr/debug-web-platform-tests-wdspec-e10s-1",
        "test-windows10-32-2004-qr/debug-web-platform-tests-wdspec-e10s-2",
        "test-windows10-32-2004-qr/debug-web-platform-tests-wdspec-e10s-3",
        "test-windows10-32-2004-qr/debug-xpcshell-e10s-1",
        "test-windows10-32-2004-qr/debug-xpcshell-e10s-2",
        "test-windows10-32-2004-qr/debug-xpcshell-failures-e10s-1",
        "test-windows10-32-2004-qr/debug-xpcshell-failures-e10s-2",
        "test-windows10-64-2004-qr/debug-firefox-ui-functional-local-e10s",
        "test-windows10-64-2004-qr/debug-firefox-ui-functional-remote-e10s",
        "test-windows10-64-2004-qr/debug-marionette-e10s",
        "test-windows10-64-2004-qr/debug-mochitest-browser-chrome-fis-e10s-1",
        "test-windows10-64-2004-qr/debug-mochitest-remote-e10s",
        "test-windows10-64-2004-qr/debug-web-platform-tests-fis-e10s-1",
        "test-windows10-64-2004-qr/debug-web-platform-tests-reftest-fis-e10s-1",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-e10s-1",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-e10s-2",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-e10s-3",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-fis-e10s-1",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-fis-e10s-2",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-fis-e10s-3",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-headless-e10s-1",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-headless-e10s-2",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-headless-fis-e10s-1",
        "test-windows10-64-2004-qr/debug-web-platform-tests-wdspec-headless-fis-e10s-2",
        "test-windows10-64-2004-qr/debug-xpcshell-e10s-1",
        "test-windows10-64-2004-qr/debug-xpcshell-e10s-2",
        "test-windows10-64-2004-shippable-qr/opt-awsy-base-e10s",
        "test-windows10-64-2004-shippable-qr/opt-awsy-base-fis-e10s"

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: Bug 1723084 - Add try preset for the remote protocol.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/aefcdc3109ef
Add try preset for the remote protocol. r=webdriver-reviewers,jdescottes

Comment 5

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/aefcdc3109ef