1847192 - Since bug 1841792 wdspec tests use the default Firefox binary instead of the downloaded one

Status: RESOLVED DUPLICATE of bug 1847207

(Testing :: web-platform-tests, defect)

Description

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Since the patches from bug 1841792 landed and got synced upstream the wdspec jobs at least for the wpt repository are using the wrong Firefox binary. Check those results from wpt.fyi:

https://wpt.fyi/results/webdriver/tests/bidi/script/call_function/channel.py?label=master&label=experimental&product=firefox&product=chrome&product=edge&aligned&view=subtest

The script.message event is around for quite some time. Even through mozversion tells that a Firefox 118 build is used it's not doing so. Instead 113 is used and can be seen in the logs:

https://community-tc.services.mozilla.com/tasks/H9lX9j6CRq2lwyeRwtstEw/runs/0/logs/live/public/logs/live.log#L431

James can you please take a look? Thanks a lot.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

I can actually reproduce this when running the following command locally:

python3 ./wpt run --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --install-browser --install-webdriver firefox webdriver/tests/bidi/script/message/message.py

Note that I do not have a Firefox binary at the default location and as such the command fails:

E           webdriver.error.SessionNotCreatedException: session not created (500): Expected browser binary location, but unable to find binary in default location, no 'moz:firefoxOptions.binary' capability provided, and no binary flag set on the command line

body       = {'capabilities': {'alwaysMatch': {'acceptInsecureCerts': True,
                                  'moz:firefoxOptions': {'args': ['--profile',
                                                                  '/var/folders/sd/hgkqcwv90sz_q1pqjww78nfm0000gn/T/tmp05a77_v7.mozrunner']},
                                  'webSocketUrl': True}}}
err        = <SessionNotCreatedException http_status=500>
method     = 'POST'
response   = <Response status=500 error=<SessionNotCreatedException http_status=500>>
self       = <Session (disconnected)>
timeout    = None
url        = 'session'

Comment 2

[James Graham [:jgraham]]

https://github.com/web-platform-tests/wpt/pull/41338 should fix this, I think.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This requires bug 1847207.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Got fixed in bug 1847207. Lets mark as dupe.