1565406 - [wpt-sync] Sync PR 17795 - Delete test_valid_but_unmatchable_key webdriver test

Status: RESOLVED FIXED

(Testing :: geckodriver, task, P4)

Description

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 17795 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/17795
Details from upstream follow.

Julian Kung <[e-mail]> wrote:

Delete test_valid_but_unmatchable_key webdriver test

This test is designed with the assumption that the first set of capabilities should be rejected during the matching capabilities algorithm at step 3 when following the "otherwise" substep due to the extension capability "foo:unmatchable".

If name is the key of an extension capability, let value be the result of trying implementation-specific steps to match on name with value. If the match is not successful, return success with data null.

However, the test incorrectly assumes that the implementation-specific steps will result in an unsuccessful match. The test therefore is no longer strictly adhering to the defined spec.

No browsers are currently passing this tests so I propose that it should be removed.

Comment 1

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=0f0b588bd0c02ec191a88bf0978142915815ae93

Comment 2

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=bca0422fac1c5e10c4fa513ee1b2b606fae72c15

Comment 3

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

CI Results

Ran 0 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 1 tests and 7 subtests

Status Summary

Firefox

OK : 1
PASS: 5
FAIL: 2

Chrome

OK : 1
PASS: 6
FAIL: 1

Safari

OK : 1
PASS: 4
FAIL: 3

Links

GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/webdriver/tests/new_session/default_values.py
test_no_capabilites: FAIL (Chrome: PASS, Safari: FAIL)
test_desired: FAIL (Chrome: PASS, Safari: FAIL)

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9484ca736521
[wpt PR 17795] - Delete test_valid_but_unmatchable_key webdriver test, a=testonly

Comment 5

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/9484ca736521