Closed Bug 1837057 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 40400 - [FedCM] Fix WPT test defaults

Categories

(Core :: DOM: Credential Management, task, P4)

Product:
Core
Component:
DOM: Credential Management
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
116 Branch
Tracking Flags:
Tracking Status
firefox116 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 40400 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/40400
Details from upstream follow.

Nicolás Peña <npm@chromium.org> wrote:

[FedCM] Fix WPT test defaults

Currently, the mediation parameter is not passed, which means it will be
set to 'optional'. It's better for most tests to use 'required', and
instead use 'optional' for the auto re-authn test.

Change-Id: I744a3b486c8edb356510f55a465c8db4b1c58589
Reviewed-on: https://chromium-review.googlesource.com/4595879
WPT-Export-Revision: 3ffdd03b60cc3e575be0a4262754aadf8cb3a8d0

Component: web-platform-tests → DOM: Credential Management
Product: Testing → Core

CI Results

Ran 5 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 16 tests and 19 subtests

Status Summary

Firefox

OK : 3
FAIL : 25
ERROR : 13

Chrome

OK : 1
PASS : 2
TIMEOUT: 6
ERROR : 12
NOTRUN : 20

Safari

OK : 3
FAIL : 25
ERROR : 13

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /credential-management/fedcm-cross-origin-policy.https.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: TIMEOUT, Safari: OK)
    • Test that COEP policy do not apply to FedCM requests: FAIL (Chrome: TIMEOUT, Safari: FAIL)
  • /credential-management/fedcm-csp.https.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: OK, Safari: OK)
    • Provider configURL should honor Content-Security-Policy.: FAIL (Chrome: PASS, Safari: FAIL)
  • /credential-management/fedcm-iframe.https.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: TIMEOUT, Safari: OK)
    • FedCM disabled in cross origin iframe without permissions policy: FAIL (Chrome: PASS, Safari: FAIL)
    • FedCM enabled in 2 level deep nested iframe. FedCM should be enabled regardless of iframe nesting depth: FAIL (Chrome: TIMEOUT, Safari: FAIL)
    • FedCM disabled in 2 level deep nested iframe where middle iframe does not have permission policy: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • FedCM disabled in 2 level deep nested iframe where innermost iframe does not have permission policy: FAIL (Chrome: NOTRUN, Safari: FAIL)
  • /credential-management/fedcm-multi-idp/abort-multiple-gets-through-first-idp.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/abort-multiple-gets-through-second-idp.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/get-before-and-after-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/get-before-and-during-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/get-before-onload-and-during-dom-content-loaded.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/multiple-gets-after-abort.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/multiple-gets-after-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/multiple-gets-before-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/multiple-gets-during-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/single-get-after-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/single-get-before-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-multi-idp/single-get-during-onload.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: ERROR, Safari: ERROR)
  • /credential-management/fedcm-network-requests.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Chrome: TIMEOUT, Safari: ERROR)
    • Successfully obtaining token should resolve the promise.: FAIL (Chrome: TIMEOUT, Safari: FAIL)
    • When there's a pending request, a second get call should be rejected. : FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Reject when provider list is empty: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Reject when configURL is missing: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Reject when configURL is invalid: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Reject when clientId is empty: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • nonce is not required in FederatedIdentityProvider.: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Reject when clientId is missing: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test the abort signal: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Get after abort should work: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test that the promise is rejected if the manifest is not in the manifest list: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test that promise is rejected if accounts endpoint redirects: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test that token endpoint does not follow redirects: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test client_metadata request: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test that service worker cannot observe fetches performed by FedCM API: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test basic User InFo API flow: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test that User Info API only works when invoked from iframe that is same origin as the IDP: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test that User Info API does not work in the top frame: FAIL (Chrome: NOTRUN, Safari: FAIL)
    • Test that the returning account from the two accounts will be auto re-authenticated.: FAIL (Chrome: NOTRUN, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/ba79aef55533 [wpt PR 40400] - [FedCM] Fix WPT test defaults, a=testonly

https://hg.mozilla.org/mozilla-central/rev/ba79aef55533

Status: NEW → RESOLVED
Closed: 1 year ago
status-firefox116: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 116 Branch
You need to log in before you can comment on or make changes to this bug.