Closed Bug 2059624 Opened 1 month ago Closed 1 month ago

[wpt-sync] Sync PR 61645 - Reland "[sub apps] enable wpt tests"

Categories

(Testing :: web-platform-tests, task, P4)

Product:
Testing
Component:
web-platform-tests
Type:
task

Tracking

(firefox155 fixed)

Status:
RESOLVED FIXED
Milestone:
155 Branch
Tracking Flags:
Tracking Status
firefox155 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 61645 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/61645
Details from upstream follow.

Vlad Krot <vkrot@google.com> wrote:

Reland "[sub apps] enable wpt tests"

This is a reland of commit f56a10fc2ca726d6401a1c2232370faa8ce7d740

I have only changed a single file disable-site-isolation-trials to
exclude tests that require isolated origin so that
not_site_per_process_blink_wpt_tests do not run the tests.

Original change's description:

[sub apps] enable wpt tests

Re-enable the tests in third_party/blink/web_tests/external/wpt/subapps.

  • Use virtual test suits to emulate isolated context with header overrides.
  • Modernized tests to fit new sub apps API shape.
  • Remove insecure context test because by definition isolated context cannot be insecure.
  • Add a test that checks permission policy behavior.

Fixed: 40928236
Change-Id: Idc3d52c01a5a4cb4f4f588ea8c6011e1e13b4901
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/8122238
Reviewed-by: Andrew Rayskiy \<greengrape@google.com>
Reviewed-by: Vladimir Levin \<vmpstr@chromium.org>
Reviewed-by: Rick Byers \<rbyers@chromium.org>
Commit-Queue: Vlad Krot \<vkrot@google.com>
Cr-Commit-Position: refs/heads/main@{#1668571}

Bug: 40928236
Change-Id: I4c06e2489f8d8d24e91c18e05f721a2cb2252597

Reviewed-on: https://chromium-review.googlesource.com/8173844
WPT-Export-Revision: 87a8fe80c466bc2b376047680c317591d6319415

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 8 tests and 2 subtests

Status Summary

Firefox

OK : 3
PASS : 11
FAIL : 32
ERROR : 5
NOTRUN: 8

Chrome

OK : 3
PASS : 11
FAIL : 32
ERROR : 5
NOTRUN: 8

Safari

OK : 3
PASS : 11
FAIL : 32
ERROR : 5
NOTRUN: 8

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /subapps/add-error.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
    • The object is no longer associated to a document.: FAIL (Chrome: FAIL, Safari: FAIL)
    • API is only supported in top-level browsing contexts.: FAIL (Chrome: FAIL, Safari: FAIL)
    • API supports only same-origin URLs.: FAIL (Chrome: FAIL, Safari: FAIL)
    • Service failed to add two sub-apps.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
    • Service added one sub-app failed to add another sub-app.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
    • Service rejected call because user denied permission.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
  • /subapps/add-success.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
    • Add API call works with single sub app.: FAIL (Chrome: FAIL, Safari: FAIL)
    • Add API call works with multiple sub apps.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
  • /subapps/disabled-by-permissions-policy.tentative.https.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • add() disabled by permissions-policy: FAIL (Chrome: FAIL, Safari: FAIL)
    • list() disabled by permissions-policy: FAIL (Chrome: FAIL, Safari: FAIL)
    • remove() disabled by permissions-policy: FAIL (Chrome: FAIL, Safari: FAIL)
  • /subapps/idlharness.tentative.https.window.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • SubApps interface: existence and properties of interface object: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface object length: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface object name: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: existence and properties of interface prototype object: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: existence and properties of interface prototype object's "constructor" property: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: existence and properties of interface prototype object's @@unscopables property: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: operation add(sequence<USVString>): FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: operation remove(sequence<USVString>): FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: operation list(): FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps must be primary interface of window.subApps: FAIL (Chrome: FAIL, Safari: FAIL)
    • Stringification of window.subApps: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: window.subApps must inherit property "add(sequence<USVString>)" with the proper type: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: calling add(sequence<USVString>) on window.subApps with too few arguments must throw TypeError: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: window.subApps must inherit property "remove(sequence<USVString>)" with the proper type: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: calling remove(sequence<USVString>) on window.subApps with too few arguments must throw TypeError: FAIL (Chrome: FAIL, Safari: FAIL)
    • SubApps interface: window.subApps must inherit property "list()" with the proper type: FAIL (Chrome: FAIL, Safari: FAIL)
    • Window interface: attribute subApps: FAIL (Chrome: FAIL, Safari: FAIL)
    • Window interface: window must inherit property "subApps" with the proper type: FAIL (Chrome: FAIL, Safari: FAIL)
  • /subapps/list-error.tentative.https.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • The object is no longer associated to a document.: FAIL (Chrome: FAIL, Safari: FAIL)
    • API is only supported in top-level browsing contexts.: FAIL (Chrome: FAIL, Safari: FAIL)
  • /subapps/list-success.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
    • List API call works with 2 sub apps.: FAIL (Chrome: FAIL, Safari: FAIL)
    • List API call works with no sub apps.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
  • /subapps/remove-error.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
    • The object is no longer associated to a document.: FAIL (Chrome: FAIL, Safari: FAIL)
    • API is only supported in top-level browsing contexts.: FAIL (Chrome: FAIL, Safari: FAIL)
    • API supports only same-origin URLs.: FAIL (Chrome: FAIL, Safari: FAIL)
    • Remove call fails.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
    • Remove call fails with mixed results.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)
  • /subapps/remove-success.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
    • Remove API call works with one app.: FAIL (Chrome: FAIL, Safari: FAIL)
    • Remove API call works with several apps.: NOTRUN (Chrome: NOTRUN, Safari: NOTRUN)

Tests Disabled in Gecko Infrastructure

  • /subapps/add-error.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
  • /subapps/add-success.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
  • /subapps/disabled-by-permissions-policy.tentative.https.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
  • /subapps/idlharness.tentative.https.window.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
  • /subapps/list-error.tentative.https.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
  • /subapps/list-success.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
  • /subapps/remove-error.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)
  • /subapps/remove-success.tentative.https.html [wpt.fyi]: ERROR [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: ERROR, Safari: ERROR)

https://hg.mozilla.org/mozilla-central/rev/fe9accf577f4

Status: NEW → RESOLVED
Closed: 1 month ago
status-firefox155: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 155 Branch
You need to log in before you can comment on or make changes to this bug.