Closed Bug 1784460 Opened 2 years ago Closed 2 years ago

[wpt-sync] Sync PR 35448 - Test `Script.evaluate` and `Script.callFunction` with strict mode

Categories

(Testing :: geckodriver, task, P4)

Product:
Testing
Component:
geckodriver
Type:
task

Tracking

(firefox106 fixed)

Status:
RESOLVED FIXED
Milestone:
106 Branch
Tracking Flags:
Tracking Status
firefox106 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(Depends on 1 open bug,
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 35448 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/35448
Details from upstream follow.

Maksim Sadym <sadym@google.com> wrote:

Test Script.evaluate and Script.callFunction with strict mode

Component: web-platform-tests → geckodriver

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 15 tests and 1 subtests

Status Summary

Firefox

OK : 15
PASS : 278
FAIL : 120

Chrome

TIMEOUT: 15

Safari

OK : 15
ERROR : 398

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /webdriver/tests/bidi/script/call_function/await_promise.py [wpt.fyi]
    • test_await_promise_delayed[False]: FAIL (Safari: ERROR)
    • test_await_promise_async_arrow[False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/call_function.py [wpt.fyi]
    • test_default_this: FAIL (Safari: ERROR)
    • test_remote_value_argument: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/exception_details.py [wpt.fyi]
    • test_invalid_function: FAIL (Safari: ERROR)
    • test_exception_details[(Symbol('foo'))-expected13-True]: FAIL (Safari: ERROR)
    • test_exception_details[(Symbol('foo'))-expected13-False]: FAIL (Safari: ERROR)
    • test_exception_details[(()=>{})-expected16-True]: FAIL (Safari: ERROR)
    • test_exception_details[(()=>{})-expected16-False]: FAIL (Safari: ERROR)
    • test_exception_details[(function(){})-expected17-True]: FAIL (Safari: ERROR)
    • test_exception_details[(function(){})-expected17-False]: FAIL (Safari: ERROR)
    • test_exception_details[(async ()=>{})-expected18-True]: FAIL (Safari: ERROR)
    • test_exception_details[(async ()=>{})-expected18-False]: FAIL (Safari: ERROR)
    • test_exception_details[(async function(){})-expected19-True]: FAIL (Safari: ERROR)
    • test_exception_details[(async function(){})-expected19-False]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakMap()-expected24-True]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakMap()-expected24-False]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakSet()-expected25-True]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakSet()-expected25-False]: FAIL (Safari: ERROR)
    • test_exception_details[new Error('SOME_ERROR_TEXT')-expected26-True]: FAIL (Safari: ERROR)
    • test_exception_details[new Error('SOME_ERROR_TEXT')-expected26-False]: FAIL (Safari: ERROR)
    • test_exception_details[Promise.resolve()-expected27-True]: FAIL (Safari: ERROR)
    • test_exception_details[Promise.resolve()-expected27-False]: FAIL (Safari: ERROR)
    • test_exception_details[new Int32Array()-expected28-True]: FAIL (Safari: ERROR)
    • test_exception_details[new Int32Array()-expected28-False]: FAIL (Safari: ERROR)
    • test_exception_details[new ArrayBuffer()-expected29-True]: FAIL (Safari: ERROR)
    • test_exception_details[new ArrayBuffer()-expected29-False]: FAIL (Safari: ERROR)
    • test_exception_details[document.createElement('div')-expected30-True]: FAIL (Safari: ERROR)
    • test_exception_details[document.createElement('div')-expected30-False]: FAIL (Safari: ERROR)
    • test_exception_details[window-expected31-True]: FAIL (Safari: ERROR)
    • test_exception_details[window-expected31-False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/invalid.py [wpt.fyi]
    • test_params_realm_unknown: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/result.py [wpt.fyi]
    • test_remote_values[(Symbol('foo'))-expected0-True]: FAIL (Safari: ERROR)
    • test_remote_values[(Symbol('foo'))-expected0-False]: FAIL (Safari: ERROR)
    • test_remote_values[(()=>{})-expected3-True]: FAIL (Safari: ERROR)
    • test_remote_values[(()=>{})-expected3-False]: FAIL (Safari: ERROR)
    • test_remote_values[(function(){})-expected4-True]: FAIL (Safari: ERROR)
    • test_remote_values[(function(){})-expected4-False]: FAIL (Safari: ERROR)
    • test_remote_values[(async ()=>{})-expected5-True]: FAIL (Safari: ERROR)
    • test_remote_values[(async ()=>{})-expected5-False]: FAIL (Safari: ERROR)
    • test_remote_values[(async function(){})-expected6-True]: FAIL (Safari: ERROR)
    • test_remote_values[(async function(){})-expected6-False]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakMap()-expected11-True]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakMap()-expected11-False]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakSet()-expected12-True]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakSet()-expected12-False]: FAIL (Safari: ERROR)
    • test_remote_values[new Error('SOME_ERROR_TEXT')-expected13-True]: FAIL (Safari: ERROR)
    • test_remote_values[new Error('SOME_ERROR_TEXT')-expected13-False]: FAIL (Safari: ERROR)
    • test_remote_values[new Int32Array()-expected14-True]: FAIL (Safari: ERROR)
    • test_remote_values[new Int32Array()-expected14-False]: FAIL (Safari: ERROR)
    • test_remote_values[new ArrayBuffer()-expected15-True]: FAIL (Safari: ERROR)
    • test_remote_values[new ArrayBuffer()-expected15-False]: FAIL (Safari: ERROR)
    • test_remote_values[document.createElement('div')-expected16-True]: FAIL (Safari: ERROR)
    • test_remote_values[document.createElement('div')-expected16-False]: FAIL (Safari: ERROR)
    • test_remote_values[window-expected17-True]: FAIL (Safari: ERROR)
    • test_remote_values[window-expected17-False]: FAIL (Safari: ERROR)
    • test_remote_value_promise_no_await: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/result_ownership.py [wpt.fyi]
    • test_throw_exception[root-True]: FAIL (Safari: ERROR)
    • test_invalid_script[root-True]: FAIL (Safari: ERROR)
    • test_invalid_script[none-False]: FAIL (Safari: ERROR)
    • test_invalid_script[None-False]: FAIL (Safari: ERROR)
    • test_rejected_promise[root-True]: FAIL (Safari: ERROR)
    • test_return_value[root-True-True]: FAIL (Safari: ERROR)
    • test_return_value[root-True-False]: FAIL (Safari: ERROR)
    • test_return_value[none-False-False]: FAIL (Safari: ERROR)
    • test_return_value[None-False-False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/strict_mode.py [wpt.fyi]
    • test_strict_mode: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/await_promise.py [wpt.fyi]
    • test_no_await_promise_rejected: FAIL (Safari: ERROR)
    • test_no_await_promise_resolved: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/exception_details.py [wpt.fyi]
    • test_invalid_script: FAIL (Safari: ERROR)
    • test_exception_details[(Symbol('foo'))-expected13-True]: FAIL (Safari: ERROR)
    • test_exception_details[(Symbol('foo'))-expected13-False]: FAIL (Safari: ERROR)
    • test_exception_details[(()=>{})-expected16-True]: FAIL (Safari: ERROR)
    • test_exception_details[(()=>{})-expected16-False]: FAIL (Safari: ERROR)
    • test_exception_details[(function(){})-expected17-True]: FAIL (Safari: ERROR)
    • test_exception_details[(function(){})-expected17-False]: FAIL (Safari: ERROR)
    • test_exception_details[(async ()=>{})-expected18-True]: FAIL (Safari: ERROR)
    • test_exception_details[(async ()=>{})-expected18-False]: FAIL (Safari: ERROR)
    • test_exception_details[(async function(){})-expected19-True]: FAIL (Safari: ERROR)
    • test_exception_details[(async function(){})-expected19-False]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakMap()-expected24-True]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakMap()-expected24-False]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakSet()-expected25-True]: FAIL (Safari: ERROR)
    • test_exception_details[new WeakSet()-expected25-False]: FAIL (Safari: ERROR)
    • test_exception_details[new Error('SOME_ERROR_TEXT')-expected26-True]: FAIL (Safari: ERROR)
    • test_exception_details[new Error('SOME_ERROR_TEXT')-expected26-False]: FAIL (Safari: ERROR)
    • test_exception_details[Promise.resolve()-expected27-True]: FAIL (Safari: ERROR)
    • test_exception_details[Promise.resolve()-expected27-False]: FAIL (Safari: ERROR)
    • test_exception_details[new Int32Array()-expected28-True]: FAIL (Safari: ERROR)
    • test_exception_details[new Int32Array()-expected28-False]: FAIL (Safari: ERROR)
    • test_exception_details[new ArrayBuffer()-expected29-True]: FAIL (Safari: ERROR)
    • test_exception_details[new ArrayBuffer()-expected29-False]: FAIL (Safari: ERROR)
    • test_exception_details[document.createElement('div')-expected30-True]: FAIL (Safari: ERROR)
    • test_exception_details[document.createElement('div')-expected30-False]: FAIL (Safari: ERROR)
    • test_exception_details[window-expected31-True]: FAIL (Safari: ERROR)
    • test_exception_details[window-expected31-False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/invalid.py [wpt.fyi]
    • test_params_realm_unknown: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/result.py [wpt.fyi]
    • test_remote_values[(Symbol('foo'))-expected0]: FAIL (Safari: ERROR)
    • test_remote_values[(()=>{})-expected3]: FAIL (Safari: ERROR)
    • test_remote_values[(function(){})-expected4]: FAIL (Safari: ERROR)
    • test_remote_values[(async ()=>{})-expected5]: FAIL (Safari: ERROR)
    • test_remote_values[(async function(){})-expected6]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakMap()-expected11]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakSet()-expected12]: FAIL (Safari: ERROR)
    • test_remote_values[new Error('SOME_ERROR_TEXT')-expected13]: FAIL (Safari: ERROR)
    • test_remote_values[Promise.resolve()-expected14]: FAIL (Safari: ERROR)
    • test_remote_values[new Int32Array()-expected15]: FAIL (Safari: ERROR)
    • test_remote_values[new ArrayBuffer()-expected16]: FAIL (Safari: ERROR)
    • test_remote_values[document.createElement('div')-expected17]: FAIL (Safari: ERROR)
    • test_remote_values[window-expected18]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/result_ownership.py [wpt.fyi]
    • test_throw_exception[root-True]: FAIL (Safari: ERROR)
    • test_invalid_script[root-True]: FAIL (Safari: ERROR)
    • test_invalid_script[none-False]: FAIL (Safari: ERROR)
    • test_invalid_script[None-False]: FAIL (Safari: ERROR)
    • test_rejected_promise[root-True]: FAIL (Safari: ERROR)
    • test_return_value[root-True-True]: FAIL (Safari: ERROR)
    • test_return_value[root-True-False]: FAIL (Safari: ERROR)
    • test_return_value[none-False-False]: FAIL (Safari: ERROR)
    • test_return_value[None-False-False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/strict_mode.py [wpt.fyi]
    • test_strict_mode: FAIL (Safari: ERROR)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/8a4b2a98452f [wpt PR 35448] - Test `Script.evaluate` and `Script.callFunction` with strict mode, a=testonly https://hg.mozilla.org/integration/autoland/rev/dcc94f818fd5 [wpt PR 35448] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/8a4b2a98452f
https://hg.mozilla.org/mozilla-central/rev/dcc94f818fd5

Status: NEW → RESOLVED
Closed: 2 years ago
status-firefox106: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 106 Branch
You need to log in before you can comment on or make changes to this bug.