Closed Bug 1779211 Opened 2 years ago Closed 2 years ago

[wpt-sync] Sync PR 34803 - Add `resultOwnership` tests for `script.evaluate`

Categories

(Testing :: geckodriver, task, P4)

task

Tracking

(firefox104 fixed)

RESOLVED FIXED
104 Branch
Tracking Status
firefox104 --- fixed

People

(Reporter: mozilla.org, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 34803 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/34803
Details from upstream follow.

Maksim Sadym <sadym@google.com> wrote:

Add resultOwnership tests for script.evaluate

Added tests for resultOwnership parameter of script.evaluate: script/evaluate/result_ownership.py

Component: web-platform-tests → geckodriver
Whiteboard: [wptsync downstream] → [wptsync downstream error]
PR 34803 applied with additional changes from upstream: 0453b5346e43e6cd6d7a1c0ba05a7607536ff1b7, 114e6d13139eb06dd4f899b185cb715ed2d84ba9
Whiteboard: [wptsync downstream error] → [wptsync downstream]

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 10 tests and 15 subtests

Status Summary

Firefox

OK : 10
PASS : 137[GitHub] 144[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt]
FAIL : 46[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] 85[GitHub]

Chrome

TIMEOUT: 10

Safari

OK : 10
ERROR : 222

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /webdriver/tests/bidi/script/call_function/call_function.py [wpt.fyi]
    • test_invalid_function: FAIL (Safari: ERROR)
    • test_arguments: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_this: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_default_this: FAIL (Safari: ERROR)
    • test_remote_value_argument: FAIL (Safari: ERROR)
    • test_async_arrow_await_promise[False]: FAIL (Safari: ERROR)
    • test_async_classic_await_promise[False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/invalid.py [wpt.fyi]
    • test_params_realm_unknown: FAIL (Safari: ERROR)
    • test_params_this_invalid_type[False]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_this_invalid_type[SOME_STRING]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_this_invalid_type[42]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_this_invalid_type[this3]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_this_invalid_type[this4]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_single_argument_invalid_type[False]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_single_argument_invalid_type[SOME_STRING]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_single_argument_invalid_type[42]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_single_argument_invalid_type[argument3]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
    • test_params_single_argument_invalid_type[argument4]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/result.py [wpt.fyi]
    • test_primitive_values[Infinity-expected6]: FAIL (Safari: ERROR)
    • test_remote_values[(Symbol('foo'))-expected0]: FAIL (Safari: ERROR)
    • test_remote_values[({'foo': {'bar': 'baz'}, 'qux': 'quux'})-expected2]: FAIL (Safari: ERROR)
    • test_remote_values[(()=>{})-expected3]: FAIL (Safari: ERROR)
    • test_remote_values[(function(){})-expected4]: FAIL (Safari: ERROR)
    • test_remote_values[(async ()=>{})-expected5]: FAIL (Safari: ERROR)
    • test_remote_values[(async function(){})-expected6]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakMap()-expected11]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakSet()-expected12]: FAIL (Safari: ERROR)
    • test_remote_values[new Error('SOME_ERROR_TEXT')-expected13]: FAIL (Safari: ERROR)
    • test_remote_values[Promise.resolve()-expected14]: FAIL (Safari: ERROR)
    • test_remote_values[new Int32Array()-expected15]: FAIL (Safari: ERROR)
    • test_remote_values[new ArrayBuffer()-expected16]: FAIL (Safari: ERROR)
    • test_remote_values[document.createElement('div')-expected17]: FAIL (Safari: ERROR)
    • test_remote_values[window-expected18]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/result_ownership.py [wpt.fyi]
    • test_throw_exception[root-True]: FAIL (Safari: ERROR)
    • test_throw_exception[none-False]: FAIL (Safari: ERROR)
    • test_throw_exception[None-False]: FAIL (Safari: ERROR)
    • test_invalid_script[root-True]: FAIL (Safari: ERROR)
    • test_invalid_script[none-False]: FAIL (Safari: ERROR)
    • test_invalid_script[None-False]: FAIL (Safari: ERROR)
    • test_rejected_promise[root-True]: FAIL (Safari: ERROR)
    • test_rejected_promise[none-False]: FAIL (Safari: ERROR)
    • test_rejected_promise[None-False]: FAIL (Safari: ERROR)
    • test_return_value[root-True-True]: FAIL (Safari: ERROR)
    • test_return_value[root-True-False]: FAIL (Safari: ERROR)
    • test_return_value[none-False-True]: FAIL (Safari: ERROR)
    • test_return_value[none-False-False]: FAIL (Safari: ERROR)
    • test_return_value[None-False-True]: FAIL (Safari: ERROR)
    • test_return_value[None-False-False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/await_promise.py [wpt.fyi]
    • test_await_resolve_primitive[Infinity-Infinity-number]: FAIL (Safari: ERROR)
    • test_no_await_promise_rejected: FAIL (Safari: ERROR)
    • test_no_await_promise_resolved: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/exception_details.py [wpt.fyi]
    • test_invalid_script: FAIL (Safari: ERROR)
    • test_reject_error: FAIL (Safari: ERROR)
    • test_throw_error: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/invalid.py [wpt.fyi]
    • test_params_realm_unknown: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/result.py [wpt.fyi]
    • test_primitive_values[Infinity-expected6]: FAIL (Safari: ERROR)
    • test_remote_values[object]: FAIL
    • test_remote_values[(Symbol('foo'))-expected0]: FAIL (Safari: ERROR)
    • test_remote_values[({'foo': {'bar': 'baz'}, 'qux': 'quux'})-expected2]: FAIL (Safari: ERROR)
    • test_remote_values[(()=>{})-expected3]: FAIL (Safari: ERROR)
    • test_remote_values[(function(){})-expected4]: FAIL (Safari: ERROR)
    • test_remote_values[(async ()=>{})-expected5]: FAIL (Safari: ERROR)
    • test_remote_values[(async function(){})-expected6]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakMap()-expected11]: FAIL (Safari: ERROR)
    • test_remote_values[new WeakSet()-expected12]: FAIL (Safari: ERROR)
    • test_remote_values[new Error('SOME_ERROR_TEXT')-expected13]: FAIL (Safari: ERROR)
    • test_remote_values[Promise.resolve()-expected14]: FAIL (Safari: ERROR)
    • test_remote_values[new Int32Array()-expected15]: FAIL (Safari: ERROR)
    • test_remote_values[new ArrayBuffer()-expected16]: FAIL (Safari: ERROR)
    • test_remote_values[document.createElement('div')-expected17]: FAIL (Safari: ERROR)
    • test_remote_values[window-expected18]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/result_ownership.py [wpt.fyi]
    • test_throw_exception[root-True]: FAIL (Safari: ERROR)
    • test_throw_exception[none-False]: FAIL (Safari: ERROR)
    • test_throw_exception[None-False]: FAIL (Safari: ERROR)
    • test_invalid_script[root-True]: FAIL (Safari: ERROR)
    • test_invalid_script[none-False]: FAIL (Safari: ERROR)
    • test_invalid_script[None-False]: FAIL (Safari: ERROR)
    • test_rejected_promise[root-True]: FAIL (Safari: ERROR)
    • test_rejected_promise[none-False]: FAIL (Safari: ERROR)
    • test_rejected_promise[None-False]: FAIL (Safari: ERROR)
    • test_return_value[root-True-True]: FAIL (Safari: ERROR)
    • test_return_value[root-True-False]: FAIL (Safari: ERROR)
    • test_return_value[none-False-True]: FAIL (Safari: ERROR)
    • test_return_value[none-False-False]: FAIL (Safari: ERROR)
    • test_return_value[None-False-True]: FAIL (Safari: ERROR)
    • test_return_value[None-False-False]: FAIL (Safari: ERROR)
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/e66a5be46f58
[wpt PR 34803] - Add `resultOwnership` tests for `script.evaluate`, a=testonly
https://hg.mozilla.org/integration/autoland/rev/341f20140e72
[wpt PR 34803] - Update wpt metadata, a=testonly
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 104 Branch
You need to log in before you can comment on or make changes to this bug.