Closed Bug 1634232 Opened 9 months ago Closed 8 months ago

[wpt-sync] Sync PR 23332 - Clipboard API Tests: Automate Web Platform Tests

Categories

(Core :: DOM: Core & HTML, task, P4)

Product:
Core
Component:
DOM: Core & HTML
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
mozilla78
Tracking Flags:
Tracking Status
firefox78 --- fixed

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 23332 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/23332
Details from upstream follow.

Darwin Huang <huangdarwin@chromium.org> wrote:

Clipboard API Tests: Automate Web Platform Tests

Since https://github.com/web-platform-tests/wpt/pull/20461 and
https://github.com/web-platform-tests/wpt/issues/5671 were fixed, it now
becomes possible to automate some Web Platform Tests, and have them run
on all browsers automatically.

Clipboard API tests previously were duplicated in non-WPT in order to automate
them via PermissionsHelper and detect regressions.

This allows us to shed a lot of duplicate tests, as well as a difficult-to-remember
process of remembering to update both test suites when changes were made.

Bug: 1076691
Change-Id: Ibdfdf37e75da68d7a4b1e2ba986e4198b73230ac

Reviewed-on: https://chromium-review.googlesource.com/2065346
WPT-Export-Revision: a1f40b1d82adc76609e655dfa4afa93a0c01f144

Component: web-platform-tests → DOM: Core & HTML
Product: Testing → Core
Status: NEW → RESOLVED
Closed: 9 months ago
Resolution: --- → INVALID
Status: RESOLVED → REOPENED
Resolution: INVALID → ---

CI Results

Ran 12 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 79 tests

Status Summary

Firefox

PASS : 71
FAIL : 12[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 15[GitHub]
TIMEOUT: 1
ERROR : 10

Chrome

OK : 9
PASS : 14
TIMEOUT: 2

Safari

PASS : 2
FAIL : 13
ERROR : 10

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

/clipboard-apis/detached-iframe/read-on-detaching-iframe.https.html
Verify read fails on detaching iframe: FAIL
/clipboard-apis/detached-iframe/write-on-detaching-iframe.https.html
Verify write fails on detaching iframe: FAIL

New Tests That Don't Pass

/clipboard-apis/text-write-read/async-writeText-read.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify write and read clipboard given text: Clipboard write text -> read ([text/plain ClipboardItem]) test: FAIL (Chrome: PASS, Safari: FAIL)
Verify write and read clipboard given text: non-Latin1 text encoding test データ: FAIL (Chrome: PASS, Safari: FAIL)
/clipboard-apis/text-write-read/async-write-read.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify write and read clipboard given text: Clipboard write ([text/plain ClipboardItem]) -> read ([text/plain ClipboardItem]) test: FAIL (Chrome: PASS, Safari: FAIL)
Verify write and read clipboard given text: non-Latin1 text encoding test データ: FAIL (Chrome: PASS, Safari: FAIL)
/clipboard-apis/text-write-read/async-writeText-readText.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify write and read clipboard given text: non-Latin1 text encoding test データ: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
Verify write and read clipboard given text: Clipboard write text -> read text test: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
/clipboard-apis/text-write-read/async-write-readText.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify write and read clipboard given text: Clipboard write ([text/plain ClipboardItem) -> read text test: FAIL (Chrome: PASS, Safari: FAIL)
Verify write and read clipboard given text: non-Latin1 text encoding test データ: FAIL (Chrome: PASS, Safari: FAIL)
/clipboard-apis/detached-iframe/read-on-detaching-iframe.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify read fails on detaching iframe: FAIL (Chrome: PASS, Safari: PASS)
/clipboard-apis/detached-iframe/writeText-readText-on-detached-iframe.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify readText and writeText fails on detached iframe: FAIL [GitHub], TIMEOUT [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
/clipboard-apis/detached-iframe/write-read-on-detached-iframe.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify read and write fail on detached iframe: FAIL (Chrome: PASS, Safari: FAIL)
/clipboard-apis/async-write-image-read-image.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify write error on malformed data [image/png ClipboardItem]: FAIL (Chrome: PASS, Safari: FAIL)
Verify write and read clipboard [image/png Blob]: FAIL (Chrome: PASS, Safari: FAIL)
/clipboard-apis/detached-iframe/write-on-detaching-iframe.https.html: ERROR (Chrome: OK, Safari: ERROR)
Verify write fails on detaching iframe: FAIL (Chrome: PASS, Safari: PASS)
/clipboard-apis/async-write-blobs-read-blobs.https.html: ERROR (Chrome: TIMEOUT, Safari: ERROR)
Verify write and read clipboard (multiple types): FAIL (Chrome: TIMEOUT, Safari: FAIL)

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/933f09e8d1c5
[wpt PR 23332] - Clipboard API Tests: Automate Web Platform Tests, a=testonly
https://hg.mozilla.org/integration/autoland/rev/dbaa870ef34d
[wpt PR 23332] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/933f09e8d1c5
https://hg.mozilla.org/mozilla-central/rev/dbaa870ef34d

Status: REOPENED → RESOLVED
Closed: 9 months ago → 8 months ago
status-firefox78: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla78
You need to log in before you can comment on or make changes to this bug.