Closed Bug 1616610 Opened 4 years ago Closed 4 years ago

[wpt-sync] Sync PR 21881 - Split html/.../query-encoding/ tests

Categories

(Core :: DOM: Core & HTML, task, P4)

Product:
Core
Component:
DOM: Core & HTML
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
mozilla75
Tracking Flags:
Tracking Status
firefox75 --- fixed

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 21881 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/21881
Details from upstream follow.

Joshua Bell <jsbell@chromium.org> wrote:

Split html/.../query-encoding/ tests

These tests cover 5 encodings (UTF-8, UTF-16LE/BE, Windows-1251/1252)
and exercise many features (HTML, CSS, SVG, Workers, ...). They're
currently all skipped in Chrome (and other browser CI systems), since
something in that huge matrix fails or times out for everyone.

https://github.com/web-platform-tests/wpt/issues/4934 suggests
splitting these into separate files. As a stopgap, split them out
using the WPT "variant" mechanism and provide expected failure files
for subsets, which should make fixing the tests and/or browsers more
actionable, and let us catch new regressions.

Bug: 930297
Change-Id: I4813281f547216b2b5f377118a58a419f62cfbc7
Reviewed-on: https://chromium-review.googlesource.com/2063808
WPT-Export-Revision: 9275b2e75b141ec9aabc8283b9a794ddfd8d3b64

Component: web-platform-tests → DOM: Core & HTML
Product: Testing → Core

CI Results

Ran 13 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 134 tests and 2 subtests

Status Summary

Firefox

OK : 88[Gecko-windows10-64-debug, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 89[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-windows10-64-qr-debug] 90[Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-opt, Gecko-windows10-64-qr-opt, GitHub]
PASS : 433[GitHub] 475[Gecko-windows10-64-debug, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 476[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-windows10-64-qr-debug] 477[Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-opt, Gecko-windows10-64-qr-opt]
FAIL : 57
TIMEOUT: 10[Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-opt, Gecko-windows10-64-qr-opt, GitHub] 12[Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-windows10-64-qr-debug] 14[Gecko-windows10-64-debug, Gecko-windows7-32-debug, Gecko-windows7-32-opt]

Chrome

OK : 88
PASS : 372
FAIL : 106
TIMEOUT: 22
ERROR : 2

Safari

OK : 78
PASS : 347
FAIL : 92
TIMEOUT: 71
ERROR : 2

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=eventsource
EventSource constructor: FAIL
EventSource#url: FAIL
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=window-open
window.open(): FAIL
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=eventsource
EventSource constructor: FAIL
EventSource#url: FAIL
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=scheme
Scheme ssh (getting <a>.href): FAIL
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=scheme
Scheme ssh (getting <a>.href): FAIL
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=window-open
window.open(): FAIL

New Tests That Don't Pass

/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=eventsource
EventSource constructor: FAIL (Chrome: PASS, Safari: PASS)
EventSource#url: FAIL (Chrome: PASS, Safari: PASS)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=history
history.pushState: FAIL (Chrome: FAIL, Safari: FAIL)
history.replaceState: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16be.html?include=appcache
Parsing cache manifest (CACHE): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
Parsing cache manifest (FALLBACK): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-8.html?include=workers
SharedWorker() in a shared worker: FAIL (Chrome: FAIL, Safari: FAIL)
importScripts() in a shared worker: FAIL (Chrome: FAIL, Safari: FAIL)
SharedWorker() in a dedicated worker: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=xml
<?xml-stylesheet?> (CSS): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16be.html?include=workers: OK [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt, GitHub], TIMEOUT [Gecko-windows10-64-qr-debug] (Chrome: ERROR, Safari: ERROR)
SharedWorker() in a shared worker: FAIL (Chrome: TIMEOUT, Safari: FAIL)
importScripts() in a shared worker: FAIL (Chrome: TIMEOUT, Safari: FAIL)
SharedWorker constructor: PASS [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt, GitHub], TIMEOUT [Gecko-windows10-64-qr-debug] (Chrome: PASS, Safari: FAIL)
SharedWorker() in a dedicated worker: FAIL (Chrome: TIMEOUT, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=xhr
XMLHttpRequest#open(): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16be.html?include=history
history.pushState: FAIL (Chrome: FAIL, Safari: FAIL)
history.replaceState: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-8.html?include=xmldocument
XMLDocument#load(): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=window-open
window.open(): FAIL (Chrome: PASS, Safari: PASS)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=eventsource
EventSource constructor: FAIL (Chrome: PASS, Safari: PASS)
EventSource#url: FAIL (Chrome: PASS, Safari: PASS)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=workers: OK [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-opt, GitHub], TIMEOUT [Gecko-linux1804-64-debug, Gecko-windows10-64-debug, Gecko-windows7-32-debug] (Chrome: OK, Safari: OK)
SharedWorker() in a shared worker: FAIL (Chrome: FAIL, Safari: FAIL)
importScripts() in a shared worker: FAIL (Chrome: FAIL, Safari: FAIL)
SharedWorker constructor: PASS [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-opt, GitHub], TIMEOUT [Gecko-linux1804-64-debug, Gecko-windows10-64-debug, Gecko-windows7-32-debug] (Chrome: PASS, Safari: FAIL)
SharedWorker() in a dedicated worker: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=xmldocument
XMLDocument#load(): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16le.html?include=appcache
Parsing cache manifest (CACHE): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
Parsing cache manifest (FALLBACK): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16le.html?include=xmldocument
XMLDocument#load(): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-8.html?include=appcache
Parsing cache manifest (CACHE): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
Parsing cache manifest (FALLBACK): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-8.html?include=history
history.pushState: FAIL (Chrome: FAIL, Safari: FAIL)
history.replaceState: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=workers: OK [Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, GitHub], TIMEOUT [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-windows10-64-debug, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)
SharedWorker() in a shared worker: FAIL (Chrome: FAIL, Safari: FAIL)
importScripts() in a shared worker: FAIL (Chrome: FAIL, Safari: FAIL)
SharedWorker constructor: PASS [Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, GitHub], TIMEOUT [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-windows10-64-debug, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
SharedWorker() in a dedicated worker: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=scheme
Scheme gopher (getting <a>.href): FAIL (Chrome: FAIL, Safari: FAIL)
Scheme ws (getting <a>.href): FAIL (Chrome: FAIL, Safari: PASS)
Scheme ssh (getting <a>.href): FAIL (Chrome: PASS, Safari: PASS)
Scheme wss (getting <a>.href): FAIL (Chrome: FAIL, Safari: PASS)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=xhr
XMLHttpRequest#open(): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16le.html?include=workers: OK [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, GitHub], TIMEOUT [Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
SharedWorker() in a shared worker: FAIL (Chrome: TIMEOUT, Safari: FAIL)
importScripts() in a shared worker: FAIL (Chrome: TIMEOUT, Safari: FAIL)
SharedWorker constructor: PASS [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-asan-opt, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, GitHub], TIMEOUT [Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
SharedWorker() in a dedicated worker: FAIL (Chrome: TIMEOUT, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=xml
<?xml-stylesheet?> (CSS): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=history
history.pushState: FAIL (Chrome: FAIL, Safari: FAIL)
history.replaceState: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=scheme
Scheme gopher (getting <a>.href): FAIL (Chrome: FAIL, Safari: FAIL)
Scheme ws (getting <a>.href): FAIL (Chrome: FAIL, Safari: PASS)
Scheme ssh (getting <a>.href): FAIL (Chrome: PASS, Safari: PASS)
Scheme wss (getting <a>.href): FAIL (Chrome: FAIL, Safari: PASS)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=loading
loading video <audio><source>: FAIL (Chrome: FAIL, Safari: TIMEOUT)
loading image <input src>: FAIL (Chrome: FAIL, Safari: FAIL)
loading image <object data>: FAIL (Chrome: FAIL, Safari: TIMEOUT)
loading video <audio>: FAIL (Chrome: FAIL, Safari: TIMEOUT)
loading video <video>: FAIL (Chrome: FAIL, Safari: TIMEOUT)
loading image <img src>: FAIL (Chrome: FAIL, Safari: FAIL)
loading video <video><source>: FAIL (Chrome: FAIL, Safari: TIMEOUT)
loading image <video poster>: FAIL (Chrome: FAIL, Safari: FAIL)
loading image <embed src>: FAIL (Chrome: FAIL, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1252.html?include=appcache
Parsing cache manifest (CACHE): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
Parsing cache manifest (FALLBACK): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16le.html?include=history
history.pushState: FAIL (Chrome: FAIL, Safari: FAIL)
history.replaceState: FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=window-open
window.open(): FAIL (Chrome: PASS, Safari: PASS)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=xmldocument
XMLDocument#load(): FAIL (Chrome: FAIL, Safari: FAIL)
/html/infrastructure/urls/resolving-urls/query-encoding/windows-1251.html?include=appcache
Parsing cache manifest (CACHE): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
Parsing cache manifest (FALLBACK): TIMEOUT (Chrome: TIMEOUT, Safari: TIMEOUT)
/html/infrastructure/urls/resolving-urls/query-encoding/utf-16be.html?include=xmldocument
XMLDocument#load(): FAIL (Chrome: FAIL, Safari: FAIL)

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/cc3538c8a2d4
[wpt PR 21881] - Split html/.../query-encoding/ tests, a=testonly
https://hg.mozilla.org/integration/autoland/rev/0c7f8f07b238
[wpt PR 21881] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/cc3538c8a2d4
https://hg.mozilla.org/mozilla-central/rev/0c7f8f07b238

Status: NEW → RESOLVED
Closed: 4 years ago
status-firefox75: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla75
You need to log in before you can comment on or make changes to this bug.