Open Bug 1663008 Opened 4 years ago Updated 4 years ago

[wpt-sync] Sync PR 25381 - WPT: Refactor shape-detection tests to use test-only-api.js

Categories

(Testing :: web-platform-tests, task, P4)

Product:
Testing
Component:
web-platform-tests
Type:
task

Tracking

(Not tracked)

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 25381 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/25381
Details from upstream follow.

b'Arnaud Mandy <arnaud.mandy@intel.com>' wrote:

WPT: Refactor shape-detection tests to use test-only-api.js

use of test-only-api.js in preparation for launching official MojoJS support
in WPT. This would not change the test results on Chromium waterfall
(everything should continue to pass) or upstream WPT (tests currently
fail because MojoJS isn't enabled).

Bug: 1123993
Change-Id: I38a1ad092a6eb9229d5c6be27bc670c89f6ef6cd

Reviewed-on: https://chromium-review.googlesource.com/2391230
WPT-Export-Revision: 510cc9b82262cd3c3a46afc0ac92050bea5841e3

CI Results

Ran 12 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 12 tests and 3 subtests

Status Summary

Firefox

OK : 1
FAIL : 34
TIMEOUT: 1
ERROR : 11
NOTRUN : 5

Chrome

OK : 2
PASS : 6
FAIL : 34
ERROR : 10

Safari

OK : 1
FAIL : 34
TIMEOUT: 1
ERROR : 11
NOTRUN : 5

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/shape-detection/detected-boundingBox-read-only.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - detectedFace.boundingBox should be DOMRectReadOnly: FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detectedBarcode.boundingBox should be DOMRectReadOnly: FAIL (Chrome: FAIL, Safari: FAIL)
Text - detectedText.boundingBox should be DOMRectReadOnly: FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detected-postMessage.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - DetectedFace can be passed to postMessage(): FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - DetectedBarcode can be passed to postMessage(): FAIL (Chrome: FAIL, Safari: FAIL)
Text - DetectedText can be passed to postMessage(): FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-HTMLCanvasElement.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - detect(HTMLCanvasElement): FAIL (Chrome: FAIL, Safari: FAIL)
Face - detect(OffscreenCanvas): FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detect(HTMLCanvasElement): FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detect(OffscreenCanvas): FAIL (Chrome: FAIL, Safari: FAIL)
Text - detect(HTMLCanvasElement): FAIL (Chrome: FAIL, Safari: FAIL)
Text - detect(OffscreenCanvas): FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-HTMLImageElement.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - detect(HTMLImageElement): FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detect(HTMLImageElement): FAIL (Chrome: FAIL, Safari: FAIL)
Text - detect(HTMLImageElement): FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-HTMLVideoElement.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - detect(HTMLVideoElement): FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detect(HTMLVideoElement): FAIL (Chrome: FAIL, Safari: FAIL)
Text - detect(HTMLVideoElement): FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-ImageBitmap.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - detect(ImageBitmap): FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detect(ImageBitmap): FAIL (Chrome: FAIL, Safari: FAIL)
Text - detect(ImageBitmap): FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-ImageData.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - detect(ImageData): FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detect(ImageData): FAIL (Chrome: FAIL, Safari: FAIL)
Text - detect(ImageData): FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-getSupportedFormats.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
get supported barcode formats: FAIL (Chrome: FAIL, Safari: FAIL)
getSupportedFormats() resolves with empty list when unsupported: FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-on-worker.https.worker.html: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)
Face Detector detect(ImageBitmap) on worker: FAIL (Chrome: FAIL, Safari: FAIL)
Barcode Detector detect(ImageBitmap) on worker: FAIL (Chrome: FAIL, Safari: FAIL)
Text Detector detect(ImageBitmap) on worker: FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-options.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Test that FaceDetectionOptions are correctly propagated: FAIL (Chrome: FAIL, Safari: FAIL)
Test that BarcodeDetectorOptions are correctly propagated: FAIL (Chrome: FAIL, Safari: FAIL)
/shape-detection/detection-security-test.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: ERROR)
Face - detect(broken image): TIMEOUT (Chrome: PASS, Safari: TIMEOUT)
Barcode - detect(broken image): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Text - detect(broken image): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Face - detect(broken video): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Barcode - detect(broken video): NOTRUN (Chrome: PASS, Safari: NOTRUN)
Text - detect(broken video): NOTRUN (Chrome: PASS, Safari: NOTRUN)
/shape-detection/detector-same-object.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
Face - detect(ImageData), [SameObject]: FAIL (Chrome: FAIL, Safari: FAIL)
Barcode - detect(ImageData), [SameObject]: FAIL (Chrome: FAIL, Safari: FAIL)
Text - detect(ImageData), [SameObject]: FAIL (Chrome: FAIL, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

/shape-detection/detected-boundingBox-read-only.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detected-postMessage.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-HTMLCanvasElement.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-HTMLImageElement.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-HTMLVideoElement.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-ImageBitmap.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-ImageData.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-getSupportedFormats.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-on-worker.https.worker.html: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)
/shape-detection/detection-options.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)
/shape-detection/detection-security-test.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: ERROR)
/shape-detection/detector-same-object.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-debug-geckoview, Gecko-android-em-7.0-x86_64-opt-geckoview, Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: ERROR, Safari: ERROR)

You need to log in before you can comment on or make changes to this bug.