Closed Bug 1746315 Opened 2 years ago Closed 2 years ago

[wpt-sync] Sync PR 32102 - sensors: Split accelerometer tests to avoid flake

Categories

(Core :: DOM: Device Interfaces, task, P4)

task

Tracking

()

RESOLVED FIXED
97 Branch
Tracking Status
firefox97 --- fixed

People

(Reporter: mozilla.org, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 32102 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/32102
Details from upstream follow.

Reilly Grant <reillyg@chromium.org> wrote:

sensors: Split accelerometer tests to avoid flake

The generic sensor test suite can take a long time. This change splits
the tests for the three accelerometer interfaces (Accelerometer,
GravitySensor and LinearAccelerationSensor) into separate test files to
avoid the likelihood that they time out.

Fixed: 833215
Change-Id: I406e71b9da08c36c3495de5029b322c9de039e63
Reviewed-on: https://chromium-review.googlesource.com/3344186
WPT-Export-Revision: e0c122d12aa5aba1dafc182b239102ddf9238c99

Component: web-platform-tests → DOM: Device Interfaces
Product: Testing → Core

CI Results

Ran 11 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 3 tests and 19 subtests

Status Summary

Firefox

FAIL : 9
ERROR : 3
NOTRUN: 48

Chrome

OK : 3
PASS : 54
FAIL : 3

Safari

FAIL : 9
ERROR : 3
NOTRUN: 48

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/accelerometer/Accelerometer.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux1804-64-tsan-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Chrome: OK, Safari: ERROR)
Accelerometer: Test that onerror is sent when sensor is not supported.: FAIL (Chrome: PASS, Safari: FAIL)
Accelerometer: Test that onerror is sent when permissions are not granted.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that onerror is send when start() call has failed.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that frequency is capped to allowed maximum.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that frequency is capped to the maximum supported frequency.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that frequency is limited to the minimum supported frequency.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that sensor cannot be constructed within iframe disallowed to use feature policy.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that sensor can be constructed within an iframe allowed to use feature policy.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that 'onreading' is called and sensor reading is valid.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: sensor reading is correct.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: sensor timestamp is updated when time passes.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that sensor can be successfully created and its states are correct.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: no exception is thrown when calling start() on already started sensor.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: no exception is thrown when calling stop() on already stopped sensor.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: Test that fresh reading is fetched on start().: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: frequency hint works.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
Accelerometer: throw 'TypeError' if frequency is invalid.: FAIL (Chrome: PASS, Safari: FAIL)
Accelerometer: sensor reading is correct when options.referenceFrame is 'screen'.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Accelerometer: throw 'TypeError' if referenceFrame is not one of enumeration values.: FAIL (Chrome: PASS, Safari: FAIL)
/accelerometer/GravitySensor.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux1804-64-tsan-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Chrome: OK, Safari: ERROR)
GravitySensor: Test that onerror is sent when sensor is not supported.: FAIL (Chrome: PASS, Safari: FAIL)
GravitySensor: Test that onerror is sent when permissions are not granted.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that onerror is send when start() call has failed.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that frequency is capped to allowed maximum.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that frequency is capped to the maximum supported frequency.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that frequency is limited to the minimum supported frequency.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that sensor cannot be constructed within iframe disallowed to use feature policy.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that sensor can be constructed within an iframe allowed to use feature policy.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that 'onreading' is called and sensor reading is valid.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: sensor reading is correct.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: sensor timestamp is updated when time passes.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that sensor can be successfully created and its states are correct.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: no exception is thrown when calling start() on already started sensor.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: no exception is thrown when calling stop() on already stopped sensor.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: Test that fresh reading is fetched on start().: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: frequency hint works.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
GravitySensor: throw 'TypeError' if frequency is invalid.: FAIL (Chrome: PASS, Safari: FAIL)
GravitySensor: sensor reading is correct when options.referenceFrame is 'screen'.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
GravitySensor: throw 'TypeError' if referenceFrame is not one of enumeration values.: FAIL (Chrome: PASS, Safari: FAIL)
/accelerometer/LinearAccelerationSensor.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux1804-64-tsan-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Chrome: OK, Safari: ERROR)
LinearAccelerationSensor: Test that onerror is sent when sensor is not supported.: FAIL (Chrome: PASS, Safari: FAIL)
LinearAccelerationSensor: Test that onerror is sent when permissions are not granted.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that onerror is send when start() call has failed.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that frequency is capped to allowed maximum.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that frequency is capped to the maximum supported frequency.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that frequency is limited to the minimum supported frequency.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that sensor cannot be constructed within iframe disallowed to use feature policy.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that sensor can be constructed within an iframe allowed to use feature policy.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that 'onreading' is called and sensor reading is valid.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: sensor reading is correct.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: sensor timestamp is updated when time passes.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that sensor can be successfully created and its states are correct.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: no exception is thrown when calling start() on already started sensor.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: no exception is thrown when calling stop() on already stopped sensor.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: Test that fresh reading is fetched on start().: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: frequency hint works.: NOTRUN (Chrome: PASS, Safari: NOTRUN)
LinearAccelerationSensor: throw 'TypeError' if frequency is invalid.: FAIL (Chrome: PASS, Safari: FAIL)
LinearAccelerationSensor: sensor reading is correct when options.referenceFrame is 'screen'.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
LinearAccelerationSensor: throw 'TypeError' if referenceFrame is not one of enumeration values.: FAIL (Chrome: PASS, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

/accelerometer/Accelerometer.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux1804-64-tsan-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Chrome: OK, Safari: ERROR)
/accelerometer/GravitySensor.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux1804-64-tsan-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Chrome: OK, Safari: ERROR)
/accelerometer/LinearAccelerationSensor.https.html: ERROR [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux1804-64-tsan-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Chrome: OK, Safari: ERROR)

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/55b6b4671459
[wpt PR 32102] - sensors: Split accelerometer tests to avoid flake, a=testonly
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 97 Branch
You need to log in before you can comment on or make changes to this bug.