1821887 - [wpt-sync] Sync PR 38948 - Increase timeout and add retries to loaf tests

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 38948 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/38948
Details from upstream follow.

Noam Rosenthal <[e-mail]> wrote:

Increase timeout and add retries to loaf tests

LoAF tests cover timing related issues and rely on
threaded compositingm so they are a bit brittle timing-wise
by definition.

Increasing timeout and retrying on failure to filter out
flakiness and noise.

Bug: 1422630
Change-Id: I8643f7080f4f9db8d4adb2317cd3ff213de0ba00
Reviewed-on: https://chromium-review.googlesource.com/4332476
WPT-Export-Revision: e3d428ca3e54ff34e5502194147e8684dee95dbf

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

PR 38948 applied with additional changes from upstream: b8e9469a49469720bb72a078c4ecde798daa70f5, b147fc5c5fbb7dd186ccefdfa2ba198f6501c716, d3027dd4e2fce8faa493ea0b9e6bd6507cf8651e

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=d3ca88326b75367ceaeb3d1ee930e730201f7f59

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=01ba9aca61e9d6eeae03f53600da243b496b4a78

Comment 4

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 12 tests and 1 subtests

Status Summary

Firefox

ERROR: 12

Chrome

OK : 11
PASS : 15
FAIL : 27
ERROR: 1

Safari

ERROR: 12

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /long-animation-frame/tentative/loaf-basic.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-buffered.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-desired-exec-time.html [wpt.fyi]: ERROR (Chrome: ERROR, Safari: ERROR)
• /long-animation-frame/tentative/loaf-event-listener.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-idle.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-iframe-popup.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-promise.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-script-block.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-script-window-attribution.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-timeline.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-user-callback.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)
• /long-animation-frame/tentative/loaf-visibility.html [wpt.fyi]: ERROR (Chrome: OK, Safari: ERROR)

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a0b271baf540
[wpt PR 38948] - Increase timeout and add retries to loaf tests, a=testonly

Comment 6

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/a0b271baf540