Closed Bug 1682236 Opened 5 years ago Closed 5 years ago

[wpt-sync] Sync PR 26883 - NativeIO: Add timeout=long to flaky web platform tests

Categories

(Testing :: web-platform-tests, task, P4)

task

Tracking

(firefox86 fixed)

RESOLVED FIXED
86 Branch
Tracking Status
firefox86 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 26883 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/26883
Details from upstream follow.

b'Richard Stotz <rstz@chromium.org>' wrote:

NativeIO: Add timeout=long to flaky web platform tests

This CL adds longer timeouts to some WPT that occasionally time out
under OSX. I expect this will reduce the flakiness for operations
accessing the hard drive.

Bug: 1157915
Change-Id: I5fc3e4716dec5a9d0c17021bf02e449b5dda400d
Reviewed-on: https://chromium-review.googlesource.com/2587164
WPT-Export-Revision: 2a9194ad5ab08dd5facab1de8e19f1cf0fdb355e

PR 26883 applied with additional changes from upstream: 2c4d900806e4dae65611c73c23a847515bf122e1, 9e022ebcfdfce2b2382fcfa0f492f3b5821157b0

CI Results

Ran 14 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 24 tests and 6 subtests

Status Summary

Firefox

OK : 20
FAIL : 124
ERROR : 4
NOTRUN: 12

Chrome

OK : 24
PASS : 116
FAIL : 20

Safari

OK : 15
FAIL : 93
ERROR : 9
NOTRUN: 9

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/native-io/concurrent_io/concurrent_io_read_async.tentative.https.any.serviceworker.html
read() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/close_async.tentative.https.any.sharedworker.html
NativeIOFile.close is idempotent: FAIL (Chrome: PASS)
NativeIOFile.close is idempotent when called immediately: FAIL (Chrome: PASS)
NativeIOFile.read fails after NativeIOFile.close settles: FAIL (Chrome: PASS)
NativeIOFile.read fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS)
NativeIOFile.write fails after NativeIOFile.close settles: FAIL (Chrome: PASS)
NativeIOFile.write fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS)
NativeIOFile.getLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS)
NativeIOFile.getLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS)
NativeIOFile.flush fails after NativeIOFile.close settles: FAIL (Chrome: PASS)
NativeIOFile.flush fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS)
NativeIOFile.setLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS)
NativeIOFile.setLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS)
/native-io/concurrent_io/concurrent_io_read_async.tentative.https.any.html
read() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_read_async.tentative.https.any.worker.html
read() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while read() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_read_async.tentative.https.any.sharedworker.html
read() rejects while read() is resolving.: FAIL (Chrome: PASS)
write() rejects while read() is resolving.: FAIL (Chrome: PASS)
getLength() rejects while read() is resolving.: FAIL (Chrome: PASS)
flush() rejects while read() is resolving.: FAIL (Chrome: PASS)
setLength() rejects while read() is resolving.: FAIL (Chrome: PASS)
/native-io/concurrent_io/concurrent_io_setLength_async.tentative.https.any.sharedworker.html
read() rejects while setLength() is resolving.: FAIL (Chrome: PASS)
write() rejects while setLength() is resolving.: FAIL (Chrome: PASS)
getLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS)
flush() rejects while setLength() is resolving.: FAIL (Chrome: PASS)
setLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS)
/native-io/close_async.tentative.https.any.serviceworker.html
NativeIOFile.close is idempotent: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.close is idempotent when called immediately: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.read fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.read fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.write fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.write fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.getLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.getLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.flush fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.flush fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.setLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.setLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/close_async.tentative.https.any.html
NativeIOFile.close is idempotent: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.close is idempotent when called immediately: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.read fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.read fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.write fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.write fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.getLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.getLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.flush fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.flush fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.setLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.setLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_setLength_async.tentative.https.any.serviceworker.html
read() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/close_async.tentative.https.any.worker.html
NativeIOFile.close is idempotent: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.close is idempotent when called immediately: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.read fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.read fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.write fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.write fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.getLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.getLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.flush fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.flush fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.setLength fails after NativeIOFile.close settles: FAIL (Chrome: PASS, Safari: FAIL)
NativeIOFile.setLength fails immediately after calling NativeIOFile.close: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_setLength_async.tentative.https.any.html
read() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/flush_async_basic.tentative.https.any.worker.html
NativeIOFile.read returns bytes written by NativeIOFile.write after NativeIOFile.flush: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_setLength_async.tentative.https.any.worker.html
read() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while setLength() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/flush_async_basic.tentative.https.any.html
NativeIOFile.read returns bytes written by NativeIOFile.write after NativeIOFile.flush: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_write_async.tentative.https.any.html
read() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/flush_async_basic.tentative.https.any.serviceworker.html
NativeIOFile.read returns bytes written by NativeIOFile.write after NativeIOFile.flush: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_write_async.tentative.https.any.worker.html
read() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/flush_async_basic.tentative.https.any.sharedworker.html
NativeIOFile.read returns bytes written by NativeIOFile.write after NativeIOFile.flush: FAIL (Chrome: PASS)
/native-io/concurrent_io/concurrent_io_write_async.tentative.https.any.serviceworker.html
read() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
write() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
getLength() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
flush() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
setLength() rejects while write() is resolving.: FAIL (Chrome: PASS, Safari: FAIL)
/native-io/concurrent_io/concurrent_io_write_async.tentative.https.any.sharedworker.html
read() rejects while write() is resolving.: FAIL (Chrome: PASS)
write() rejects while write() is resolving.: FAIL (Chrome: PASS)
getLength() rejects while write() is resolving.: FAIL (Chrome: PASS)
flush() rejects while write() is resolving.: FAIL (Chrome: PASS)
setLength() rejects while write() is resolving.: FAIL (Chrome: PASS)
/native-io/rename_async_failure_handling.tentative.https.any.worker.html: ERROR (Chrome: OK, Safari: ERROR)
nativeIO.rename does not overwrite an existing file.: FAIL (Chrome: FAIL, Safari: FAIL)
nativeIO.rename does not allow renaming an open file.: FAIL (Chrome: FAIL, Safari: FAIL)
nativeIO.rename does not allow renaming from or to invalid names.: FAIL (Chrome: PASS, Safari: FAIL)
Failed nativeIO.rename does not unlock the source.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Failed nativeIO.rename does not unlock the destination.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Renaming a non-existing file fails with a NotFoundError.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
/native-io/rename_async_failure_handling.tentative.https.any.html: ERROR (Chrome: OK, Safari: ERROR)
nativeIO.rename does not overwrite an existing file.: FAIL (Chrome: FAIL, Safari: FAIL)
nativeIO.rename does not allow renaming an open file.: FAIL (Chrome: FAIL, Safari: FAIL)
nativeIO.rename does not allow renaming from or to invalid names.: FAIL (Chrome: PASS, Safari: FAIL)
Failed nativeIO.rename does not unlock the source.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Failed nativeIO.rename does not unlock the destination.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Renaming a non-existing file fails with a NotFoundError.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
/native-io/rename_async_failure_handling.tentative.https.any.serviceworker.html: ERROR (Chrome: OK, Safari: ERROR)
nativeIO.rename does not overwrite an existing file.: FAIL (Chrome: FAIL, Safari: FAIL)
nativeIO.rename does not allow renaming an open file.: FAIL (Chrome: FAIL, Safari: FAIL)
nativeIO.rename does not allow renaming from or to invalid names.: FAIL (Chrome: PASS, Safari: FAIL)
Failed nativeIO.rename does not unlock the source.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Failed nativeIO.rename does not unlock the destination.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
Renaming a non-existing file fails with a NotFoundError.: NOTRUN (Chrome: FAIL, Safari: NOTRUN)
/native-io/rename_async_failure_handling.tentative.https.any.sharedworker.html: ERROR (Chrome: OK, Safari: ERROR)
nativeIO.rename does not overwrite an existing file.: FAIL (Chrome: FAIL)
nativeIO.rename does not allow renaming an open file.: FAIL (Chrome: FAIL)
nativeIO.rename does not allow renaming from or to invalid names.: FAIL (Chrome: PASS)
Failed nativeIO.rename does not unlock the source.: NOTRUN (Chrome: FAIL)
Failed nativeIO.rename does not unlock the destination.: NOTRUN (Chrome: FAIL)
Renaming a non-existing file fails with a NotFoundError.: NOTRUN (Chrome: FAIL)

Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/7228cf531afd [wpt PR 26883] - NativeIO: Add timeout=long to flaky web platform tests, a=testonly
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Target Milestone: --- → 86 Branch
You need to log in before you can comment on or make changes to this bug.