1502272 - Running tests with --repeat-until-unexpected doesn't print the list of unexpected results at the end of the run

Status: RESOLVED FIXED

(Testing :: web-platform-tests, enhancement)

Description

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

I've been seeing some intermittently failing WPT tests while trying to green up Fennec WPT results. I started running some of the subdirectories of tests with --repeat-until-unexpected, and I'll eventually hit the intermittent failure. But when the test run completes, it doesn't print the nicely formatted list of failing tests, so I have to go back through the log to find the failures. They often don't have proper line endings, so they end up jumbled into a single line.

I think it'd be nice to have it print the formatted list of unexpected results just like it does without the --repeat-until-unexpected flag.

Comment 1

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Attachment: Bug 1502272 - Print the formatted list of unexpected failures after --repeat-until-unexpected completes

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/456031f62a0a
Print the formatted list of unexpected failures after --repeat-until-unexpected completes r=jgraham

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/13825 for changes under testing/web-platform/tests

Comment 4

[Arthur Iakab [arthur_iakab]]

https://hg.mozilla.org/mozilla-central/rev/456031f62a0a

Comment 5

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged