1615048 - [wpt-sync] Sync PR 21763 - Update chromium logger to identify subtest failures.

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 21763 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/21763
Details from upstream follow.

Luke Zielinski <[e-mail]> wrote:

Update chromium logger to identify subtest failures.

This also fixes a bug where a subtest failure would be hidden because
the expected_status was evaluated too late in test_end. For a
subtest failure the test status is Pass. But for Chromium, we flip this
"actual" status to a failure.
But the actual status is also used as a fall-back for the expected status
(see explanation in chromium.py:126). So if expected is evaluated after the
"flip", it will just match actual and the failure will be marked as
an "expected" failure.

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try https://treeherder.mozilla.org/#/jobs?repo=try&revision=de516770b9703dc5ccb6dbee0e5a6a77ee05ac9d

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ec2e37b3e918
[wpt PR 21763] - Update chromium logger to identify subtest failures., a=testonly

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Test result changes from PR not available.

Comment 4

[Oana Pop-Rus]

https://hg.mozilla.org/mozilla-central/rev/ec2e37b3e918