1646761 - Some WPT groups are not mentioned in errorsummary.log

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, defect)

Description

[Marco Castelluccio [:marco]]

E.g. in https://firefoxci.taskcluster-artifacts.net/RYmCJO0fQsOor5jwtCCUzw/0/public/test_info//wpt_errorsummary.log we have no group_result line.

The group_result lines are outputted on suite_end (https://searchfox.org/mozilla-central/rev/eef39502e08bcd3c40573c65a6827828dce4a032/testing/mozbase/mozlog/mozlog/formatters/errorsummary.py#58). In this case, suite_end was emitted in the raw log: https://firefoxci.taskcluster-artifacts.net/RYmCJO0fQsOor5jwtCCUzw/0/public/test_info//wpt_raw.log.

What's wrong?

Comment 1

[Marco Castelluccio [:marco]]

This is probably the same bug as bug 1636939 (at least, the WPT part of bug 1636939) and is happening because some groups are None (which means we return early in https://searchfox.org/mozilla-central/rev/eef39502e08bcd3c40573c65a6827828dce4a032/testing/mozbase/mozlog/mozlog/formatters/errorsummary.py#41).

Comment 2

[Marco Castelluccio [:marco]]

Attachment: Bug 1646761 - Serialize test IDs rather than test class instances. r=jgraham

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2581e284eb9a
Serialize test IDs rather than test class instances. r=jgraham

Comment 4

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/24242 for changes under testing/web-platform/tests

Comment 5

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream web-platform-tests status checks passed, PR will merge once commit reaches central.

Comment 6

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/2581e284eb9a

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1634554

Comment 8

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged by moz-wptsync-bot