1859529 - Missing group information in WPT tasks

Status: NEW

(Testing :: web-platform-tests, defect)

Description

[Marco Castelluccio [:marco]]

E.g. https://firefoxci.taskcluster-artifacts.net/bfCWzEbWRfG_efD-_rDgnw/0/public/test_info/wpt_errorsummary.log has no "group_result" lines, and the "test_groups" line only mention "testharness" as a group.

The same on https://firefoxci.taskcluster-artifacts.net/Qj6znedHRMKZfNb2YP33GA/0/public/test_info/wpt_errorsummary.log:

{"groups": ["testharness"], "action": "test_groups", "line": 30}
{"test": "/infrastructure/testdriver/virtual_authenticator.html", "subtest": "Can get the credentials", "group": "", "status": "FAIL", "expected": "PASS", "message": "assert_equals: expected "Y3JlZC0x" but got "cred-1"", "stack": "@http://web-platform.test:8000/infrastructure/testdriver/virtual_authenticator.html:52:16\n", "known_intermittent": [], "action": "test_result", "line": 23916}

Comment 1

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

it appears webgpu tasks have testharness as the group; the other example is a backfill job, I suspect there isn't a common pattern other than some situation inside of wpt results in this.

Comment 2

[Marco Castelluccio [:marco]]

I've seen it in many other WPT tasks as well.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

maybe we should create some unittests for this to not get regressed, there was another issue with some wpt-css tests where the group name started with a : character

Comment 4

[Marco Castelluccio [:marco]]

James, any idea why this could be happening?