1474463 - Consider reporting missing wpt expected subtest results

Status: NEW

(Testing :: web-platform-tests, enhancement)

Description

[Karl Tomlinson (:karlt)]

This would help us to understand when newly reported test failures come from test name changes, and to clean up obsolete subtest expectation data.

I guess we'd need something like a MISSING result to indicate that the subtest
is not running on some platforms.

I noticed this due to
https://github.com/web-platform-tests/wpt/issues/10201
Valid test name changes would be considerably more rare, and so supporting this is not a top priority.

Comment 1

[Karl Tomlinson (:karlt)]

To clarify, I mean reporting when expectation data mentions a subtest that does not actually run.