Open Bug 1921499 Opened 1 month ago Updated 19 days ago

`wpt-update` doesn't remove subtest entry without expectation field when there is a bug field

Categories

(Testing :: web-platform-tests, defect)

defect

Tracking

(Not tracked)

People

(Reporter: Sasha, Unassigned)

References

Details

Over on https://hg.mozilla.org/integration/autoland/rev/21ea92b7e4cf we had a new test passing and the expectation for FAIL was removed. But somehow the subtest entry including the bug reference remained:

 [viewport.py]
   disabled:
     if os == "android": bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1840084
-
   [test_with_scrollbars[quirks-both\]]
     bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1819490
-    expected: FAIL

Given that this was the one and only expectation entry, the [test_with_scrollbars[quirks-both]] entry should have been completely removed.
I've managed to reproduce it just by running the command locally without the wptsync bot being involved.

The severity field is not set for this bug.
:jgraham, could you have a look please?

For more information, please visit BugBot documentation.

Flags: needinfo?(james)

This is mostly expected; the tooling doesn't know about the bug annotation, so it doesn't know that it could be removed if there's no expectation. Instead we fall back on the default behaviour of not removing the subtest if there are any keys remaining. I think it's quite fixable if worthwhile.

Severity: -- → S3
Flags: needinfo?(james)
You need to log in before you can comment on or make changes to this bug.