./mach wpt-update ../logs/* --update-intermittent doesn't update wpt expectation .ini files when it should for one specific task
Categories
(Testing :: web-platform-tests, defect)
Tracking
(firefox100 fixed)
Tracking | Status | |
---|---|---|
firefox100 | --- | fixed |
People
(Reporter: aryx, Assigned: jgraham)
Details
Attachments
(1 file)
~/mozilla/fetchlogs $ cargo run mozilla-central 11820f4551ab30b94ff80685ed0a4690eadbb0e8 --out-dir ../logs/ --filter-jobs test-linux1804-32-shippable-qr/opt-web-platform-tests-fis-e10s-9
./mach wpt-update ../logs/* --update-intermittent
doesn't update any test expectation files but there are unexpected results for Linux 32-bit.
Note Test harness output was not a valid structured log message:
gets also logged.
Assignee | ||
Comment 1•3 years ago
|
||
It seems like we're failing to mark the test as modified in this case where only a subtest changes, so we don't write the update. But I'm not sure why this is only broken sometimes and not in any case where the overall test didn't require updates.
Assignee | ||
Comment 2•3 years ago
|
||
The wpt-update code ensures that it only writes data in cases the file
is changed by having a 'modified' flag on each metadata file. However
this wasn't being correctly set on the manifest in the case that only
a subtest was modified, and not a top level test.
It turns out that in the existing code the test modified flag is
usually set anyway, except in the case that the test itself has a
conditional status that doesn't require an update. Therefore this
wasn't caught by any of the tests, and hadn't caused lots of issues
with updates.
Updated•3 years ago
|
Comment 4•3 years ago
|
||
bugherder |
Description
•