1676717 - Change wpt metadata update to not update intermittent when new value is a subset of old value

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task)

Description

[James Graham [:jgraham]]

We often see metadata changes like [PASS, FAIL] going to [FAIL, PASS]. Although in principle we'd like the most common status to be first, when we have things like expected: [PASS, FAIL] getting lots of os-specific expectations because the frequency is different on different platforms it doesn't help much.

Comment 1

[James Graham [:jgraham]]

Attachment: Bug 1676717 - Don't change wpt metadata when new metadata is a subset of old,

We often see metadata changes like [PASS, FAIL] going to [FAIL,
PASS]. Although in principle we'd like the most common status to be
first, when we have things like expected: [PASS, FAIL] getting lots of
os-specific expectations because the frequency is different on
different platforms it doesn't help much.

Instead, if the new metadata is a subset of the old, bail early and
don't make any changes.

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/26618d9cd273
Don't change wpt metadata when new metadata is a subset of old, r=karlcow,denschub

Comment 3

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/26508 for changes under testing/web-platform/tests

Comment 4

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/26618d9cd273

Comment 5

[Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)]

Upstream PR merged by jgraham