1592608 - ReftestManifest does not capture enough manifest information

Status: RESOLVED FIXED

(Testing :: Reftest, enhancement)

Description

[Geoff Brown [:gbrown]]

The python ReftestManifest is used by the TestResolver to read reftest manifests and is the source of reftest manifest data for tools like 'mach test-info' and test-verify.

ReftestManifest provides access to all of the files referenced from reftest manifests, but it is missing important data:

• it does not capture any of the manifest annotations (eg. "skip-if(skiaContent)")
• it does not capture the relationship between a test file and a reference file

Comment 1

[Geoff Brown [:gbrown]]

Attachment: Bug 1592608 - Add more fields to ReftestManifest test descriptions; r=

Add test annotations to the ReftestManifest and TestResolver. For example, a
test description from the TestResolver might now contain 'skip-if': 'skiaContent';
similar to the content provided for manifestparser tests; this will allow
'mach test-info report' to filter tests based on reftest manifest test
annotations.
Also add the referenced-test field which identifies the test file associated
with test entries for reference files; this will allow test-verify to
run the correct reftest when only the reference file has been modified.

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/082bcb14a8c5
Add more fields to ReftestManifest test descriptions; r=ahal,froydnj

Comment 3

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/082bcb14a8c5