2006813 - [wpt-sync] Sync PR 56840 - feat(manifest): Add initial tooling for Test262 test types

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 56840 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/56840
Details from upstream follow.

wpt-pr-bot <[e-mail]> wrote:

feat(manifest): Add initial tooling for Test262 test types

This commit introduces the foundational infrastructure for the WPT manifest to recognize and process Test262 ECMA-262 conformance tests. This is the first step towards the goal of running the entire Test262 suite within the WPT infrastructure, as outlined in the approved RFC.

The core of this change is a new TestRecord parser in test262.py which is responsible for extracting the YAML frontmatter from Test262 .js files. This metadata is then used by the manifest generation process to correctly identify and classify the tests.

Key changes included in this commit:

• A new tools/manifest/test262.py module containing the YAML frontmatter parser.
• A corresponding Test262Test manifest item type defined in tools/manifest/item.py to represent these tests.
• Updates to tools/manifest/sourcefile.py to identify Test262 files by their directory path (/test262/) and invoke the new parser.
• The addition of pyyaml as a project dependency to handle the YAML parsing to tools/wpt/requirements.txt
  • Note to reviewers: PyYaml is lazily loaded. This is to prevent the modification of too many commands.json files. This may not be preferred since WPT does not do that often but open to other options. Please check failing checks for commits on the original PR for how I kept trying to track down the next commands.json file to fix.
• New unit tests for the parser and the manifest generation logic for Test262 files.

This work is part of the effort to add Test262 support as laid out in the RFC: https://github.com/web-platform-tests/rfcs/pull/229

This commit is the first in a series of smaller PRs split from the larger, original implementation in https://github.com/web-platform-tests/wpt/pull/55997. Subsequent PRs will add the server-side logic to serve the tests and the wptrunner integration to execute them.

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try https://treeherder.mozilla.org/#/jobs?repo=try&revision=509153fb7537e9163f27daacb3d2a362658d2ecb

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

The PR was not expected to affect any tests, but the try push wasn't a success. Check the try results for infrastructure issues

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/9c57951df6ca
https://hg.mozilla.org/integration/autoland/rev/2e83cf2f25e5
[wpt PR 56840] - feat(manifest): Add initial tooling for Test262 test types [pt 1/5], a=testonly

Comment 4

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Test result changes from PR not available.

Comment 5

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/2e83cf2f25e5

Comment 6

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Test result changes from PR not available.