Closed Bug 1632601 Opened 3 months ago Closed 3 months ago

Create test archives for jsreftest and jittest

Categories

(Testing :: General, enhancement)

enhancement

Tracking

(firefox77 fixed)

RESOLVED FIXED
mozilla77
Tracking Status
firefox77 --- fixed

People

(Reporter: catlee, Assigned: catlee)

References

Details

(Whiteboard: [ci-costs-2020:done])

Attachments

(1 file)

Currently all of the jsreftest and jittest files are contained within the common tests archives.

The common tests archive contains approximately 375MB of data across 62k files.

jsreftest alone contains 188MB in 44k files
jittest contains 87MB in 15k files

We pay the cost of downloading and extracting all of these files on most of our test suites, since they all download the common test archive, and most of them don't extract a subset of the files from the archives.

I also noticed that some files for web-platform tests are duplicated between the common archive and the web-platform archive. e.g. testing/web-platform/tests/tools/wptserve and wpt_third_party.

We should split out the jsreftest and jittest files into their own test archives, and remove the duplicate wpt tools.

Assignee: nobody → catlee

Split out jsreftest and jittest files into their own packages, removing them
from the common package.

This speeds up extracting files from the common test archive for
non-jsreftest/jittest suites.

Also, remove some files from the web-platform test archive that are already
present in the common archive.

Thanks :catlee! We started talking about this in 1611894 but then that particular problem went away on its own.

See Also: → 1611894
Whiteboard: [ci-costs-2020:todo]

:catlee, great patch, let me know if you need help testing or reviewing this, I imagine this will be a huge win.

Attachment #9142801 - Attachment description: Bug 1632601: Create test archives for jsreftest and jittest → Bug 1632601: Create test archives for jsreftest and jittest r=ahal
Pushed by catlee@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/434df61a71b0
Create test archives for jsreftest and jittest r=ahal
Status: NEW → RESOLVED
Closed: 3 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla77

This improved download-and-extract times on average by this amount per worker type:

t-win7-32-gpu                 -271.93509930145
t-win7-32                     -226.7196882673268
gecko-t-win64-aarch64-laptop  -69.60187633499979
t-win10-64-gpu-s              -32.36924360062819
gecko-t-win10-64-ref-hw       -23.683039860699793
t-win10-64                    -21.739066498577913
gecko-t-osx-1014              -20.821812657222694
gecko-t-win10-64-hw           -19.79946379788017
gecko-t-osx-1014-staging      -19.146570328746677
gecko-t-osx-1014-power        -15.410287422714852
gecko-t-bitbar-gw-unit-p2     -13.957377857269247
gecko-t-bitbar-gw-perf-p2     -12.61643865012671
gecko-t-linux                 -11.437835640731691
t-linux-xlarge                -10.750972427258773
gecko-t-bitbar-gw-perf-g5     -10.219570862858887
t-linux-large                 -10.078663632993521
gecko-t-linux-talos           -5.386077451923681
Whiteboard: [ci-costs-2020:todo] → [ci-costs-2020:done]
You need to log in before you can comment on or make changes to this bug.