Run puppeteer tests in several chunks
Categories
(Remote Protocol :: Agent, task, P3)
Tracking
(firefox133 fixed)
Tracking | Status | |
---|---|---|
firefox133 | --- | fixed |
People
(Reporter: jdescottes, Assigned: Sasha)
References
Details
(Whiteboard: [webdriver:m13])
Attachments
(1 file)
At the moment puppeteer tests run in single chunks. As the test suite grows bigger we had to use several workarounds to keep the gzipped log size < 5MB (eg Bug 1911382).
We should update the tests to allow to run them in chunks on CI.
Comment 1•3 months ago
|
||
On GitHub the Puppeteer repository uses the shard
feature via GitHub Actions. But that's something that we can not use and mocha.js doesn't have it natively.
We should check if our chunking algorithm for other test suites would help here as well.
Reporter | ||
Updated•2 months ago
|
Comment 2•2 months ago
|
||
I've asked Alex and he pointed me to: https://github.com/puppeteer/puppeteer/blob/main/.github/workflows/ci.yml#L203
So it's basically a command like:
npm run test -- --shard '1-2'
to run the first half of tests.
All dependencies are getting installed automatically when Puppeteer is installed.
So that seems to be pretty easy to implement.
Assignee | ||
Updated•2 months ago
|
Assignee | ||
Comment 3•2 months ago
|
||
Hi Andrew,
I'm trying to add chunking to the puppeteer source test job, but it doesn't seem to work. I've tried adding chunks
property in the various places, but the schema validation would always fail (e.g. here) and since we don't have the chunking in any other source test jobs, I started doubting that it actually works at all for this type. Is that so, or am I just doing something wrong?
Comment 4•2 months ago
|
||
Yes, the chunking you are thinking of is specific to the test
kind. That said, Taskgraph has built-in chunking transforms that you can use now. See:
https://taskcluster-taskgraph.readthedocs.io/en/latest/reference/transforms/chunking.html
You'll need to add this transform to the kind.yml
first.
Assignee | ||
Comment 5•1 month ago
|
||
Updated•26 days ago
|
Assignee | ||
Updated•25 days ago
|
Comment 7•23 days ago
|
||
bugherder |
Description
•