Closed Bug 1836717 Opened 2 years ago Closed 2 years ago

Increase the number of chunks used for wdspec tests

Categories

(Remote Protocol :: Agent, task, P2)

Product:
Remote Protocol
Component:
Agent
Type:
task
Points:
1

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1881286

People

(Reporter: jdescottes, Unassigned)

References

Details

At the moment we need to be quite careful with the balance between our wdspec test chunks, and as we have seen in Bug 1821996 and Bug 1834716, we can easily go over the limit supported by the log parser.

We temporarily addressed the issue by making sure the load was better balanced between the different test jobs, but it still feels like we are getting close to the limit, and as we add more and more tests, balancing will not be enough.

At the moment we split the wdspec tests in 3 chunks, I think we should increase that.

Henrik, would this make sense to you?

Flags: needinfo?(hskupin)

Which platforms / build types does that actually affect most? Do we have some numbers for log sizes? Usually we divide in chunks based on the time a job takes but not the log size. But if we are running into issues due to the amount of new tests we probably have to increase the chunks. Note that for slow running builds we already have more than 3 chunks, and we might want to increase that value as well.

Flags: needinfo?(hskupin)

Actually it would be good if we could log all the Firefox log output to a separate log file but we haven't had time to look at this for geckodriver.

(In reply to Henrik Skupin [:whimboo][⌚️UTC+2] from comment #2)

Which platforms / build types does that actually affect most? Do we have some numbers for log sizes? Usually we divide in chunks based on the time a job takes but not the log size. But if we are running into issues due to the amount of new tests we probably have to increase the chunks.

Some numbers:

Note that for slow running builds we already have more than 3 chunks, and we might want to increase that value as well.

Note that for debug builds we use 3 chunks as well, while the logs and runtimes are noticeably bigger.
It might be enough to increase the number of chunks for debug?

Yes that sounds plausible to me. Lets do that for now. Thanks!

Lets do it soon before we exceed the limit again.

Points: --- → 1
Priority: -- → P2
Whiteboard: [webdriver:m7]
Whiteboard: [webdriver:m7] → [webdriver:m8]
Whiteboard: [webdriver:m8] → [webdriver:backlog]

This was actually bumped in Bug 1881286

Status: NEW → RESOLVED
Closed: 2 years ago
Duplicate of bug: 1881286
Resolution: --- → DUPLICATE
Whiteboard: [webdriver:backlog]
You need to log in before you can comment on or make changes to this bug.