Closed Bug 1549619 Opened 5 months ago Closed 5 months ago

revisit chunking of mochitest-devtools

Categories

(Testing :: General, enhancement)

enhancement
Not set

Tracking

(firefox68 fixed)

RESOLVED FIXED
mozilla68
Tracking Status
firefox68 --- fixed

People

(Reporter: egao, Assigned: egao)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

Summary

In similar vein to other chunking review, mochitest-devtools has some very short runtime chunks scattered throughout the platforms.

Data

Comparing some platforms:

linux64/opt

  • longest: 27min
  • shortest: 10 min
  • time until suite-start: 0:04:13

windows7/opt

  • longest: 19 min
  • shortest: 15 min
  • time until suite-start: 0:07:39

macosx64-shippable/opt

  • longest: 23min
  • shortest: 9min
  • time until suite-start: 0:02:36

All examples are taken from baseline run:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=pending%2Crunning%2Csuperseded%2Cusercancel%2Cretry%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&classifiedState=unclassified&tier=1%2C2%2C3&group_state=expanded&revision=e8aebe488b2f2e567940577de25013d00e818f7c&searchStr=devtools&selectedJob=243359778

Thoughts

For opt, similar approach to xpcshell-test, just with more chunks can be taken. Ideally, halve chunks from 8 to 4.

ccov can be left alone.

debug can be reduced by 1 or 2 chunks. Do not anticipate further reductions.

Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/d9cf7d539c45
task efficiency: revisit chunking of mochitest-devtools-chrome r=jmaher
Status: NEW → RESOLVED
Closed: 5 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Target Milestone: mozilla68 → ---

Have an updated patch that should take care of the macosx64/debug failure, pending try run conclusion.

Try:
https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=efd822ec7ddaac810271c7aa103285cdc7eb32a7

macosx64/debug appears to run in 8 chunks (as expected) and does not time out.

Flags: needinfo?(egao)
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/2ec342f2be77
task efficiency: revisit chunking of mochitest-devtools-chrome r=jmaher
Status: REOPENED → RESOLVED
Closed: 5 months ago5 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
Blocks: 1550915
You need to log in before you can comment on or make changes to this bug.