Closed Bug 1393900 Opened 3 years ago Closed 2 years ago

Update mochitest runtimes files

Categories

(Testing :: General, enhancement)

enhancement
Not set

Tracking

(firefox57 fixed)

RESOLVED FIXED
mozilla57
Tracking Status
firefox57 --- fixed

People

(Reporter: ahal, Assigned: ahal)

References

Details

Attachments

(1 file)

It's been awhile since we updated the runtimes files under testing/runtimes, lets do another pass to help balance out the chunks a bit more.
The try push looks good. There are still some chunks taking ~80 min though because they are running a single manifest that apparently takes that long. See https://bugzilla.mozilla.org/show_bug.cgi?id=1204281#c402 for more details.

Other than that, the rest of the chunks look better balanced, so I think we should land this either way. I'll do a more thorough try push and put the patch up for review shortly.
Assignee: nobody → ahalberstadt
Status: NEW → ASSIGNED
Comment on attachment 8902364 [details]
Bug 1393900 - Update mochitest runtimes files to balance the chunks,

https://reviewboard.mozilla.org/r/173834/#review179278

it would be interesting to summarize the total number of removed/new tests, total time difference, and how many tests are faster/similar/slower and maybe the median change for those :)
Attachment #8902364 - Flags: review?(jmaher) → review+
Yeah, it would probably be better if we wrote a new script that queries active data for that though. Then we could see this information over any arbitrary time period, not just when updating runtimes. This is basically what the last version of test-informant did.
Pushed by ahalberstadt@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/d87bd54dc409
Update mochitest runtimes files to balance the chunks, r=jmaher
https://hg.mozilla.org/mozilla-central/rev/d87bd54dc409
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla57
You need to log in before you can comment on or make changes to this bug.