1393900 - Update mochitest runtimes files

Status: RESOLVED FIXED

(Testing :: General, enhancement)

Description

[Andrew Halberstadt [:ahal]]

It's been awhile since we updated the runtimes files under testing/runtimes, lets do another pass to help balance out the chunks a bit more.

Comment 1

[Andrew Halberstadt [:ahal]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=5d37bb3c580eabf0476fe20e1c619e91e6d09ca0

Comment 2

[Andrew Halberstadt [:ahal]]

The try push looks good. There are still some chunks taking ~80 min though because they are running a single manifest that apparently takes that long. See https://bugzilla.mozilla.org/show_bug.cgi?id=1204281#c402 for more details.

Other than that, the rest of the chunks look better balanced, so I think we should land this either way. I'll do a more thorough try push and put the patch up for review shortly.

Comment 3

[Andrew Halberstadt [:ahal]]

Attachment: Bug 1393900 - Update mochitest runtimes files to balance the chunks,

Review commit: https://reviewboard.mozilla.org/r/173834/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/173834/

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8902364 [details]
Bug 1393900 - Update mochitest runtimes files to balance the chunks,

https://reviewboard.mozilla.org/r/173834/#review179278

it would be interesting to summarize the total number of removed/new tests, total time difference, and how many tests are faster/similar/slower and maybe the median change for those :)

Comment 5

[Andrew Halberstadt [:ahal]]

Yeah, it would probably be better if we wrote a new script that queries active data for that though. Then we could see this information over any arbitrary time period, not just when updating runtimes. This is basically what the last version of test-informant did.

Comment 6

[Andrew Halberstadt [:ahal]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=1282f72f4809b98f97be4c881a4d01303a4f4c08

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d87bd54dc409
Update mochitest runtimes files to balance the chunks, r=jmaher

Comment 8

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/d87bd54dc409