Closed Bug 1288501 Opened 6 years ago Closed 5 years ago

Android test chunks determined by mozharness configuration


(Release Engineering :: Applications: MozharnessCore, defect)

Not set


(firefox50 fixed)

Tracking Status
firefox50 --- fixed


(Reporter: gbrown, Assigned: gbrown)



(1 file) does not accept options like --this-chunk and --total-chunk. Instead, callers request a test suite and chunk with an option like "--test-suite=mochitest-23". The mozharness configuration maps the test suite name to a suite category (eg mochitest) and a chunk number.

That's inconvenient when increasing chunks: The config file needs to be updated with new suite mappings and callers (taskcluster and buildbot) must be updated at the same time to ensure the new suites are called.

Use of command line options like desktop_unittest's --this-chunk and --total-chunk would be more convenient and allow buildbot and taskcluster to be updated independently.
This adds support for --this-chunk and --total-chunk arguments in Old-style requests are still accepted too. Callers can request, for example:
  --test-suite=mochitest --this-chunk=3 --total-chunk=20

In the latter case, the script now parses {{suite}}-{{chunk}} rather than using the test_suite_definitions mapping from the configuration. This allows for the complete removal of test_suite_definitions, simplifying the config file substantially. (I also had to make a minor change to the mochitest-chrome config to remove test_suite_definitions, but that just made the mochitest-chrome settings more consistent, like mochitest-media, etc.)

I intend to start using --this-chunk and --total-chunk from taskcluster soon. Eventually, I think I will remove total_chunks from the mozharness configuration and rely on --total-chunk (perhaps once buildbot jobs are retired). shows how this makes it easier to update chunks on taskcluster only -- bug 1287831.
Attachment #8773525 - Flags: review?(kmoir)
Attachment #8773525 - Flags: review?(kmoir) → review+
Pushed by
Accept total-chunk, this-chunk options in; r=kmoir
Closed: 5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.