1117025 - run try builds locally from mach

Status: NEW

(Testing :: General, defect)

Description

[Cameron McCormack (:heycam)]

I don't know how much would be involved in this, but I would love to be able to do something like:

  ./mach mochitest-plain --try 3f69b9d4d758

which would download the build, symbols and tests from the given try push and run them.  I'd also be happy with running the tests from my local tree.  It might need a command line option to select which specific build to use, such as "linux-debug", in case more than one in that try job will run on my machine.

I find it a real hassle to work how how to take the packaged tests and symbols that are uploaded to ftp.mozilla.org and to run them locally, so I'd like mach to do it for me. :)

Comment 1

[Gregory Szorc [:gps]]

Easily running automation builds locally is a very reasonable request.

Comment 2

[(not currently active) Ted Mielczarek]

We've talked about this from different angles in the past: bug 1058923, bug 524130. We definitely need *something* to make it easier.

Comment 3

[Armen [:armenzg]]

This script was meant to extract commands from a log:
https://hg.mozilla.org/build/braindump/raw-file/fc6ff19493c1/buildbot-related/scrape_buildbot_logs_for_commands.sed

This can be used to extract with mozharness command was used.

We can clone mozharness and pass the developer mode parameters specified in here:
https://wiki.mozilla.org/ReleaseEngineering/Mozharness/How_to_run_tests_as_a_developer#Common_steps

Android and b2g jobs can fetch artifacts from tooltool when using the developer mode.
LDAP credentials are needed.