1186053 - ensure that ./mach <test> uses in-tree mozharness and runs the jobs as similar to production as possible

Status: RESOLVED FIXED

(Release Engineering :: Applications: MozharnessCore, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

while trying to test talos:
./mach talos-test chromez

I get errors that talos files are not found, and they are not because the mozharness script doesn't clone them.  I edited testing/mozharness/mozharness/testing/talos.py to fix it and add some logging- running again yields no indication my changes were working.

Looking in the log files, I don't see any mention of 'hg clone mozharness', so I am filing a bug

Comment 1

[Jordan Lund (:jlund)]

'mach $test' isn't configured to use in-tree mozharness so editing '$gecko_repo/testing/mozharness/mozharness/testing/talos.py' won't be used by mach.

we will need to setup mach to point to in-tree copy instead of ... whatever it is using now. I presume that it is cloning hgmo/build/mozharness or using a local copy somewhere outside of the tree.

gps: do you know how mach works with mozharness for tests or can point me to someone who can make the change?

Comment 2

[James Graham [:jgraham]]

I'm going to guess that gps isn't the right person to needinfo on this since it's about the implementation details of a specific mach command that it looks like Armen wrote. 

The implementation is at [1] and it seems pretty clear that the changes needed involve removing the clone step and setting the mozharness directory to the in-tree copy instead of the clone.

[1] https://dxr.mozilla.org/mozilla-central/source/testing/talos/mach_commands.py

Comment 3

[Armen [:armenzg]]

I landed the code with incorrect metadata.
Jason Yeo wrote the mach integration. I only landed it for him.

Comment 4

[Julien Pagès (:parkouss)]

I'm on it, in bug 1185539. I think I should have done the work here instead, looking at the bug title.

Comment 5

[Julien Pagès (:parkouss)]

Hm, is this bug only for talos or for other things as well ? Talos is handled on bug 1185539.

Comment 6

[Armen [:armenzg]]

We can use bug 1185539 for the talos work.

This bug can be used to analyze if we use mach + mozharness anywhere.

The only place I was aware of is mach talos. If someone could determine if we use it in other places it would be great.

Comment 7

[Jordan Lund (:jlund)]

I think this is done now or not applicable