1190907 - Error running talos INSTALL.py

Status: RESOLVED FIXED

(Testing :: Talos, defect)

Description

[Benoit Girard (:BenWa)]

Attachment: log

I get this log running python INSTALL.py using the latest tip of talos.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

this looks like our unintentional dependencies on odd packages.  There is a patch to remove this dependency, I suspect it is ready to land. :parkouss, let me know what I can do to help get the mozlog removal patch landed :)

Comment 2

[Julien Pagès (:parkouss)]

It's on try in bug 1189714, we should be able to land that soon.

Comment 3

[Julien Pagès (:parkouss)]

This should be better now - Benoit, can you confirm ?

Comment 4

[Benoit Girard (:BenWa)]

Attachment: log2

Doesn't appear to be as of b6589aef27a5.

Comment 5

[Julien Pagès (:parkouss)]

Indeed, there are other errors now. mozlog is required everywhere, and with >= VERSION. As mozversion 3.0 is available but not compatible with the talos dependencies, this ends up in a mess.

We should update our dependencies of talos to the latest versions of mozbase.

Comment 6

[Julien Pagès (:parkouss)]

Attachment: deps_temp_fix.patch

As a temporary workaround, we could apply that patch. This give us time to fix dependencies issues and should allow trys to work also.

jmaher, do you mind pushing this to a simple try (just to check that mozdevice==0.29) is available on internal pypi ?

With this patch, it works well locally for me now.

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8643504 [details] [diff] [review]
deps_temp_fix.patch

Review of attachment 8643504 [details] [diff] [review]:
-----------------------------------------------------------------

this looks great and a reasonable fix.  We do need to test this carefully on try.

Comment 8

[Julien Pagès (:parkouss)]

Pushed to try:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=c54a03d5421b

Comment 9

[Julien Pagès (:parkouss)]

Some errors on try, because mozdevice 0.29 not in internal pypi. :) So I asked on rely, what is available is here:

http://pypi.pub.build.mozilla.org/pub/

so I updated to use mozdevice==0.40 and re-run failed jobs (20).

Comment 10

[Julien Pagès (:parkouss)]

asked on #releng*

Comment 11

[Julien Pagès (:parkouss)]

Running pretty good so far, except for g2 tests that are busted again.

Benoit, could that be a side effect of a6529a8 or 582072d ?

Comment 12

[Julien Pagès (:parkouss)]

Attachment: deps_temp_fix.patch

updating the patch to make it works locally and on try (this is what was tested on try).

I think we are good to land this now.

Comment 13

[Julien Pagès (:parkouss)]

Soory no, we should not. mozdevice 0.40 requires mozlog 3.0, so it fails locally. I have to find another one.

Comment 14

[Julien Pagès (:parkouss)]

If I require mozdevice==0.26, I get:

pkg_resources.VersionConflict: (mozdevice 0.26 (/home/jp/dev/talos/venv2/lib/python2.7/site-packages), Requirement.parse('mozdevice>=0.29'))

If I require mozdevice==0.40 or no mozdevice, we have mozlog errors, and there is no other versions in internal pypi so I am a bit blocked.



Let's wait for talos to use new packages, that will fix everything. In the mean time I updated mozversion to not require mozdevice (bug 1189847). It is already on pypi, but not on internal packages. We are waiting some marionette packages with whimboo to ask internal mirroring (multiple packages in one go).

So, forget about the patch here - talos local is broken until that. Note that you should be able to run:

python talso/run_tests.py directly as a temporary workaround.

Comment 15

[Joel Maher ( :jmaher ) (UTC -8)]

landed this temporary dependency fix on the talos branch:
https://hg.mozilla.org/build/talos/rev/ef4be62febe2

Comment 16

[Benoit Girard (:BenWa)]

FYI: I have one of the version posted after Comment 4 locally and it works.

Comment 17

[Joel Maher ( :jmaher ) (UTC -8)]

ok, this is working good and deployed!

Comment 18

[Julien Pagès (:parkouss)]

FYI, now the mozbase dependencies have been updated with bug 1190265, so should be good without local patches now. :)