1089712 - Need libzmq installed on test machines and related pypi packages

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[Malini Das [:mdas] - Away, not checking bugmail]

we're updating Gij to use zeroMQ (as part of bug 994764), and we need to have the right libraries installed before we can land the changes.

Can we have this package installed on the test machines: http://download.zeromq.org/zeromq-4.0.4.tar.gz?

Comment 1

[Malini Das [:mdas] - Away, not checking bugmail]

We're looking to land these parts this week and are blocked by this, can we have someone to take a look at this please? Thanks!

Comment 2

[Malini Das [:mdas] - Away, not checking bugmail]

Catlee reminded me about python packages! We'll also need to have the following packages on RelEng's internal pypi:

* Corredor (https://pypi.python.org/pypi/corredor/0.1) which requires:
* Tornado (https://pypi.python.org/pypi/tornado)
* PyZMQ (https://pypi.python.org/pypi/pyzmq)

Comment 3

[Malini Das [:mdas] - Away, not checking bugmail]

The required versions of Tornado and PyZMQ are whatever is latest

Comment 4

[Chris Cooper [:coop] (he/him)]

(In reply to Malini Das [:mdas] from comment #2)
> Catlee reminded me about python packages! We'll also need to have the
> following packages on RelEng's internal pypi:
> 
> * Corredor (https://pypi.python.org/pypi/corredor/0.1) which requires:
> * Tornado (https://pypi.python.org/pypi/tornado)
> * PyZMQ (https://pypi.python.org/pypi/pyzmq)

This part is relatively easy. 

I'll see if I can find someone today to tackle the zeromq part.

Comment 5

[Chris Cooper [:coop] (he/him)]

Malini: Bug 994764 is about having a new common framework for running b2g tests. AFAICT the Gij tests only run on our tst-linux64-spot platform. Will other slave platforms (talos, emulators, non-linux) also require zeromq, or is the change confined to the tst-linux64-spot platform?

Comment 6

[Chris Cooper [:coop] (he/him)]

(In reply to Malini Das [:mdas] from comment #2) 
> * Corredor (https://pypi.python.org/pypi/corredor/0.1) which requires:
> * Tornado (https://pypi.python.org/pypi/tornado)
> * PyZMQ (https://pypi.python.org/pypi/pyzmq)

http://pypi.pub.build.mozilla.org/pub/corredor-0.1.tar.gz
http://pypi.pub.build.mozilla.org/pub/tornado-4.0.2.tar.gz
http://pypi.pub.build.mozilla.org/pub/pyzmq-14.4.0.tar.gz

Comment 7

[Justin Wood (:Callek)]

malini,

In addition to the requested info in c#5...

This will also be pretty easy to install on at least the tst-linux64 machines if the following existing ubuntu package is "good enough":

[[e-mail] ~]# apt-cache show libzmq1
Package: libzmq1
Priority: optional
Section: universe/libs
Installed-Size: 287
Maintainer: Ubuntu Developers <[e-mail]>
Original-Maintainer: Martin Lucina <[e-mail]>
Architecture: amd64
Source: zeromq
Version: 2.1.11-1ubuntu1
Depends: libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), libpgm-5.1-0 (>= 5.1.116~dfsg), libstdc++6 (>= 4.2.1), libuuid1 (>= 2.16)
Filename: pool/universe/z/zeromq/libzmq1_2.1.11-1ubuntu1_amd64.deb
Size: 109084
MD5sum: e65fb509f8428985d6d4db2ad2a7db13
SHA1: 8f24b7c740609b9d1acbec362cb78e2ff5194932
SHA256: af517106d78bf54f05940f7fcc01dc0a8bbb0ceaca655811fc9ecc2a08f0ff81
Description: ZeroMQ lightweight messaging kernel (shared library)
Homepage: http://www.zeromq.org/
Description-md5: 506c9d461f70b68113cc64a3132f0d7a
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Origin: Ubuntu

Comment 8

[Malini Das [:mdas] - Away, not checking bugmail]

(In reply to Chris Cooper [:coop] from comment #5)
> Malini: Bug 994764 is about having a new common framework for running b2g
> tests. AFAICT the Gij tests only run on our tst-linux64-spot platform. Will
> other slave platforms (talos, emulators, non-linux) also require zeromq, or
> is the change confined to the tst-linux64-spot platform?

Good question, let's add it to tst-linux64-spot platform only. We won't be running on those other platforms just yet.

Comment 9

[Malini Das [:mdas] - Away, not checking bugmail]

(In reply to Chris Cooper [:coop] from comment #6)
> (In reply to Malini Das [:mdas] from comment #2) 
> > * Corredor (https://pypi.python.org/pypi/corredor/0.1) which requires:
> > * Tornado (https://pypi.python.org/pypi/tornado)
> > * PyZMQ (https://pypi.python.org/pypi/pyzmq)
> 
> http://pypi.pub.build.mozilla.org/pub/corredor-0.1.tar.gz
> http://pypi.pub.build.mozilla.org/pub/tornado-4.0.2.tar.gz
> http://pypi.pub.build.mozilla.org/pub/pyzmq-14.4.0.tar.gz

\o/ Thanks

Comment 10

[Malini Das [:mdas] - Away, not checking bugmail]

(In reply to Justin Wood (:Callek) from comment #7)
> malini,
> 
> In addition to the requested info in c#5...
> 
> This will also be pretty easy to install on at least the tst-linux64
> machines if the following existing ubuntu package is "good enough":
> 
> [[e-mail] ~]# apt-cache show
> libzmq1
> Package: libzmq1
> Priority: optional
> Section: universe/libs
> Installed-Size: 287
> Maintainer: Ubuntu Developers <[e-mail]>
> Original-Maintainer: Martin Lucina <[e-mail]>
> Architecture: amd64
> Source: zeromq
> Version: 2.1.11-1ubuntu1
> Depends: libc6 (>= 2.15), libgcc1 (>= 1:4.1.1), libpgm-5.1-0 (>=
> 5.1.116~dfsg), libstdc++6 (>= 4.2.1), libuuid1 (>= 2.16)
> Filename: pool/universe/z/zeromq/libzmq1_2.1.11-1ubuntu1_amd64.deb
> Size: 109084
> MD5sum: e65fb509f8428985d6d4db2ad2a7db13
> SHA1: 8f24b7c740609b9d1acbec362cb78e2ff5194932
> SHA256: af517106d78bf54f05940f7fcc01dc0a8bbb0ceaca655811fc9ecc2a08f0ff81
> Description: ZeroMQ lightweight messaging kernel (shared library)
> Homepage: http://www.zeromq.org/
> Description-md5: 506c9d461f70b68113cc64a3132f0d7a
> Bugs: https://bugs.launchpad.net/ubuntu/+filebug
> Origin: Ubuntu

Sorry, I don't think we can take this route :( It looks like that's version 2.1.11, and we need version 4.0.4. I tested on an older version (3.x) previously and it was incompatible.

Comment 11

[Ryan VanderMeulen [:RyanVM]]

This broke v1.4 and v2.0 due to bug 1050861 not being there. To fix the bustage, we went ahead and cherry-picked that fix.

Comment 12

[Justin Wood (:Callek)]

(In reply to Ryan VanderMeulen [:RyanVM UTC-4] from comment #11)
> This broke v1.4 and v2.0 due to bug 1050861 not being there. To fix the
> bustage, we went ahead and cherry-picked that fix.

(In reply to Chris Cooper [:coop] from comment #6)
> (In reply to Malini Das [:mdas] from comment #2) 
> > * Corredor (https://pypi.python.org/pypi/corredor/0.1) which requires:
> > * Tornado (https://pypi.python.org/pypi/tornado)
> > * PyZMQ (https://pypi.python.org/pypi/pyzmq)
> 
> http://pypi.pub.build.mozilla.org/pub/tornado-4.0.2.tar.gz

And ahead of RyanVM's cherrypick I pulled tornado-4.0.2 off pypi.pub, though it seemed to get hung up in cache anyway.

I'll re-deploy it tomorrow.

Comment 13

[Malini Das [:mdas] - Away, not checking bugmail]

We can punt on this for now, we'll be landing a workaround to disable installing of these packages. We will only absolutely require it when we change how we start our b2g desktop instances (to use mozrunner instead of what's currently being done). Feel free to deprioritize.

Comment 14

[Malini Das [:mdas] - Away, not checking bugmail]

as an update, we're currently working on removing the libzmq requirement since it isn't used fully, and we've had various problems installing it in differnet environments: https://bugzilla.mozilla.org/show_bug.cgi?id=1098017

Comment 15

[Justin Wood (:Callek)]

WONTFIX -> per c#14