1186935 - Update mozbase modules for mozlog update on internal PyPI

Status: RESOLVED WONTFIX

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[James Graham [:jgraham]]

https://hg.mozilla.org/integration/mozilla-inbound/rev/7f3175cac497

mozcrash 0.15
mozdevice 0.46
moznetwork 0.27
mozprofile 0.25
mozrunner 6.8
mozversion 1.3

Comment 1

[Justin Wood (:Callek)]

This was necessary due to Bug 1180762 c#2 (and on), basically mozprofile 0.25 required mozlog 3.0 which had breaking changes that these other pieces needed to pickup.

done. Raw log below

[[e-mail]3 ~]$ wget https://pypi.python.org/packages/source/m/mozdevice/mozdevice-0.46.tar.gz#md5=dd9cbe68
3d4a44511fa0dd296a2fee47
--2015-07-23 08:41:51--  https://pypi.python.org/packages/source/m/mozdevice/mozdevice-0.46.tar.gz
Resolving pypi.python.org... 199.27.79.223
Connecting to pypi.python.org|199.27.79.223|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 58680 (57K) [application/octet-stream]
Saving to: â?omozdevice-0.46.tar.gzâ??

100%[=======================================================================================>] 58,680      --.-K/s   in 0.04s

2015-07-23 08:41:51 (1.32 MB/s) - â?omozdevice-0.46.tar.gzâ?? saved [58680/58680]

[[e-mail]3 ~]$ md5sum mozdevice-0.46.tar.gz
dd9cbe683d4a44511fa0dd296a2fee47  mozdevice-0.46.tar.gz
[[e-mail]3 ~]$ sudo mv mozdevice-*.tar.gz /mnt/netapp/relengweb/pypi/pub/
[[e-mail]3 ~]$ sudo chmod +r /mnt/netapp/relengweb/pypi/pub/mozdevice-*.tar.gz
[[e-mail]3 ~]$ wget https://pypi.python.org/packages/source/m/mozcrash/mozcrash-0.15.tar.gz#md5=09809d1161
cf38283fd7ceed936216ac
--2015-07-23 08:45:32--  https://pypi.python.org/packages/source/m/mozcrash/mozcrash-0.15.tar.gz
Resolving pypi.python.org... 23.235.47.223
Connecting to pypi.python.org|23.235.47.223|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 6361 (6.2K) [application/octet-stream]
Saving to: â?omozcrash-0.15.tar.gzâ??

100%[=======================================================================================>] 6,361       --.-K/s   in 0s

2015-07-23 08:45:33 (552 MB/s) - â?omozcrash-0.15.tar.gzâ?? saved [6361/6361]

[[e-mail]3 ~]$ md5sum mozdevice-0.46.tar.gz
md5sum: mozdevice-0.46.tar.gz: No such file or directory
[[e-mail]3 ~]$ md5sum mozcrash-0.15.tar.gz
09809d1161cf38283fd7ceed936216ac  mozcrash-0.15.tar.gz
[[e-mail]3 ~]$ wget https://pypi.python.org/packages/source/m/moznetwork/moznetwork-0.27.tar.gz#md5=27e1b2
8729b53a3c850a6068760d7921
--2015-07-23 08:46:22--  https://pypi.python.org/packages/source/m/moznetwork/moznetwork-0.27.tar.gz
Resolving pypi.python.org... 23.235.44.223
Connecting to pypi.python.org|23.235.44.223|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3373 (3.3K) [application/octet-stream]
Saving to: â?omoznetwork-0.27.tar.gzâ??

100%[=======================================================================================>] 3,373       --.-K/s   in 0s

2015-07-23 08:46:22 (327 MB/s) - â?omoznetwork-0.27.tar.gzâ?? saved [3373/3373]

[[e-mail]3 ~]$ ls moz*
mozcrash-0.15.tar.gz  moznetwork-0.27.tar.gz
[[e-mail]3 ~]$ md5sum moznetwork-0.27.tar.gz
27e1b28729b53a3c850a6068760d7921  moznetwork-0.27.tar.gz
[[e-mail]3 ~]$ wget https://pypi.python.org/packages/source/m/mozrunner/mozrunner-6.8.tar.gz#md5=bbc356cee
e8f1d574ec5367c2c57b9af
--2015-07-23 08:47:22--  https://pypi.python.org/packages/source/m/mozrunner/mozrunner-6.8.tar.gz
Resolving pypi.python.org... 199.27.79.223
Connecting to pypi.python.org|199.27.79.223|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 52730 (51K) [application/octet-stream]
Saving to: â?omozrunner-6.8.tar.gzâ??

100%[=======================================================================================>] 52,730      --.-K/s   in 0.03s

2015-07-23 08:47:22 (1.78 MB/s) - â?omozrunner-6.8.tar.gzâ?? saved [52730/52730]

[[e-mail]3 ~]$ md5sum mozrunner-6.8.tar.gz
bbc356ceee8f1d574ec5367c2c57b9af  mozrunner-6.8.tar.gz
[[e-mail]3 ~]$ wget https://pypi.python.org/packages/source/m/mozversion/mozversion-1.3.tar.gz#md5=66aa7a4
0d1eb8fca5ca57f2488826907
--2015-07-23 08:47:50--  https://pypi.python.org/packages/source/m/mozversion/mozversion-1.3.tar.gz
Resolving pypi.python.org... 23.235.47.223
Connecting to pypi.python.org|23.235.47.223|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4747 (4.6K) [application/octet-stream]
Saving to: â?omozversion-1.3.tar.gzâ??

100%[=======================================================================================>] 4,747       --.-K/s   in 0s

2015-07-23 08:47:50 (487 MB/s) - â?omozversion-1.3.tar.gzâ?? saved [4747/4747]

[[e-mail]3 ~]$ md5sum mozversion-1.3.tar.gz
66aa7a40d1eb8fca5ca57f2488826907  mozversion-1.3.tar.gz
[[e-mail]3 ~]$ sudo mv moz*.tar.gz /mnt/netapp/relengweb/pypi/pub/
[[e-mail]3 ~]$ sudo chmod +r /mnt/netapp/relengweb/pypi/pub/moz*.tar.gz

Comment 2

[Justin Wood (:Callek)]

tl;dr I backed out all these packages AND the mozprofile 0.25 from Bug 1180762 pending a patch to use http://hg.mozilla.org/build/talos/file/dd701c9bd7de/requirements.txt instead of a bare package list in mozharness

[12:04:12]	RyanVM|sheriffduty	Callek|Buildduty, jmaher: https://treeherder.mozilla.org/logviewer.html#?job_id=1866113&repo=mozilla-central
[12:04:18]	RyanVM|sheriffduty	k, I'm not retriggering these anymore
[12:07:32]	Callek|Buildduty	jmaher: jgraham: verdict, delete mozprofile 0.25 mozlog 3.0 and related updates for mozlog, or fail forward somehow?
[12:08:20]	jgraham	Callek|Buildduty: "delete the new versions" isn't going to work in the long run at least
[12:08:31]	Callek|Buildduty	jgraham: indeed
[12:08:40]	Callek|Buildduty	I'm justing looking to make/keep trees open atm
[12:11:30]	jmaher	Callek|Buildduty: hmm
[12:11:39]	jmaher	I thought we had pinned talos to use specific versions
[12:11:55]	jmaher	yeah, we have mozprofile=0.23
[12:12:06]	jmaher	etc.
[12:12:18]	jgraham	jmaher: Where is the code?
[12:12:21]	jmaher	so if we require a specific version in the talos file, why are we failing
[12:12:30]	jmaher	http://hg.mozilla.org/build/talos/file/dd701c9bd7de/requirements.txt
[12:12:32]	jmaher	jgraham: ^
[12:13:14]	Callek|Buildduty	jmaher: are we requiring a specific mozlog version in either?
[12:13:25]	Callek|Buildduty	e.g. we're still pulling in mozlog 3.0 afaict
[12:13:43]	jmaher	Callek|Buildduty: mozlog 2.6
[12:14:06]	jmaher	oh
[12:14:08]	jgraham	Are we sure that file actually gets read
[12:14:16]	jmaher	ahh
[12:14:17]	jmaher	wait
[12:14:46]	jmaher	https://dxr.mozilla.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/talos.py?from=talos.py#163
[12:14:55]	jmaher	we use that file in a patch waiting to land
[12:15:07]	jmaher	but right now it probably picks up the latest version
[12:15:31]	jgraham	Yeah, so I suggest we land that patch asap
[12:15:45]	Callek|Buildduty	jmaher: jgraham it won't help the othe rbranches
[12:15:55]	jmaher	and it won't allow us to retrigger
[12:16:10]	Callek|Buildduty	jmaher: jgraham: *my* suggestion is to backout all but mozprofile 0.24 until that patch lands and we can reland the other stuff
[12:16:13]	jmaher	so we need to remove the new packages
[12:16:22]	jmaher	yeah Callek|Buildduty 
[12:16:36]	jgraham	So we can do that if only talos is using them
[12:16:41]	jgraham	Is that actually the case?
[12:17:11]	jmaher	jgraham: we just updated the packages this morning, I doubt anything landed which requires it
[12:17:38]	jgraham	What prompted us to do the update?
[12:17:52]	jmaher	jgraham: to update talos code
[12:17:58]	jmaher	heh
[12:18:11]	Callek|Buildduty	jgraham: update talos code, and I saw mozprofile > requested on pypi so I asked if I should grab that too
[12:18:15]	Callek|Buildduty	I did and thus failure

[[e-mail]3 ~]$ for i in mozversion-1.3 mozrunner-6.8 moznetwork-0.27 mozcrash-0.15  mozdevice-0.46 mozlog-
3.0 mozprofile-0.25; do sudo rm -vf /mnt/netapp/relengweb/pypi/pub/$i*; done
removed `/mnt/netapp/relengweb/pypi/pub/mozversion-1.3.tar.gz'
removed `/mnt/netapp/relengweb/pypi/pub/mozrunner-6.8.tar.gz'
removed `/mnt/netapp/relengweb/pypi/pub/moznetwork-0.27.tar.gz'
removed `/mnt/netapp/relengweb/pypi/pub/mozcrash-0.15.tar.gz'
removed `/mnt/netapp/relengweb/pypi/pub/mozdevice-0.46.tar.gz'
removed `/mnt/netapp/relengweb/pypi/pub/mozlog-3.0.tar.gz'
removed `/mnt/netapp/relengweb/pypi/pub/mozprofile-0.25.tar.gz'

We can do a new bug when its time for these updates.