1597921 - [task-efficiencies] why are we installing multiple versions of six

Status: RESOLVED INVALID

(Testing :: General, defect, P3)

Description

[Edwin Takahashi (:egao | infrequent contributor)]

+++ This bug was initially created as a clone of Bug #1596590 +++

I noted in the test log that six is being installed twice:

[task 2019-11-20T09:28:42.274Z] 09:28:42     INFO -  Collecting six>=1.10.0 (from mozterm==1.0.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 1))
[task 2019-11-20T09:28:43.387Z] 09:28:43     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/six-1.13.0-py2.py3-none-any.whl
[task 2019-11-20T09:28:43.397Z] 09:28:43     INFO -  Requirement already satisfied (use --upgrade to upgrade): mozfile>=1.0 in /builds/worker/workspace/build/venv/lib/python2.7/site-packages (from mozcrash==1.1.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 4))
[task 2019-11-20T09:28:43.399Z] 09:28:43     INFO -  Requirement already satisfied (use --upgrade to upgrade): mozlog>=5.0 in /builds/worker/workspace/build/venv/lib/python2.7/site-packages (from mozcrash==1.1.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 4))
[task 2019-11-20T09:28:43.402Z] 09:28:43     INFO -  Requirement already satisfied (use --upgrade to upgrade): mozinfo in /builds/worker/workspace/build/venv/lib/python2.7/site-packages (from mozdebug==0.2.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 5))
[task 2019-11-20T09:28:43.405Z] 09:28:43     INFO -  Requirement already satisfied (use --upgrade to upgrade): moznetwork>=0.24 in /builds/worker/workspace/build/venv/lib/python2.7/site-packages (from mozhttpd==0.7->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 8))
[task 2019-11-20T09:28:43.412Z] 09:28:43     INFO -  Collecting distro==1.4.0 (from mozinfo==1.2.1->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 9))
[task 2019-11-20T09:28:44.043Z] 09:28:44     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/distro-1.4.0.tar.gz (53kB)
[task 2019-11-20T09:28:44.231Z] 09:28:44     INFO -  Collecting requests (from mozInstall==2.0.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 10))
[task 2019-11-20T09:28:44.900Z] 09:28:44     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/requests-2.22.0.tar.gz (113kB)
[task 2019-11-20T09:28:45.068Z] 09:28:45     INFO -  Collecting blessings>=1.3 (from mozlog==5.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 12))
[task 2019-11-20T09:28:45.637Z] 09:28:45     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/blessings-1.7-py2-none-any.whl
[task 2019-11-20T09:28:45.654Z] 09:28:45     INFO -  Collecting chardet<3.1.0,>=3.0.2 (from requests->mozInstall==2.0.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 10))
[task 2019-11-20T09:28:46.313Z] 09:28:46     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/chardet-3.0.4-py2.py3-none-any.whl (133kB)
[task 2019-11-20T09:28:46.341Z] 09:28:46     INFO -  Collecting idna<2.9,>=2.5 (from requests->mozInstall==2.0.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 10))
[task 2019-11-20T09:28:46.883Z] 09:28:46     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/idna-2.8.tar.gz (174kB)
[task 2019-11-20T09:28:47.035Z] 09:28:47     INFO -  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->mozInstall==2.0.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 10))
[task 2019-11-20T09:28:47.616Z] 09:28:47     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/urllib3-1.25.6-py2.py3-none-any.whl (125kB)
[task 2019-11-20T09:28:47.651Z] 09:28:47     INFO -  Collecting certifi>=2017.4.17 (from requests->mozInstall==2.0.0->-r /builds/worker/workspace/build/tests/config/mozbase_requirements.txt (line 10))
[task 2019-11-20T09:28:48.192Z] 09:28:48     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/certifi-2019.9.11-py2.py3-none-any.whl (154kB)
[task 2019-11-20T09:28:48.214Z] 09:28:48     INFO -  Building wheels for collected packages: distro, requests, idna
[task 2019-11-20T09:28:48.215Z] 09:28:48     INFO -    Running setup.py bdist_wheel for distro: started
[task 2019-11-20T09:28:48.372Z] 09:28:48     INFO -    Running setup.py bdist_wheel for distro: finished with status 'done'
[task 2019-11-20T09:28:48.374Z] 09:28:48     INFO -    Stored in directory: /builds/worker/.cache/pip/wheels/ec/f8/6b/6e1955b508176284a3ed69f7cc096419870d9db444f545d9b4
[task 2019-11-20T09:28:48.383Z] 09:28:48     INFO -    Running setup.py bdist_wheel for requests: started
[task 2019-11-20T09:28:48.554Z] 09:28:48     INFO -    Running setup.py bdist_wheel for requests: finished with status 'done'
[task 2019-11-20T09:28:48.556Z] 09:28:48     INFO -    Stored in directory: /builds/worker/.cache/pip/wheels/12/a1/63/ddb8884d719be5695923514a4445fa7b28be3220499cce0910
[task 2019-11-20T09:28:48.565Z] 09:28:48     INFO -    Running setup.py bdist_wheel for idna: started
[task 2019-11-20T09:28:48.723Z] 09:28:48     INFO -    Running setup.py bdist_wheel for idna: finished with status 'done'
[task 2019-11-20T09:28:48.724Z] 09:28:48     INFO -    Stored in directory: /builds/worker/.cache/pip/wheels/c2/75/0c/641d27d584aef4b02784f962777f146879d970f4cfdb8e7ec0
[task 2019-11-20T09:28:48.729Z] 09:28:48     INFO -  Successfully built distro requests idna
[task 2019-11-20T09:28:48.734Z] 09:28:48     INFO -  Installing collected packages: six, distro, chardet, idna, urllib3, certifi, requests, blessings
[task 2019-11-20T09:28:49.095Z] 09:28:49     INFO -  Successfully installed blessings-1.7 certifi-2019.9.11 chardet-3.0.4 distro-1.4.0 idna-2.8 requests-2.22.0 six-1.13.0 urllib3-1.25.6

then

[task 2019-11-20T09:29:05.433Z] 09:29:05     INFO -  Collecting six==1.10.0 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 2))
[task 2019-11-20T09:29:06.553Z] 09:29:06     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/six-1.10.0-py2.py3-none-any.whl
[task 2019-11-20T09:29:06.565Z] 09:29:06     INFO -  Collecting twisted==10.2.0 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 4))
[task 2019-11-20T09:29:07.187Z] 09:29:07     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/Twisted-10.2.0.tar.gz (1.9MB)
[task 2019-11-20T09:29:07.993Z] 09:29:07     INFO -  Collecting txws==0.9.1 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 7))
[task 2019-11-20T09:29:08.572Z] 09:29:08     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/txWS-0.9.1.tar.gz
[task 2019-11-20T09:29:08.880Z] 09:29:08     INFO -  Requirement already satisfied (use --upgrade to upgrade): psutil>=5.6.3 in /builds/worker/workspace/build/venv/lib/python2.7/site-packages (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 9))
[task 2019-11-20T09:29:08.888Z] 09:29:08     INFO -  Collecting ipaddr==2.1.11 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 12))
[task 2019-11-20T09:29:09.510Z] 09:29:09     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/ipaddr-2.1.11.tar.gz
[task 2019-11-20T09:29:09.653Z] 09:29:09     INFO -  Collecting passlib==1.6.5 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 13))
[task 2019-11-20T09:29:10.309Z] 09:29:10     INFO -    Downloading https://pypi.pub.build.mozilla.org/pub/passlib-1.6.5-py2.py3-none-any.whl (317kB)
[task 2019-11-20T09:29:10.433Z] 09:29:10     INFO -  Building wheels for collected packages: twisted, txws, ipaddr
[task 2019-11-20T09:29:10.434Z] 09:29:10     INFO -    Running setup.py bdist_wheel for twisted: started
[task 2019-11-20T09:29:11.204Z] 09:29:11     INFO -    Running setup.py bdist_wheel for twisted: finished with status 'done'
[task 2019-11-20T09:29:11.216Z] 09:29:11     INFO -    Stored in directory: /builds/worker/.cache/pip/wheels/03/6c/d6/ca2ac2b37f8c36b3418dca8f1e9b1eab8654a5f0a752b81933
[task 2019-11-20T09:29:11.335Z] 09:29:11     INFO -    Running setup.py bdist_wheel for txws: started
[task 2019-11-20T09:29:11.513Z] 09:29:11     INFO -    Running setup.py bdist_wheel for txws: finished with status 'done'
[task 2019-11-20T09:29:11.515Z] 09:29:11     INFO -    Stored in directory: /builds/worker/.cache/pip/wheels/a4/52/d9/7fcf2230d414c15b14d6ec250261d3633d478605fec7041df1
[task 2019-11-20T09:29:11.521Z] 09:29:11     INFO -    Running setup.py bdist_wheel for ipaddr: started
[task 2019-11-20T09:29:11.669Z] 09:29:11     INFO -    Running setup.py bdist_wheel for ipaddr: finished with status 'done'
[task 2019-11-20T09:29:11.671Z] 09:29:11     INFO -    Stored in directory: /builds/worker/.cache/pip/wheels/5f/e0/ad/0bc8636ef04be0e0cc4cd996858d26afb6c38749085d0217a4
[task 2019-11-20T09:29:11.675Z] 09:29:11     INFO -  Successfully built twisted txws ipaddr
[task 2019-11-20T09:29:11.677Z] 09:29:11     INFO -  Installing collected packages: six, twisted, txws, ipaddr, passlib
[task 2019-11-20T09:29:11.679Z] 09:29:11     INFO -    Found existing installation: six 1.13.0
[task 2019-11-20T09:29:11.681Z] 09:29:11     INFO -      Uninstalling six-1.13.0:
[task 2019-11-20T09:29:11.685Z] 09:29:11     INFO -        Successfully uninstalled six-1.13.0
[task 2019-11-20T09:29:12.976Z] 09:29:12     INFO -  Successfully installed ipaddr-2.1.11 passlib-1.6.5 six-1.10.0 twisted-10.2.0 txws-0.9.1

Log: https://clgmgmyaaaaw5cdryhyfdbtt4wrtvvlmqqrirykoiayczgfo.taskcluster-worker.net:32774/log/NE33pjTwRbuaaiKaratevw

This seems wasteful since we're doing two operations for no reason.

Comment 1

[Edwin Takahashi (:egao | infrequent contributor)]

This task is no longer needed as six version has been standardized to 1.13.0.