Closed Bug 1717578 Opened 6 months ago Closed 6 months ago

Permafailing tier 2 Could not install python package: failed all attempts. | ERROR: No matching distribution found for twisted>=18.7.0 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt

Categories

(Firefox Build System :: General, defect, P5)

defect

Tracking

(firefox-esr78 unaffected, firefox89 unaffected, firefox90 unaffected, firefox91 fixed)

RESOLVED FIXED
91 Branch
Tracking Status
firefox-esr78 --- unaffected
firefox89 --- unaffected
firefox90 --- unaffected
firefox91 --- fixed

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [stockwell disable-recommended])

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=343454615&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AuM_uhsBRmWsC3lD7I_7TA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/AuM_uhsBRmWsC3lD7I_7TA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1


[task 2021-06-22T06:24:42.442Z] 06:24:42  WARNING - Return code: 1
[task 2021-06-22T06:24:42.443Z] 06:24:42     INFO - retry: Failed, sleeping 300 seconds before retrying
[task 2021-06-22T06:29:42.514Z] 06:29:42     INFO - retry: Calling run_command with args: [['/builds/worker/workspace/build/venv/bin/pip', 'install', '--no-deps', '--timeout', '120', '-r', '/builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt', '--no-index', '--find-links', 'https://pypi.pub.build.mozilla.org/pub/']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x7f7d2ce4d730>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x7f7d2ba9f4e0>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x557b4cefd510>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x7f7d2ba93810>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x7f7d2b2e1030>, 'level': 'error'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x7f7d2cfbc870>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x7f7d2b2e1170>, 'level': 'critical'}], 'cwd': '/builds/worker/workspace/build/tests/mochitest/websocketprocessbridge', 'env': {'TASKCLUSTER_PORT_80_TCP_ADDR': '172.17.0.2', 'TASKCLUSTER_INSTANCE_TYPE': 'm5.large', 'TASKCLUSTER_WORKER_TYPE': 't-linux-large', 'MOZ_AUTOMATION': '1', 'MOZ_SOURCE_CHANGESET': '18c1168c3fa9bc78182ec7ab23dd1305ed7aa538', 'LOGNAME': 'worker', 'TOOLTOOL_CACHE': '/builds/worker/tooltool-cache', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/builds/worker/bin', 'HOME': '/builds/worker', 'MOZ_FETCHES_DIR': '/builds/worker/fetches', 'MOZHARNESS_SCRIPT': 'desktop_unittest.py', 'LANG': 'en_US.UTF-8', 'TERM': 'xterm', 'SHELL': '/bin/bash', 'MOZ_NODE_PATH': '/usr/local/bin/node', 'RUN_ID': '0', 'SHLVL': '1', 'MOZILLA_BUILD_URL': 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RTWXXUAGRyWC7fM4NHMepg/artifacts/public/build/target.tar.bz2', 'TASKCLUSTER_PORT': 'tcp://172.17.0.2:80', 'WORKING_DIR': '/builds/worker', 'DISPLAY': ':0', 'EXTRA_MOZHARNESS_CONFIG': '{"installer_url": "https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RTWXXUAGRyWC7fM4NHMepg/artifacts/public/build/target.tar.bz2", "test_packages_url": "https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RTWXXUAGRyWC7fM4NHMepg/artifacts/public/build/target.test_packages.json"}', 'TASKCLUSTER_PROXY_URL': 'http://taskcluster', 'TASKCLUSTER_NAME': '/vibrant_albattani/taskcluster', 'GECKO_HEAD_REPOSITORY': 'https://hg.mozilla.org/integration/autoland', 'TASKCLUSTER_WORKER_LOCATION': '{"availabilityZone":"us-east-1a","cloud":"aws","region":"us-east-1"}', 'SCCACHE_DISABLE': '1', 'TASKCLUSTER_PORT_80_TCP_PORT': '80', 'MOZ_SOURCE_REPO': 'https://hg.mozilla.org/integration/autoland', 'GECKO_HEAD_REV': '18c1168c3fa9bc78182ec7ab23dd1305ed7aa538', 'MOZ_SCM_LEVEL': '3', 'MOZHARNESS_URL': 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RTWXXUAGRyWC7fM4NHMepg/artifacts/public/build/mozharness.zip', 'GECKO_BASE_REPOSITORY': 'https://hg.mozilla.org/mozilla-unified', 'MOZ_FETCHES': '[{"artifact": "public/build/fix-stacks.tar.xz", "extract": true, "task": "Xqqx86T7Ssq_DIRPO8pmug"}, {"artifact": "public/build/minidump_stackwalk.tar.xz", "extract": true, "task": "aRb7KHi1T8i0EFgq4eoNjw"}, {"artifact": "public/build/node.tar.zst", "extract": true, "task": "WyrP8GdfToWCiiz9iOib9w"}]', 'LC_ALL': 'en_US.UTF-8', 'DBUS_SESSION_BUS_ADDRESS': 'unix:abstract=/tmp/dbus-GyVCH7tfaR,guid=0195b2f424ba2db05d53412c60d1801a', 'TASKCLUSTER_PORT_80_TCP_PROTO': 'tcp', 'TASK_ID': 'AuM_uhsBRmWsC3lD7I_7TA', 'TASKCLUSTER_PORT_80_TCP': 'tcp://172.17.0.2:80', 'OLDPWD': '/builds/worker/workspace', 'HOSTNAME': 'taskcluster-worker', 'GECKO_PATH': '/builds/worker/checkouts/gecko', 'HG_STORE_PATH': '/builds/worker/checkouts/hg-store', 'PWD': '/builds/worker/workspace', 'NEED_PULSEAUDIO': 'true', 'TASKCLUSTER_ROOT_URL': 'https://firefox-ci-tc.services.mozilla.com', 'ENABLE_E10S': 'true', 'NEED_WINDOW_MANAGER': 'true', 'MOZHARNESS_CONFIG': 'unittests/linux_unittest.py remove_executables.py', 'TASKCLUSTER_WORKER_GROUP': 'us-east-1', 'TASKCLUSTER_PUBLIC_IP': '52.91.156.12', 'USER': 'worker'}}, attempt #5
[task 2021-06-22T06:29:42.514Z] 06:29:42     INFO - Running command: ['/builds/worker/workspace/build/venv/bin/pip', 'install', '--no-deps', '--timeout', '120', '-r', '/builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt', '--no-index', '--find-links', 'https://pypi.pub.build.mozilla.org/pub/'] in /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge
[task 2021-06-22T06:29:42.514Z] 06:29:42     INFO - Copy/paste: /builds/worker/workspace/build/venv/bin/pip install --no-deps --timeout 120 -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt --no-index --find-links https://pypi.pub.build.mozilla.org/pub/
[task 2021-06-22T06:29:42.514Z] 06:29:42     INFO - Using env: (same as previous command)
[task 2021-06-22T06:29:42.716Z] 06:29:42     INFO -  DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
[task 2021-06-22T06:29:42.796Z] 06:29:42     INFO -  Looking in links: https://pypi.pub.build.mozilla.org/pub/
[task 2021-06-22T06:29:42.797Z] 06:29:42     INFO -  Requirement already satisfied: six in /builds/worker/workspace/build/venv/lib/python2.7/site-packages (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 4)) (1.13.0)
[task 2021-06-22T06:29:42.798Z] 06:29:42     INFO -  Requirement already satisfied: vcversioner==2.16.0.0 in /builds/worker/workspace/build/venv/lib/python2.7/site-packages (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 5)) (2.16.0.0)
[task 2021-06-22T06:29:44.291Z] 06:29:44     INFO -  ERROR: Could not find a version that satisfies the requirement twisted>=18.7.0 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 6)) (from versions: 10.1.0, 10.2.0, 12.3.0)
[task 2021-06-22T06:29:44.292Z] 06:29:44     INFO -  ERROR: No matching distribution found for twisted>=18.7.0 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 6))
[task 2021-06-22T06:29:44.330Z] 06:29:44  WARNING - Return code: 1
[task 2021-06-22T06:29:44.331Z] 06:29:44    FATAL - Could not install python package: failed all attempts.
[task 2021-06-22T06:29:44.331Z] 06:29:44    FATAL - Running post_fatal callback...
[task 2021-06-22T06:29:44.332Z] 06:29:44    FATAL - Exiting -1
[task 2021-06-22T06:29:44.332Z] 06:29:44     INFO - Running post-action listener: _resource_record_post_action
[task 2021-06-22T06:29:44.333Z] 06:29:44     INFO - Running post-action listener: _start_resource_monitoring
[task 2021-06-22T06:29:44.352Z] 06:29:44     INFO - Starting resource monitoring.
[task 2021-06-22T06:29:44.366Z] 06:29:44     INFO - [mozharness: 2021-06-22 06:29:44.364559Z] Finished create-virtualenv step (failed)
[task 2021-06-22T06:29:44.367Z] 06:29:44     INFO - Running post-run listener: _resource_record_post_run
[task 2021-06-22T06:29:44.445Z] cleanup
[task 2021-06-22T06:29:44.445Z] + cleanup
[task 2021-06-22T06:29:44.445Z] + local rv=255
[task 2021-06-22T06:29:44.445Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2021-06-22T06:29:44.446Z] + cp /builds/worker/.xsession-errors /builds/worker/artifacts/public/xsession-errors.log

[task 2021-06-22T06:29:44.291Z] 06:29:44 INFO - ERROR: Could not find a version that satisfies the requirement twisted>=18.7.0 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 6)) (from versions: 10.1.0, 10.2.0, 12.3.0)
[task 2021-06-22T06:29:44.292Z] 06:29:44 INFO - ERROR: No matching distribution found for twisted>=18.7.0 (from -r /builds/worker/workspace/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 6))
[task 2021-06-22T06:29:44.330Z] 06:29:44 WARNING - Return code: 1

The failures point to https://treeherder.mozilla.org/jobs?repo=autoland&revision=997f00815e6bc28806b75448c8829f0259d2cb28 - Bug 1714688.

Surajeet, can you help us out with this one as well?
Thank you!

Flags: needinfo?(surajeet310)
Regressions: 1714688
Regressed by: 1714688
No longer regressions: 1714688

Hey Natalia, I sure can work on this. Could you tell me where to start ?

Flags: needinfo?(surajeet310)

I'll take a look at this a little later this morning and see what direction we need to push this in Surajeet 👍

Sure !

Hmm, this is caused by mochitests still using Python 2.
This was my mistake, I thought that the affected files were only used with Python 3.

Natalia, can we back out 997f00815e6b and 941f6c6c51e3 in the meantime?

Flags: needinfo?(ncsoregi)

(In reply to Mitchell Hentges [:mhentges] 🦀 from comment #5)

Hmm, this is caused by mochitests still using Python 2.
This was my mistake, I thought that the affected files were only used with Python 3.

Natalia, can we back out 997f00815e6b and 941f6c6c51e3 in the meantime?

Backout link: https://hg.mozilla.org/integration/autoland/rev/9f610f245248d3ed84e470279b6e42bcfada2efa

Status: NEW → RESOLVED
Closed: 6 months ago
Flags: needinfo?(ncsoregi)
Resolution: --- → FIXED
Target Milestone: --- → 91 Branch
You need to log in before you can comment on or make changes to this bug.