Closed Bug 1764711 Opened 2 years ago Closed 2 years ago

Permanent upload sources failure (task exits as successful) ModuleNotFoundError: No module named 'boto3'

Categories

(Firefox Build System :: Task Configuration, defect, P5)

defect

Tracking

(firefox-esr91 unaffected, firefox99 unaffected, firefox100 unaffected, firefox101 fixed)

RESOLVED FIXED
101 Branch
Tracking Status
firefox-esr91 --- unaffected
firefox99 --- unaffected
firefox100 --- unaffected
firefox101 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: mhentges)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=374466017&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/CG0LbfRvTx-z5az3ecZ2Hw/runs/0/artifacts/public/logs/live_backing.log


Setting this as regressed by bug 1763244, please correct if it isn't. The upload sources for other tasks only run on central but also report this failure. The tasks are green (= not set as failure).

[task 2022-04-14T05:40:04.238Z] Successfully installed boto3-1.4.4 botocore-1.5.95 docutils-0.18.1 jmespath-0.10.0 python-dateutil-2.8.2 s3transfer-0.1.13
[task 2022-04-14T05:40:04.339Z] INFO - MainThread - Using AWS credentials from the secrets service: "http://taskcluster/secrets/v1/secret/project/releng/gecko/build/level-3/gecko-generated-sources-upload"
[task 2022-04-14T05:40:04.546Z] INFO - MainThread - Fetching generated sources artifact: "https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Xp1QlZwsTvK9lQzmcZS4vw/artifacts/public/build/target.generated-files.tar.gz"
[task 2022-04-14T05:40:05.829Z] INFO - MainThread - Fetch HTTP status: 200, 16187525 bytes downloaded in 1.283s
[task 2022-04-14T05:40:05.829Z] INFO - MainThread - Creating 10 worker threads
[task 2022-04-14T05:40:05.833Z] ERROR - Thread-1 - Thread encountered exception:
[task 2022-04-14T05:40:05.833Z] Traceback (most recent call last):
[task 2022-04-14T05:40:05.833Z]   File "build/upload_generated_sources.py", line 67, in upload_worker
[task 2022-04-14T05:40:05.833Z]     import boto3
[task 2022-04-14T05:40:05.833Z] ModuleNotFoundError: No module named 'boto3'
[task 2022-04-14T05:40:05.835Z] ERROR - Thread-2 - Thread encountered exception:
[task 2022-04-14T05:40:05.835Z] Traceback (most recent call last):
[task 2022-04-14T05:40:05.835Z]   File "build/upload_generated_sources.py", line 67, in upload_worker
[task 2022-04-14T05:40:05.835Z]     import boto3
[task 2022-04-14T05:40:05.835Z] ModuleNotFoundError: No module named 'boto3'
[task 2022-04-14T05:40:05.837Z] ERROR - Thread-3 - Thread encountered exception:
[task 2022-04-14T05:40:05.837Z] Traceback (most recent call last):
[task 2022-04-14T05:40:05.837Z]   File "build/upload_generated_sources.py", line 67, in upload_worker
[task 2022-04-14T05:40:05.837Z]     import boto3
[task 2022-04-14T05:40:05.837Z] ModuleNotFoundError: No module named 'boto3'
[task 2022-04-14T05:40:05.841Z] INFO - MainThread - Finished in 1.502s
[task 2022-04-14T05:40:05.916Z] Creating default state directory: /builds/worker/.mozbuild
[taskcluster 2022-04-14 05:40:06.735Z] === Task Finished ===
[taskcluster 2022-04-14 05:40:06.735Z] Successful task run with exit code: 0 completed in 321.016 seconds

The upload_geneated_sources.py script needs boto3, but was:

  • Running in CI with Mach having a site-packages-source of None
  • Using the common site (which inherits Mach's site-packages-source)
  • Installing boto3 outside of the knowledge of the centralized
    dependency system.

Make a upload-generated-sources site, and move boto3 to it.

Assignee: nobody → mhentges
Status: NEW → ASSIGNED
Pushed by mhentges@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/4be62c831d60
Move boto3 to requirement file r=ahal
Flags: needinfo?(mhentges)
Status: ASSIGNED → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → 101 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: