Closed Bug 1503163 Opened 6 years ago Closed 6 years ago

Intermittent make: *** [configure] Error 1 after Error is not recoverable: exiting now due to corrupted xz archive

Categories

(Firefox Build System :: General, defect, P5)

Product:
Firefox Build System
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

Filed by: ebalazs [at] mozilla.com https://treeherder.mozilla.org/logviewer.html#?job_id=208563926&repo=autoland https://queue.taskcluster.net/v1/task/NcaJS7VhT_KbGkDp9b192A/runs/0/artifacts/public/logs/live_backing.log checking for rustc... not found [task 2018-10-30T06:34:11.079Z] 06:34:11 INFO - DEBUG: rustc: Trying /builds/worker/workspace/build/src/rustc/bin/rustc [task 2018-10-30T06:34:11.079Z] 06:34:11 INFO - ERROR: Cannot find rustc [task 2018-10-30T06:34:11.115Z] 06:34:11 INFO - *** Fix above errors and then restart with\ [task 2018-10-30T06:34:11.115Z] 06:34:11 INFO - "./mach build" [task 2018-10-30T06:34:11.116Z] 06:34:11 INFO - client.mk:111: recipe for target 'configure' failed [task 2018-10-30T06:34:11.116Z] 06:34:11 INFO - make: *** [configure] Error 1 [task 2018-10-30T06:34:11.187Z] 06:34:11 ERROR - Return code: 2 [task 2018-10-30T06:34:11.187Z] 06:34:11 WARNING - setting return code to 2 [task 2018-10-30T06:34:11.187Z] 06:34:11 FATAL - 'mach build -v' did not run successfully. Please check log for errors. [task 2018-10-30T06:34:11.187Z] 06:34:11 FATAL - Running post_fatal callback... [task 2018-10-30T06:34:11.187Z] 06:34:11 FATAL - Exiting -1 [task 2018-10-30T06:34:11.188Z] 06:34:11 INFO - [mozharness: 2018-10-30 06:34:11.188059Z] Finished build step (failed) [task 2018-10-30T06:34:11.188Z] 06:34:11 INFO - Running post-run listener: _shutdown_sccache [task 2018-10-30T06:34:11.188Z] 06:34:11 INFO - Running command: ['/builds/worker/workspace/build/src/sccache2/sccache', '--stop-server'] in /builds/worker/workspace/build/src [task 2018-10-30T06:34:11.188Z] 06:34:11 INFO - Copy/paste: /builds/worker/workspace/build/src/sccache2/sccache --stop-server [task 2018-10-30T06:34:11.192Z] 06:34:11 INFO - Stopping sccache server... [task 2018-10-30T06:34:11.192Z] 06:34:11 INFO - Compile requests 93 [task 2018-10-30T06:34:11.192Z] 06:34:11 INFO - Compile requests executed 83 [task 2018-10-30T06:34:11.192Z] 06:34:11 INFO - Cache hits 69 [task 2018-10-30T06:34:11.193Z] 06:34:11 INFO - Cache misses 0 [task 2018-10-30T06:34:11.193Z] 06:34:11 INFO - Cache timeouts 0 [task 2018-10-30T06:34:11.193Z] 06:34:11 INFO - Cache read errors 0 [task 2018-10-30T06:34:11.193Z] 06:34:11 INFO - Forced recaches 0 [task 2018-10-30T06:34:11.193Z] 06:34:11 INFO - Cache write errors 0 [task 2018-10-30T06:34:11.193Z] 06:34:11 INFO - Compilation failures 1 [task 2018-10-30T06:34:11.194Z] 06:34:11 INFO - Cache errors 13 [task 2018-10-30T06:34:11.194Z] 06:34:11 INFO - Non-cacheable compilations 0 [task 2018-10-30T06:34:11.194Z] 06:34:11 INFO - Non-cacheable calls 7 [task 2018-10-30T06:34:11.194Z] 06:34:11 INFO - Non-compilation calls 3 [task 2018-10-30T06:34:11.194Z] 06:34:11 INFO - Unsupported compiler calls 0 [task 2018-10-30T06:34:11.194Z] 06:34:11 INFO - Average cache write 0.000 s [task 2018-10-30T06:34:11.195Z] 06:34:11 INFO - Average cache read miss 0.000 s [task 2018-10-30T06:34:11.195Z] 06:34:11 INFO - Average cache read hit 0.029 s [task 2018-10-30T06:34:11.195Z] 06:34:11 INFO - Cache location S3, bucket: Bucket(name=taskcluster-level-3-sccache-us-east-1, base_url=http://taskcluster-level-3-sccache-us-east-1.s3.amazonaws.com/) [task 2018-10-30T06:34:11.195Z] 06:34:11 INFO - Return code: 0 [task 2018-10-30T06:34:11.195Z] 06:34:11 INFO - Running post-run listener: _summarize [task 2018-10-30T06:34:11.196Z] 06:34:11 ERROR - # TBPL FAILURE # [task 2018-10-30T06:34:11.196Z] 06:34:11 INFO - [mozharness: 2018-10-30 06:34:11.196224Z] FxDesktopBuild summary: [task 2018-10-30T06:34:11.196Z] 06:34:11 ERROR - # TBPL FAILURE # [task 2018-10-30T06:34:11.196Z] 06:34:11 INFO - Running post-run listener: copy_logs_to_upload_dir [task 2018-10-30T06:34:11.196Z] 06:34:11 INFO - Copying logs to upload dir... [task 2018-10-30T06:34:11.196Z] 06:34:11 INFO - mkdir: /builds/worker/workspace/build/upload/logs [task 2018-10-30T06:34:11.197Z] 06:34:11 DEBUG - Copying /builds/worker/logs/localconfig.json to /builds/worker/workspace/build/upload/logs/localconfig.json [task 2018-10-30T06:34:11.197Z] 06:34:11 DEBUG - mkdir_p: /builds/worker/workspace/build/upload/logs Already exists. [task 2018-10-30T06:34:11.197Z] 06:34:11 DEBUG - Copying /builds/worker/logs/log_info.log to /builds/worker/workspace/build/upload/logs/log_info.log [task 2018-10-30T06:34:11.197Z] 06:34:11 DEBUG - mkdir_p: /builds/worker/workspace/build/upload/logs Already exists. [task 2018-10-30T06:34:11.198Z] 06:34:11 DEBUG - Copying /builds/worker/logs/log_raw.log to /builds/worker/workspace/build/upload/logs/log_raw.log [task 2018-10-30T06:34:11.198Z] 06:34:11 DEBUG - mkdir_p: /builds/worker/workspace/build/upload/logs Already exists. [task 2018-10-30T06:34:11.198Z] 06:34:11 DEBUG - Copying /builds/worker/logs/log_warning.log to /builds/worker/workspace/build/upload/logs/log_warning.log [task 2018-10-30T06:34:11.198Z] 06:34:11 DEBUG - mkdir_p: /builds/worker/workspace/build/upload/logs Already exists. [task 2018-10-30T06:34:11.198Z] 06:34:11 DEBUG - Copying /builds/worker/logs/log_critical.log to /builds/worker/workspace/build/upload/logs/log_critical.log [task 2018-10-30T06:34:11.199Z] 06:34:11 DEBUG - mkdir_p: /builds/worker/workspace/build/upload/logs Already exists. [task 2018-10-30T06:34:11.199Z] 06:34:11 DEBUG - Copying /builds/worker/logs/log_error.log to /builds/worker/workspace/build/upload/logs/log_error.log [task 2018-10-30T06:34:11.199Z] 06:34:11 DEBUG - mkdir_p: /builds/worker/workspace/build/upload/logs Already exists. [task 2018-10-30T06:34:11.199Z] 06:34:11 DEBUG - Copying /builds/worker/logs/log_debug.log to /builds/worker/workspace/build/upload/logs/log_debug.log [task 2018-10-30T06:34:11.199Z] 06:34:11 DEBUG - mkdir_p: /builds/worker/workspace/build/upload/logs Already exists. [task 2018-10-30T06:34:11.200Z] 06:34:11 DEBUG - Copying /builds/worker/logs/log_fatal.log to /builds/worker/workspace/build/upload/logs/log_fatal.log [task 2018-10-30T06:34:11.206Z] cleanup [task 2018-10-30T06:34:11.206Z] + cleanup [task 2018-10-30T06:34:11.206Z] + local rv=255 [task 2018-10-30T06:34:11.206Z] + cleanup_xvfb [task 2018-10-30T06:34:11.207Z] pidof Xvfb [task 2018-10-30T06:34:11.207Z] ++ pidof Xvfb [task 2018-10-30T06:34:11.208Z] + local xvfb_pid=55 [task 2018-10-30T06:34:11.208Z] + local vnc=false [task 2018-10-30T06:34:11.208Z] + local interactive=false [task 2018-10-30T06:34:11.208Z] + '[' -n 55 ']' [task 2018-10-30T06:34:11.208Z] + [[ false == false ]] [task 2018-10-30T06:34:11.208Z] + [[ false == false ]] [task 2018-10-30T06:34:11.208Z] + kill 55 [task 2018-10-30T06:34:11.208Z] + screen -XS xvfb quit [task 2018-10-30T06:34:11.348Z] No screen session found. [task 2018-10-30T06:34:11.348Z] + true [task 2018-10-30T06:34:11.348Z] + exit 255 [taskcluster 2018-10-30 06:34:11.700Z] === Task Finished === [taskcluster 2018-10-30 06:34:12.689Z] Unsuccessful task run with exit code: 255 completed in 364.282 seconds
Most interesting part of the log is: [task 2018-10-30T06:33:37.449Z] 06:33:37 INFO - 2:39.91 untarring "/builds/worker/workspace/build/src/rustc.tar.xz" [task 2018-10-30T06:33:46.805Z] 06:33:46 INFO - 2:49.27 xz: (stdin): Unexpected end of input [task 2018-10-30T06:33:46.805Z] 06:33:46 INFO - 2:49.27 tar: Unexpected EOF in archive [task 2018-10-30T06:33:46.805Z] 06:33:46 INFO - 2:49.27 tar: Unexpected EOF in archive [task 2018-10-30T06:33:46.805Z] 06:33:46 INFO - 2:49.27 tar: Error is not recoverable: exiting now Which means several things: - we should be doing a checksum of the rustc.tar.xz file, and that should have failed. - the untar function doesn't throw/fail when the tar process fails
(In reply to Mike Hommey [:glandium] from comment #1) > - we should be doing a checksum of the rustc.tar.xz file, and that should > have failed. Note that this can happen silently when chainOfTrust.json.asc can't be downloaded. The ideal solution here would be for everything to switch to the new artifacts API, which does provide checksums.
Summary: Intermittent make: *** [configure] Error 1 after ERROR: Cannot find rustc → Intermittent make: *** [configure] Error 1 after Error is not recoverable: exiting now due to corrupted xz archive
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.