Closed Bug 1843085 Opened 2 years ago Closed 2 years ago

Perma tier2 Can't download from https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/mobile.v3.firefox-android.apks.fenix-nightly.latest.arm64-v8a/artifacts/public/build/fenix/arm64-v8a/target.apk to /builds/task

Categories

(Testing :: Raptor, defect, P5)

Product:
Testing
Component:
Raptor
Type:
defect

Tracking

(firefox117 fixed)

Status:
RESOLVED FIXED
Milestone:
117 Branch
Tracking Flags:
Tracking Status
firefox117 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: sparky)

References

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Bug 1843085 - Fix fenix nightly artifact names. r?#perftest
48 bytes, text/x-phabricator-request
Details | Review

Filed by: nerli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=422398009&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SLQHVv9ITNaSEoe36vdIjw/runs/0/artifacts/public/logs/live_backing.log

[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - retry: attempt #5 caught HTTPError exception: HTTP Error 404: Not Found
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Can't download from https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/mobile.v3.firefox-android.apks.fenix-nightly.latest.arm64-v8a/artifacts/public/build/fenix/arm64-v8a/target.apk to /builds/task_168916711731394/workspace/build/target.apk!
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Caught exception: HTTP Error 404: Not Found
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Caught exception: HTTP Error 404: Not Found
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Caught exception: HTTP Error 404: Not Found
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Caught exception: HTTP Error 404: Not Found
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Caught exception: HTTP Error 404: Not Found
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Running post_fatal callback...
[task 2023-07-12T13:17:42.384Z] 13:17:37    FATAL - Exiting -1
[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - Running post-action listener: _resource_record_post_action
[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - Running post-action listener: find_tests_for_coverage
[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - Running post-action listener: find_tests_for_verification
[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - Running post-action listener: set_extra_try_arguments
[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - Running post-action listener: setup_coverage_tools
[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - [mozharness: 2023-07-12 13:17:37.068193Z] Finished download-and-extract step (failed)
[task 2023-07-12T13:17:42.384Z] 13:17:37     INFO - Running post-run listener: _resource_record_post_run
[task 2023-07-12T13:17:42.384Z] cleanup
[task 2023-07-12T13:17:42.384Z] + cleanup
[task 2023-07-12T13:17:42.384Z] + local rv=255
[task 2023-07-12T13:17:42.384Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2023-07-12T13:17:42.384Z] + '[' ']'
[task 2023-07-12T13:17:42.384Z] + false
[task 2023-07-12T13:17:42.384Z] + exit 255
[task 2023-07-12T13:17:42.384Z] script.py: command finished
[task 2023-07-12T13:17:42.384Z] script.py: enabling charging for device 'SM-A515F' ('R58R36P8V0F')...
[task 2023-07-12T13:17:42.384Z] command_output: adb kill-server, timeout: None, timedout: None, exitcode: 0, output: 
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] netstat -aop
[task 2023-07-12T13:17:42.434Z] Active Internet connections (servers and established)
[task 2023-07-12T13:17:42.434Z] Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name     Timer
[task 2023-07-12T13:17:42.434Z] tcp        0      0 127.0.0.11:38093        0.0.0.0:*               LISTEN      -                    off (0.00/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:8099          0.0.0.0:*               LISTEN      59/taskcluster-prox  off (0.00/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:48197         TIME_WAIT   -                    timewait (59.84/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:35603         TIME_WAIT   -                    timewait (59.98/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:59601         TIME_WAIT   -                    timewait (59.77/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:54747         TIME_WAIT   -                    timewait (59.77/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:44373         TIME_WAIT   -                    timewait (59.84/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:41909         TIME_WAIT   -                    timewait (59.84/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:60134         localhost:60098         ESTABLISHED 27/generic-worker    keepalive (5.00/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:47921         TIME_WAIT   -                    timewait (59.97/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 bitbar-ubuntu-201:41520 137.80.201.35.bc.:https ESTABLISHED 27/generic-worker    keepalive (5.87/0/0)
[task 2023-07-12T13:17:42.434Z] tcp        0      0 localhost:5037          localhost:54431         TIME_WAIT   -                    timewait (59.77/0/0)
[task 2023-07-12T13:17:42.434Z] tcp6       0      0 [::]:60098              [::]:*                  LISTEN      45/livelog           off (0.00/0/0)
[task 2023-07-12T13:17:42.434Z] tcp6       0      0 [::]:60099              [::]:*                  LISTEN      45/livelog           off (0.00/0/0)
[task 2023-07-12T13:17:42.434Z] tcp6       0      0 localhost:60098         localhost:60134         ESTABLISHED 45/livelog           keepalive (8.43/0/0)
[task 2023-07-12T13:17:42.434Z] udp        0      0 127.0.0.11:47041        0.0.0.0:*                           -                    off (0.00/0/0)
[task 2023-07-12T13:17:42.434Z] Active UNIX domain sockets (servers and established)
[task 2023-07-12T13:17:42.434Z] Proto RefCnt Flags       Type       State         I-Node   PID/Program name     Path
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] df -h
[task 2023-07-12T13:17:42.434Z] Filesystem      Size  Used Avail Use% Mounted on
[task 2023-07-12T13:17:42.434Z] overlay         458G   64G  371G  15% /
[task 2023-07-12T13:17:42.434Z] tmpfs            64M     0   64M   0% /dev
[task 2023-07-12T13:17:42.434Z] tmpfs           7.8G     0  7.8G   0% /sys/fs/cgroup
[task 2023-07-12T13:17:42.434Z] shm              64M     0   64M   0% /dev/shm
[task 2023-07-12T13:17:42.434Z] /dev/sda1       458G   64G  371G  15% /test
[task 2023-07-12T13:17:42.434Z] tmpfs           7.8G     0  7.8G   0% /proc/acpi
[task 2023-07-12T13:17:42.434Z] tmpfs           7.8G     0  7.8G   0% /proc/scsi
[task 2023-07-12T13:17:42.434Z] tmpfs           7.8G     0  7.8G   0% /sys/firmware
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] 
[task 2023-07-12T13:17:42.434Z] script.py: exiting with exitcode 255.
[taskcluster 2023-07-12T13:17:42.484Z]    Exit Code: 255
[taskcluster 2023-07-12T13:17:42.484Z]    User Time: 12.034528s
[taskcluster 2023-07-12T13:17:42.484Z]  Kernel Time: 4.079808s
[taskcluster 2023-07-12T13:17:42.484Z]    Wall Time: 12m22.642324458s
[taskcluster 2023-07-12T13:17:42.484Z]       Result: FAILED
[taskcluster 2023-07-12T13:17:42.484Z] === Task Finished ===
[taskcluster 2023-07-12T13:17:42.484Z] Task Duration: 12m22.645240304s
[taskcluster 2023-07-12T13:17:42.628Z] Uploading artifact public/logs/localconfig.json from file workspace/logs/localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2023-10-10T10:37:02.318Z
[taskcluster 2023-07-12T13:17:42.818Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/SLQHVv9ITNaSEoe36vdIjw/runs/0/artifacts/public%2Flogs%2Flive_backing.log with mime type "text/plain; charset=utf-8" and expiry 2023-10-10T10:37:02.318Z
[taskcluster:error] exit status 255

Taskcluster index: https://firefox-ci-tc.services.mozilla.com/tasks/index/mobile.v3.firefox-android.apks.fenix-nightly.latest/arm64-v8a
Task log: Server returned status 404 HTTP Error 404: Not Found for https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/mobile.v3.firefox-android.apks.fenix-nightly.latest.arm64-v8a/artifacts/public/build/fenix/arm64-v8a/target.apk

Artifacts got migrated from AWS to GCP on 2023-07-12 but I am not aware why this would change a route. More likely explanation is the artifact got not migrated, e.g. because it was too old. Greg, can you check what applies here?

Flags: needinfo?(gmierz2)

This happened a few hours before the migration.

Thanks for the needinfo, and the additional information! I'll take a look. It's currently a perma-fail for all Fenix perftests on mozilla-central: https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=browsertime%2Cfenix

:aryx, I'm not sure what happened yet to cause this, but it looks like the artifact names for firefox-android were changed slightly on July 11th. This is the first revision that we find the new routes on: https://firefox-ci-tc.services.mozilla.com/tasks/index/mobile.v3.firefox-android.apks.fenix-nightly.2023.07.11.revision.d6f1e1caed3087e9acb77e779d2a2639cb062765/arm64-v8a

Previously: public/build/fenix/arm64-v8a/target.apk
Now: public/build/target.arm64-v8a.apk

This was the last push the routes were correct on: https://firefox-ci-tc.services.mozilla.com/tasks/index/mobile.v3.firefox-android.apks.fenix-nightly.2023.07.10.latest/arm64-v8a

If I change the artifact name to then we're able to pull the build again: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/d4VZVwnBQzGd4N4-TnjJwQ/artifacts/public/build/target.arm64-v8a.apk

:aryx/:jcristau, would either of you know if this change is expected? If so, I can put in a patch to fix the artifact name we use.

Flags: needinfo?(jcristau)
Flags: needinfo?(gmierz2)
Flags: needinfo?(aryx.bugmail)

Expected. From bug 1831168.

Flags: needinfo?(jcristau)
Flags: needinfo?(aryx.bugmail)
See Also: → 1843222
Assignee: nobody → gmierz2
Status: NEW → ASSIGNED

Sorry about that, I think I knew about this at one point and then forgot when landing the change on the firefox-android side.

Pushed by gmierz2@outlook.com: https://hg.mozilla.org/integration/autoland/rev/2a006f66fd19 Fix fenix nightly artifact names. r=perftest-reviewers,kshampur

No problem :jcristau :)

https://hg.mozilla.org/mozilla-central/rev/2a006f66fd19

Status: ASSIGNED → RESOLVED
Closed: 2 years ago
status-firefox117: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 117 Branch
Regressions: 1844365
Component: mozperftest → Raptor
No longer regressions: 1844365
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: