Closed Bug 1891899 Opened 9 months ago Closed 8 months ago

Perma [taskcluster:error] Uploading error artifact public/build from file public/build with message "Could not read directory 'D:\\task_171331547344886\\public\\build'", reason "file-missing-on-worker" and expiry 2024-07-16T01:03:08.333Z

Categories

(Testing :: Performance, defect, P5)

defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=454775103&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Qx7Bw1LNSFaAmGffgyJuYg/runs/0/artifacts/public/logs/live_backing.log


[task 2024-04-17T01:26:39.369Z] [6594/65433] CXX obj/third_party/abseil-cpp/absl/time/internal/cctz/time_zone/time_zone_lookup.obj
[task 2024-04-17T01:26:39.369Z] ninja: build stopped: subcommand failed.
[taskcluster 2024-04-17T01:26:40.019Z]    Exit Code: 1
[taskcluster 2024-04-17T01:26:40.019Z]    User Time: 31.25ms
[taskcluster 2024-04-17T01:26:40.019Z]  Kernel Time: 31.25ms
[taskcluster 2024-04-17T01:26:40.019Z]    Wall Time: 23m0.7947043s
[taskcluster 2024-04-17T01:26:40.019Z]       Result: FAILED
[taskcluster 2024-04-17T01:26:40.019Z] === Task Finished ===
[taskcluster 2024-04-17T01:26:40.019Z] Task Duration: 23m0.7952474s
[taskcluster:error] Uploading error artifact public/build from file public/build with message "Could not read directory 'D:\\task_171331547344886\\public\\build'", reason "file-missing-on-worker" and expiry 2024-07-16T01:03:08.333Z
[taskcluster:error] TASK FAILURE during artifact upload: file-missing-on-worker: Could not read directory 'D:\task_171331547344886\public\build'
[taskcluster 2024-04-17T01:26:40.269Z] Uploading artifact public/logs/certified.log from file D:\task_171331547344886\generic-worker\certified.log with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2024-07-16T01:03:08.333Z
[taskcluster 2024-04-17T01:26:40.628Z] Uploading artifact public/chain-of-trust.json from file D:\task_171331547344886\generic-worker\chain-of-trust.json with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2024-07-16T01:03:08.333Z
[taskcluster 2024-04-17T01:26:40.821Z] Uploading artifact public/chain-of-trust.json.sig from file D:\task_171331547344886\generic-worker\chain-of-trust.json.sig with content encoding "gzip", mime type "application/octet-stream" and expiry 2024-07-16T01:03:08.333Z
[taskcluster 2024-04-17T01:26:41.040Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-07-16T01:03:08.333Z
[taskcluster:error] exit status 1

Summary: Intermittent [taskcluster:error] Uploading error artifact public/build from file public/build with message "Could not read directory 'D:\\task_171331547344886\\public\\build'", reason "file-missing-on-worker" and expiry 2024-07-16T01:03:08.333Z → Perma [taskcluster:error] Uploading error artifact public/build from file public/build with message "Could not read directory 'D:\\task_171331547344886\\public\\build'", reason "file-missing-on-worker" and expiry 2024-07-16T01:03:08.333Z
Flags: needinfo?(mh+mozilla)

More relevant log:

[task 2024-04-17T01:26:33.476Z] FAILED: obj/third_party/abseil-cpp/absl/time/internal/cctz/time_zone/time_zone_libc.obj 
[task 2024-04-17T01:26:33.476Z] ..\..\third_party\llvm-build\Release+Asserts\bin\clang-cl.exe /c ../../third_party/abseil-cpp/absl/time/internal/cctz/src/time_zone_libc.cc /Foobj/third_party/abseil-cpp/absl/time/internal/cctz/time_zone/time_zone_libc.obj /nologo /showIncludes:user -imsvc../../../../../fetches/vs/VC/Tools/MSVC/14.39.33519/include -imsvc../../../../../fetches/vs/VC/Tools/MSVC/14.39.33519/atlmfc/include "-imsvc../../../../../fetches/vs/Windows Kits/10/Include/10.0.22621.0/ucrt" "-imsvc../../../../../fetches/vs/Windows Kits/10/Include/10.0.22621.0/shared" "-imsvc../../../../../fetches/vs/Windows Kits/10/Include/10.0.22621.0/um" "-imsvc../../../../../fetches/vs/Windows Kits/10/Include/10.0.22621.0/winrt" "-imsvc../../../../../fetches/vs/dia sdk/include" -DUSE_AURA=1 -DOFFICIAL_BUILD -D_LIBCPP_HARDENING_MODE=_LIBCPP_HARDENING_MODE_EXTENSIVE "-DCR_CLANG_REVISION=\"llvmorg-19-init-8091-gab037c4f-22\"" -D_LIBCPP_DISABLE_VISIBILITY_ANNOTATIONS -DCR_LIBCXX_REVISION=e3b94d0e5b86883fd77696bf10dc33ba250ba99b -D__STD_C -D_CRT_RAND_S -D_CRT_SECURE_NO_DEPRECATE -D_SCL_SECURE_NO_DEPRECATE -D_ATL_NO_OPENGL -D_WINDOWS -DCERT_CHAIN_PARA_HAS_EXTRA_FIELDS -DPSAPI_VERSION=2 -DWIN32 -D_SECURE_ATL -DWINAPI_FAMILY=WINAPI_FAMILY_DESKTOP_APP -DWIN32_LEAN_AND_MEAN -DNOMINMAX -D_UNICODE -DUNICODE -DNTDDI_VERSION=NTDDI_WIN10_NI -D_WIN32_WINNT=0x0A00 -DWINVER=0x0A00 -DNDEBUG -DNVALGRIND -DDYNAMIC_ANNOTATIONS_ENABLED=0 -D_CRT_NONSTDC_NO_WARNINGS -D_WINSOCK_DEPRECATED_NO_WARNINGS -DABSL_ALLOCATOR_NOTHROW=1 -I../.. -Igen -I../../buildtools/third_party/libc++ -I../../third_party/abseil-cpp -fno-delete-null-pointer-checks -fno-ident -fcolor-diagnostics -fmerge-all-constants -fcrash-diagnostics-dir=../../tools/clang/crashreports -mllvm -instcombine-lower-dbg-declare=0 -mllvm -split-threshold-for-reg-with-hint=0 /clang:-ffp-contract=off -flto=thin -fsplit-lto-unit -fwhole-program-vtables -fcomplete-member-pointers /Gy /FS /bigobj /utf-8 /Zc:twoPhase -ffile-reproducible /Zc:sizedDealloc- /D__WRL_ENABLE_FUNCTION_STATICS__ -fmsc-version=1934 -m64 -msse3 -ffile-compilation-dir=. -no-canonical-prefixes -ftrivial-auto-var-init=pattern /O2 /Oy- /Zc:inline /Gw /clang:-fno-math-errno -fprofile-use=../../build/config/compiler/pgo/chrome-win64-main-1713301186-7fa3433d41e49d4fe6158683f0676c0602f38a49-00de2a9e298799fa923cf42cb85cad16cbf4466f.profdata -Wno-profile-instr-unprofiled -Wno-profile-instr-out-of-date -Wno-backend-plugin /guard:cf /MT -Wheader-hygiene -Wstring-conversion -Wtautological-overlap-compare -Xclang -add-plugin -Xclang find-bad-constructs -Xclang -plugin-arg-find-bad-constructs -Xclang raw-ref-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang check-stack-allocated -Xclang -plugin-arg-find-bad-constructs -Xclang check-allow-auto-typedefs-better-nested -Xclang -plugin-arg-find-bad-constructs -Xclang check-raw-ptr-to-stack-allocated -Xclang -plugin-arg-find-bad-constructs -Xclang disable-check-raw-ptr-to-stack-allocated-error -Xclang -plugin-arg-find-bad-constructs -Xclang raw-ptr-exclude-path=/third_party/dawn/ -Xclang -add-plugin -Xclang unsafe-buffers -Xclang -plugin-arg-unsafe-buffers -Xclang ../../build/config/unsafe_buffers_paths.txt /W3 /wd4800 /wd4267 -Wno-unused-variable -Wno-c++11-narrowing -Wno-unused-but-set-variable -Wno-misleading-indentation -Wno-missing-field-initializers -Wno-unused-parameter -Wno-psabi -Wloop-analysis -Wno-unneeded-internal-declaration -Wno-nonportable-include-path -Wno-cast-function-type -Wno-ignored-pragma-optimize -Wno-deprecated-builtins -Wno-bitfield-constant-conversion -Wno-deprecated-this-capture -Wno-invalid-offsetof -Wno-vla-extension -Wno-thread-safety-reference-return /WX -Wshorten-64-to-32 -Wimplicit-int-conversion -Wsign-compare -Wsign-conversion -Wtautological-unsigned-zero-compare /std:c++20 -Wno-trigraphs /TP /GR- -I../../third_party/libc++/src/include -Wenum-compare-conditional -Wno-c++11-narrowing-const-reference -Wbool-conversion -Wconstant-conversion -Wenum-conversion -Wint-conversion -Wliteral-conversion -Wnon-literal-null-conversion -Wnull-conversion -Wobjc-literal-conversion -Wstring-conversion -Wbitfield-enum-conversion /Fd"obj/third_party/abseil-cpp/absl/time/internal/cctz/time_zone_cc.pdb"
[task 2024-04-17T01:26:33.476Z] ../../third_party/abseil-cpp/absl/time/internal/cctz/src/time_zone_libc.cc(51,10): error: unsafe buffer access [-Werror,-Wunsafe-buffer-usage]
[task 2024-04-17T01:26:33.476Z]    51 |   return _tzname[is_dst];
[task 2024-04-17T01:26:33.476Z]       |          ^~~~~~~
[task 2024-04-17T01:26:33.476Z] ../../../../../fetches/vs/Windows Kits/10/Include/10.0.22621.0/ucrt\time.h(88,17): note: expanded from macro '_tzname'
[task 2024-04-17T01:26:33.476Z]    88 | #define _tzname (__tzname())
[task 2024-04-17T01:26:33.476Z]       |                 ^~~~~~~~~~~~
[task 2024-04-17T01:26:33.476Z] ../../third_party/abseil-cpp/absl/time/internal/cctz/src/time_zone_libc.cc(51,10): note: See //docs/unsafe_buffers.md for help.
[task 2024-04-17T01:26:33.757Z] ../../../../../fetches/vs/Windows Kits/10/Include/10.0.22621.0/ucrt\time.h(88,17): note: expanded from macro '_tzname'
[task 2024-04-17T01:26:33.757Z]    88 | #define _tzname (__tzname())
[task 2024-04-17T01:26:33.757Z]       |                 ^
[task 2024-04-17T01:26:33.757Z] 1 error generated.
Flags: needinfo?(mh+mozilla) → needinfo?(kshampur)

sorry for the late follow up as I was away last week at a work meetup

Looks like it is passing now in CI

something happened between upstream revisions b3126655adca304c01f7121c5dfe76e3e17dd8b2 (first instance of passing again in CI) and c0b47c725887c27821ce0a1db7e0b7a01911b3a2 (last passing in CI)

and first instance of failure in CI 103a1b28cd6e0d28c5ed9093e2b83218f3bc06e5

I will cancel needinfo but going to take a look at these revision range to see if I find anything as the cause

Flags: needinfo?(kshampur)
Component: General → Performance
Product: Firefox Build System → Testing
Status: NEW → RESOLVED
Closed: 8 months ago
Resolution: --- → INCOMPLETE
See Also: → 1906221
See Also: → 1910074
You need to log in before you can comment on or make changes to this bug.