1958041 - Perma MinGW ld.lld: error: undefined symbol: HUF_decompress4X2_usingDTable_internal_fast_asm_loop

Status: RESOLVED FIXED

(Core :: Networking, defect)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=502071252&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MLCdAsF6T5SOB8Ho60FsQg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2025-04-02T16:58:37.879Z] 16:58:37     INFO -  gmake[4]: Leaving directory '/builds/worker/workspace/obj-build/toolkit/library/build'
[task 2025-04-02T16:58:37.879Z] 16:58:37     INFO -  gmake[4]: Entering directory '/builds/worker/workspace/obj-build/toolkit/library/build'
[task 2025-04-02T16:58:37.879Z] 16:58:37     INFO -  rm -f ../../../dist/bin/xul.dll
[task 2025-04-02T16:58:37.879Z] 16:58:37     INFO -  gmake[4]: Leaving directory '/builds/worker/workspace/obj-build/toolkit/library/build'
[task 2025-04-02T16:58:37.880Z] 16:58:37     INFO -  gmake[4]: Entering directory '/builds/worker/workspace/obj-build/browser/app/nmhproxy'
[task 2025-04-02T16:58:37.880Z] 16:58:37     INFO -  /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/build/bin/python /builds/worker/checkouts/gecko/config/create_res.py -DNDEBUG=1 -DTRIMMED=1 -I/builds/worker/checkouts/gecko/browser/app/nmhproxy -I/builds/worker/workspace/obj-build/browser/app/nmhproxy  -I/builds/worker/workspace/obj-build/dist/include  -o module.res module.rc
[task 2025-04-02T16:58:37.880Z] 16:58:37     INFO -  Executing: /builds/worker/fetches/clang/bin/x86_64-w64-mingw32-windres -O coff -D NDEBUG=1 -D TRIMMED=1 --include-dir /builds/worker/checkouts/gecko/browser/app/nmhproxy --include-dir /builds/worker/workspace/obj-build/browser/app/nmhproxy --include-dir /builds/worker/workspace/obj-build/dist/include -o module.res module.rc
[task 2025-04-02T16:58:37.880Z] 16:58:37     INFO -  gmake[4]: Leaving directory '/builds/worker/workspace/obj-build/browser/app/nmhproxy'
[task 2025-04-02T16:58:37.881Z] 16:58:37     INFO -  gmake[4]: Entering directory '/builds/worker/workspace/obj-build/browser/app/nmhproxy'
[task 2025-04-02T16:58:37.881Z] 16:58:37     INFO -  gmake[4]: Leaving directory '/builds/worker/workspace/obj-build/browser/app/nmhproxy'
[task 2025-04-02T16:58:37.881Z] 16:58:37     INFO -  gmake[4]: Entering directory '/builds/worker/workspace/obj-build/browser/app/nmhproxy'
[task 2025-04-02T16:58:37.881Z] 16:58:37     INFO -  gmake[4]: Leaving directory '/builds/worker/workspace/obj-build/browser/app/nmhproxy'
[task 2025-04-02T16:58:37.881Z] 16:58:37     INFO -  gmake[4]: Entering directory '/builds/worker/workspace/obj-build/toolkit/library/build'
[task 2025-04-02T16:58:37.883Z] 16:58:37     INFO -  /builds/worker/fetches/sccache/sccache /builds/worker/fetches/clang/bin/x86_64-w64-mingw32-clang++ -shared -Wl,--gc-sections -Wl,--out-implib -Wl,libxul.a -Wl,-pdb,xul.pdb -o ../../../dist/bin/xul.dll -Wl,@/builds/worker/workspace/obj-build/toolkit/library/build/xul_dll.list xul.dll.res   -Wl,--no-insert-timestamp -Wl,--build-id=sha1 -fstack-protector-strong -Wl,--dynamicbase -Wl,-Xlink=-DELAYLOAD:avrt.dll -Wl,-Xlink=-DELAYLOAD:comdlg32.dll -Wl,-Xlink=-DELAYLOAD:credui.dll -Wl,-Xlink=-DELAYLOAD:d3d11.dll -Wl,-Xlink=-DELAYLOAD:D3DCompiler_47.dll -Wl,-Xlink=-DELAYLOAD:dhcpcsvc.dll -Wl,-Xlink=-DELAYLOAD:dnsapi.dll -Wl,-Xlink=-DELAYLOAD:dwmapi.dll -Wl,-Xlink=-DELAYLOAD:dxgi.dll -Wl,-Xlink=-DELAYLOAD:gdi32.dll -Wl,-Xlink=-DELAYLOAD:hid.dll -Wl,-Xlink=-DELAYLOAD:imm32.dll -Wl,-Xlink=-DELAYLOAD:iphlpapi.dll -Wl,-Xlink=-DELAYLOAD:msi.dll -Wl,-Xlink=-DELAYLOAD:msimg32.dll -Wl,-Xlink=-DELAYLOAD:netapi32.dll -Wl,-Xlink=-DELAYLOAD:ole32.dll -Wl,-Xlink=-DELAYLOAD:oleaut32.dll -Wl,-Xlink=-DELAYLOAD:secur32.dll -Wl,-Xlink=-DELAYLOAD:setupapi.dll -Wl,-Xlink=-DELAYLOAD:shell32.dll -Wl,-Xlink=-DELAYLOAD:shlwapi.dll -Wl,-Xlink=-DELAYLOAD:urlmon.dll -Wl,-Xlink=-DELAYLOAD:user32.dll -Wl,-Xlink=-DELAYLOAD:userenv.dll -Wl,-Xlink=-DELAYLOAD:usp10.dll -Wl,-Xlink=-DELAYLOAD:uxtheme.dll -Wl,-Xlink=-DELAYLOAD:wininet.dll -Wl,-Xlink=-DELAYLOAD:winmm.dll -Wl,-Xlink=-DELAYLOAD:winspool.drv -Wl,-Xlink=-DELAYLOAD:wtsapi32.dll -Wl,-Xlink=-DELAYLOAD:oleacc.dll -Wl,-Xlink=-DELAYLOAD:UIAutomationCore.dll -Wl,-Xlink=-DELAYLOAD:api-ms-win-core-winrt-l1-1-0.dll -Wl,-Xlink=-DELAYLOAD:api-ms-win-core-winrt-string-l1-1-0.dll  ../../../js/src/build/libjs_static.a ../../../build/pure_virtual/libpure_virtual.a ../../../x86_64-pc-windows-gnu/release/libgkrust.a ../../../security/libnss3.a ../../../config/external/gkcodecs/libgkcodecs.a ../../../config/external/lgpllibs/liblgpllibs.a ../../../mozglue/build/libmozglue.a xul.dll.def  -lavrt -lksuser -lshell32 -ldbghelp -lhid -lktmw32 -lrpcrt4 -lurlmon -lwinmm -lntdll -ladvapi32 -lbcrypt -lcredui -lcrypt32 -lkernel32 -lncrypt -luserenv -lws2_32 -lsynchronization -lmsi -lpropsys -lmfuuid -lwmcodecdspuuid -lstrmiids -lgdi32 -lole32 -lversion -lwinspool -luuid -lcomdlg32 -limm32 -lmsimg32 -lnetapi32 -lshlwapi -ldnsapi -ldwmapi -liphlpapi -luxtheme -lsetupapi -lsecur32 -lsensorsapi -lportabledeviceguids -lwininet -lwintrust -lwtsapi32 -llocationapi -lsapi -ldxguid -ldhcpcsvc -ld3dcompiler -lruntimeobject -loleacc -luiautomationcore -lusp10 -loleaut32 -ldelayimp
[task 2025-04-02T16:58:37.883Z] 16:58:37     INFO -  lld: warning: unsupported build id hashing: sha1, using default hashing.
[task 2025-04-02T16:58:37.883Z] 16:58:37    ERROR -  ld.lld: error: undefined symbol: HUF_decompress4X2_usingDTable_internal_fast_asm_loop
[task 2025-04-02T16:58:37.884Z] 16:58:37     INFO -  >>> referenced by /builds/worker/checkouts/gecko/third_party/zstd/lib/decompress/huf_decompress.c:1729
[task 2025-04-02T16:58:37.884Z] 16:58:37     INFO -  >>>               ../../../third_party/zstd/Unified_c_third_party_zstd0.o:(HUF_decompress4X2_usingDTable_internal)
[task 2025-04-02T16:58:37.884Z] 16:58:37    ERROR -  ld.lld: error: undefined symbol: HUF_decompress4X1_usingDTable_internal_fast_asm_loop
[task 2025-04-02T16:58:37.884Z] 16:58:37     INFO -  >>> referenced by /builds/worker/checkouts/gecko/third_party/zstd/lib/decompress/huf_decompress.c:907
[task 2025-04-02T16:58:37.884Z] 16:58:37     INFO -  >>>               ../../../third_party/zstd/Unified_c_third_party_zstd0.o:(HUF_decompress4X1_usingDTable_internal)
[task 2025-04-02T16:58:37.885Z] 16:58:37    ERROR -  clang: error: linker command failed with exit code 1 (use -v to see invocation)
[task 2025-04-02T16:58:37.885Z] 16:58:37    ERROR -  gmake[4]: *** [/builds/worker/checkouts/gecko/config/rules.mk:539: ../../../dist/bin/xul.dll] Error 1
[task 2025-04-02T16:58:37.885Z] 16:58:37     INFO -  gmake[4]: Leaving directory '/builds/worker/workspace/obj-build/toolkit/library/build'
[task 2025-04-02T16:58:37.885Z] 16:58:37     INFO -  gmake[4]: Target 'target' not remade because of errors.
[task 2025-04-02T16:58:37.885Z] 16:58:37    ERROR -  gmake[3]: *** [/builds/worker/checkouts/gecko/config/recurse.mk:72: toolkit/library/build/target] Error 2
[task 2025-04-02T16:58:39.773Z] 16:58:39     INFO -  gmake[4]: Entering directory '/builds/worker/workspace/obj-build/browser/app/nmhproxy'
[task 2025-04-02T16:58:39.774Z] 16:58:39     INFO -  /builds/worker/fetches/rustc/bin/cargo rustc --timings --keep-going  --release --frozen --manifest-path /builds/worker/checkouts/gecko/browser/app/nmhproxy/Cargo.toml -vv    --bin nmhproxy --target=x86_64-pc-windows-gnu --features mozilla-central-workspace-hack -- -C link-arg=/builds/worker/workspace/obj-build/browser/app/nmhproxy/module.res -C default-linker-libraries=yes
[task 2025-04-02T16:58:39.774Z] 16:58:39     INFO -         Fresh unicode-ident v1.0.6
[task 2025-04-02T16:58:39.774Z] 16:58:39     INFO -         Fresh stable_deref_trait v1.2.0
[task 2025-04-02T16:58:39.774Z] 16:58:39     INFO -         Fresh litemap v0.7.3
[task 2025-04-02T16:58:39.774Z] 16:58:39     INFO -         Fresh writeable v0.5.5
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -         Fresh version_check v0.9.4
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -         Fresh cfg-if v1.0.0
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -         Fresh once_cell v1.21.1
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -         Fresh byteorder v1.5.0
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -         Fresh icu_locid_transform_data v1.5.0
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -  warning: unexpected `cfg` condition name: `icu4x_custom_data`
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -    --> /builds/worker/checkouts/gecko/third_party/rust/icu_locid_transform_data/src/lib.rs:14:7
[task 2025-04-02T16:58:39.775Z] 16:58:39     INFO -     |
[task 2025-04-02T16:58:39.776Z] 16:58:39     INFO -  14 | #[cfg(icu4x_custom_data)]
[task 2025-04-02T16:58:39.776Z] 16:58:39     INFO -     |       ^^^^^^^^^^^^^^^^^
[task 2025-04-02T16:58:39.776Z] 16:58:39     INFO -     |
[task 2025-04-02T16:58:39.776Z] 16:58:39     INFO -     = help: expected names are: `clippy`, `debug_assertions`, `doc`, `docsrs`, `doctest`, `feature`, `fmt_debug`, `miri`, `overflow_checks`, `panic`, `proc_macro`, `relocation_model`, `rustfmt`, `sanitize`, `sanitizer_cfi_generalize_pointers`, `sanitizer_cfi_normalize_integers`, `target_abi`, `target_arch`, `target_endian`, `target_env`, `target_family`, `target_feature`, `target_has_atomic`, `target_has_atomic_equal_alignment`, `target_has_atomic_load_store`, `target_os`, `target_pointer_width`, `target_thread_local`, `target_vendor`, `test`, `ub_checks`, `unix`, and `windows`
[task 2025-04-02T16:58:39.776Z] 16:58:39     INFO -     = help: consider using a Cargo feature instead
[task 2025-04-02T16:58:39.776Z] 16:58:39     INFO -     = help: or consider adding in `Cargo.toml` the `check-cfg` lint config for the lint:
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -              [lints.rust]
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -              unexpected_cfgs = { level = "warn", check-cfg = ['cfg(icu4x_custom_data)'] }
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -     = help: or consider adding `println!("cargo::rustc-check-cfg=cfg(icu4x_custom_data)");` to the top of the `build.rs`
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -     = note: see <https://doc.rust-lang.org/nightly/rustc/check-cfg/cargo-specifics.html> for more information about checking conditional configuration
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -     = note: `#[warn(unexpected_cfgs)]` on by default
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -  warning: unexpected `cfg` condition name: `icu4x_custom_data`
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -    --> /builds/worker/checkouts/gecko/third_party/rust/icu_locid_transform_data/src/lib.rs:16:11
[task 2025-04-02T16:58:39.777Z] 16:58:39     INFO -     |
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -  16 | #[cfg(not(icu4x_custom_data))]
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -     |           ^^^^^^^^^^^^^^^^^
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -     |
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -     = help: consider using a Cargo feature instead
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -     = help: or consider adding in `Cargo.toml` the `check-cfg` lint config for the lint:
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -              [lints.rust]
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -              unexpected_cfgs = { level = "warn", check-cfg = ['cfg(icu4x_custom_data)'] }
[task 2025-04-02T16:58:39.778Z] 16:58:39     INFO -     = help: or consider adding `println!("cargo::rustc-check-cfg=cfg(icu4x_custom_data)");` to the top of the `build.rs`
[task 2025-04-02T16:58:39.779Z] 16:58:39     INFO -     = note: see <https://doc.rust-lang.org/nightly/rustc/check-cfg/cargo-specifics.html> for more information about checking conditional configuration
[task 2025-04-02T16:58:39.779Z] 16:58:39     INFO -         Fresh icu_properties_data v1.5.0
[task 2025-04-02T16:58:39.779Z] 16:58:39     INFO -  warning: unexpected `cfg` condition name: `icu4x_custom_data`
[task 2025-04-02T16:58:39.779Z] 16:58:39     INFO -    --> /builds/worker/checkouts/gecko/third_party/rust/icu_properties_data/src/lib.rs:14:7
[task 2025-04-02T16:58:39.779Z] 16:58:39     INFO -     |
[task 2025-04-02T16:58:39.779Z] 16:58:39     INFO -  14 | #[cfg(icu4x_custom_data)]

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1949314

:jesup, since you are the author of the regressor, bug 1949314, could you take a look?

For more information, please visit BugBot documentation.

Comment 2

[Ryan VanderMeulen [:RyanVM]]

Due to https://hg.mozilla.org/mozilla-central/diff/981210d24352b42836f28437294745872565d4e7/third_party/zstd/lib/common/portability_macros.h I'm guessing?

Comment 3

[Biswapriyo Nath [:biswa96]]

In third_party/zstd/moz.build file, does CXXFLAGS += [ '-DZSTD_DISABLE_ASM=1' ] apply to CFLAGS also? If false, adding CFLAGS += [ '-DZSTD_DISABLE_ASM=1' ] or DEFINES["ZSTD_DISABLE_ASM"] = 1 there may solve the issue.

Comment 4

[Intermittent Failures Robot]

28 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 28

Table

	no_variant
windows-mingw32--/all	28

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1958041&startday=2025-03-31&endday=2025-04-06&tree=all

Comment 5

[Ryan VanderMeulen [:RyanVM]]

(In reply to Biswapriyo Nath [:biswa96] from comment #3)

DEFINES["ZSTD_DISABLE_ASM"] = 1 there may solve the issue.

Indeed, this looks good on Try.
https://treeherder.mozilla.org/jobs?repo=try&revision=1e0be90a5631ba3c6f5f7f5e9b031bb0f635fe36

Comment 6

[Ryan VanderMeulen [:RyanVM]]

Attachment: Bug 1958041 - Pass the ZSTD_DISABLE_ASM flag more consistently to Windows builds.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5acb9a9f0105
Pass the ZSTD_DISABLE_ASM flag more consistently to Windows builds. r=jesup

Comment 8

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/5acb9a9f0105

Comment 9

[Intermittent Failures Robot]

18 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 18

Table

	no_variant
windows-mingw32--/all	18

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1958041&startday=2025-04-07&endday=2025-04-13&tree=all