1722702 - Perma Build Bustage Android WebRender

Reporter

Description

•

3 years ago

[task 2021-07-28T09:57:54.123Z] executing ['bash', '-cx', '$GECKO_PATH/taskcluster/scripts/misc/wrench-android-build.sh release && tar czf reftests.tar.gz reftests/ && cd $GECKO_PATH/testing/mozbase && tar czf mozdevice.tar.gz mozdevice/']in /builds/worker/checkouts/gecko/gfx/wr/wrench
[task 2021-07-28T09:57:54.125Z] + /builds/worker/checkouts/gecko/taskcluster/scripts/misc/wrench-android-build.sh release
[task 2021-07-28T09:57:54.126Z] 
[task 2021-07-28T09:57:54.126Z] MODE=${1?"First argument must be debug|release"}
[task 2021-07-28T09:57:54.126Z] + MODE=release
[task 2021-07-28T09:57:54.126Z] 
[task 2021-07-28T09:57:54.126Z] pushd "${MOZ_FETCHES_DIR}"
[task 2021-07-28T09:57:54.126Z] + pushd /builds/worker/fetches
[task 2021-07-28T09:57:54.126Z] ~/fetches ~/checkouts/gecko/gfx/wr/wrench
[task 2021-07-28T09:57:54.126Z] mv wrench-deps/{vendor,.cargo,cargo-apk} ${GECKO_PATH}/gfx/wr
[task 2021-07-28T09:57:54.126Z] + mv wrench-deps/vendor wrench-deps/.cargo wrench-deps/cargo-apk /builds/worker/checkouts/gecko/gfx/wr
[task 2021-07-28T09:57:55.237Z] popd
[task 2021-07-28T09:57:55.237Z] + popd
[task 2021-07-28T09:57:55.237Z] ~/checkouts/gecko/gfx/wr/wrench
[task 2021-07-28T09:57:55.237Z] 
[task 2021-07-28T09:57:55.237Z] pushd "${GECKO_PATH}/gfx/wr/wrench"
[task 2021-07-28T09:57:55.237Z] + pushd /builds/worker/checkouts/gecko/gfx/wr/wrench
[task 2021-07-28T09:57:55.237Z] ~/checkouts/gecko/gfx/wr/wrench ~/checkouts/gecko/gfx/wr/wrench
[task 2021-07-28T09:57:55.237Z] # These things come from the toolchain dependencies of the job that invokes
[task 2021-07-28T09:57:55.237Z] # this script (webrender-wrench-android-build).
[task 2021-07-28T09:57:55.237Z] export PATH="${PATH}:${MOZ_FETCHES_DIR}/rustc/bin"
[task 2021-07-28T09:57:55.237Z] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/builds/worker/fetches/rustc/bin
[task 2021-07-28T09:57:55.237Z] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/builds/worker/fetches/rustc/bin
[task 2021-07-28T09:57:55.237Z] export ANDROID_HOME="${MOZ_FETCHES_DIR}/android-sdk-linux"
[task 2021-07-28T09:57:55.237Z] + export ANDROID_HOME=/builds/worker/fetches/android-sdk-linux
[task 2021-07-28T09:57:55.237Z] + ANDROID_HOME=/builds/worker/fetches/android-sdk-linux
[task 2021-07-28T09:57:55.237Z] export NDK_HOME="${MOZ_FETCHES_DIR}/android-ndk"
[task 2021-07-28T09:57:55.237Z] + export NDK_HOME=/builds/worker/fetches/android-ndk
[task 2021-07-28T09:57:55.237Z] + NDK_HOME=/builds/worker/fetches/android-ndk
[task 2021-07-28T09:57:55.237Z] 
# `cargo apk build` fails whilst attempting to sign the output apk,
[task 2021-07-28T09:57:55.237Z] # unless the `.android` directory exists.
[task 2021-07-28T09:57:55.237Z] # See https://github.com/rust-windowing/android-rs-glue/issues/252
[task 2021-07-28T09:57:55.237Z] mkdir /builds/worker/.android
[task 2021-07-28T09:57:55.237Z] + mkdir /builds/worker/.android
[task 2021-07-28T09:57:55.238Z] if [ "$MODE" == "debug" ]; then
[task 2021-07-28T09:57:55.238Z]     ../cargo-apk/bin/cargo-apk build --frozen --verbose
[task 2021-07-28T09:57:55.238Z] elif [ "$MODE" == "release" ]; then
[task 2021-07-28T09:57:55.238Z]     ../cargo-apk/bin/cargo-apk build --frozen --verbose --release
[task 2021-07-28T09:57:55.238Z] else
[task 2021-07-28T09:57:55.238Z]     echo "Unknown mode '${MODE}'; must be 'debug' or 'release'"
[task 2021-07-28T09:57:55.238Z]     exit 1
[task 2021-07-28T09:57:55.238Z] fi
[task 2021-07-28T09:57:55.238Z] + '[' release == debug ']'
[task 2021-07-28T09:57:55.238Z] + '[' release == release ']'
[task 2021-07-28T09:57:55.238Z] + ../cargo-apk/bin/cargo-apk build --frozen --verbose --release
[task 2021-07-28T09:57:55.261Z] Compiling injected-glue for armv7-linux-androideabi
[task 2021-07-28T09:57:55.834Z] warning: /builds/worker/checkouts/gecko/gfx/wr/Cargo.toml: unused manifest key: profile.dev.package
[task 2021-07-28T09:57:55.834Z] warning: /builds/worker/checkouts/gecko/gfx/wr/Cargo.toml: unused manifest key: profile.release.package
[task 2021-07-28T09:57:55.837Z] thread 'main' panicked at 'attempted to zero-initialize type `sized_chunks::sized_chunk::Chunk<(core::package_id::PackageId, im_rc::OrdMap<core::package_id::PackageId, std::vec::Vec<core::dependency::Dependency>>)>`, which is invalid', /builds/worker/fetches/rustc/lib/rustlib/src/rust/library/core/src/mem/mod.rs:636:9
[task 2021-07-28T09:57:55.837Z] stack backtrace:
[task 2021-07-28T09:57:55.843Z]    0:     0x55d4fdae83f0 - std::backtrace_rs::backtrace::libunwind::trace::h5e9d00f0cdf4f57e
[task 2021-07-28T09:57:55.843Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/../../backtrace/src/backtrace/libunwind.rs:90:5
[task 2021-07-28T09:57:55.843Z]    1:     0x55d4fdae83f0 - std::backtrace_rs::backtrace::trace_unsynchronized::hd5302bd66215dab9
[task 2021-07-28T09:57:55.843Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
[task 2021-07-28T09:57:55.843Z]    2:     0x55d4fdae83f0 - std::sys_common::backtrace::_print_fmt::ha0237cd11a34e2bf
[task 2021-07-28T09:57:55.843Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/sys_common/backtrace.rs:67:5
[task 2021-07-28T09:57:55.843Z]    3:     0x55d4fdae83f0 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h171d4c10df1a98ee
[task 2021-07-28T09:57:55.843Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/sys_common/backtrace.rs:46:22
[task 2021-07-28T09:57:55.845Z]    4:     0x55d4fdb0e59c - core::fmt::write::h89e4288724daa3fa
                            at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/core/src/fmt/mod.rs:1096:17
[task 2021-07-28T09:57:55.845Z]    5:     0x55d4fdae1cb2 - std::io::Write::write_fmt::h6d40f996e84584d9
[task 2021-07-28T09:57:55.845Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/io/mod.rs:1568:15
[task 2021-07-28T09:57:55.845Z]    6:     0x55d4fdaeafa5 - std::sys_common::backtrace::_print::h0c0b93221682afc8
[task 2021-07-28T09:57:55.845Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/sys_common/backtrace.rs:49:5
[task 2021-07-28T09:57:55.845Z]    7:     0x55d4fdaeafa5 - std::sys_common::backtrace::print::h57a9f95204c2fdd6
[task 2021-07-28T09:57:55.845Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/sys_common/backtrace.rs:36:9
[task 2021-07-28T09:57:55.845Z]    8:     0x55d4fdaeafa5 - std::panicking::default_hook::{{closure}}::h4245258b50e37e69
[task 2021-07-28T09:57:55.845Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panicking.rs:208:50
[task 2021-07-28T09:57:55.846Z]    9:     0x55d4fdaeab03 - std::panicking::default_hook::h7b00dcc1d0944747
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panicking.rs:225:9
[task 2021-07-28T09:57:55.846Z]   10:     0x55d4fdaeb741 - std::panicking::rust_panic_with_hook::h71e6a073d87de1f5
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panicking.rs:591:17
[task 2021-07-28T09:57:55.846Z]   11:     0x55d4fdaeb257 - std::panicking::begin_panic_handler::{{closure}}::hd549436f6bb6dbb8
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panicking.rs:495:13
[task 2021-07-28T09:57:55.846Z]   12:     0x55d4fdae888c - std::sys_common::backtrace::__rust_end_short_backtrace::h4e5f4b72b04174c3
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/sys_common/backtrace.rs:141:18
[task 2021-07-28T09:57:55.846Z]   13:     0x55d4fdaeb1e9 - rust_begin_unwind
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panicking.rs:493:5
[task 2021-07-28T09:57:55.846Z]   14:     0x55d4fdb0cc81 - core::panicking::panic_fmt::hcd56f7f635f62c74
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/core/src/panicking.rs:92:14
[task 2021-07-28T09:57:55.846Z]   15:     0x55d4fdb0cbcd - core::panicking::panic::h07405d6be4bce887
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/core/src/panicking.rs:50:5
[task 2021-07-28T09:57:55.846Z]   16:     0x55d4fd5f3c77 - cargo::core::resolver::encode::EncodableResolve::into_resolve::h6ba8f4a7503c89c2
[task 2021-07-28T09:57:55.846Z]   17:     0x55d4fd6e3d4c - cargo::ops::lockfile::load_pkg_lockfile::h4727dfbed56f6534
[task 2021-07-28T09:57:55.846Z]   18:     0x55d4fd743352 - cargo::ops::resolve::resolve_with_registry::h9ab9b0a3934c6977
[task 2021-07-28T09:57:55.846Z]   19:     0x55d4fd742a6c - cargo::ops::resolve::resolve_ws_with_opts::ha1d37351d718ad11
[task 2021-07-28T09:57:55.846Z]   20:     0x55d4fd738756 - cargo::ops::cargo_compile::compile_ws::h310427212be80bdc
[task 2021-07-28T09:57:55.846Z]   21:     0x55d4fd738335 - cargo::ops::cargo_compile::compile_with_exec::h21c4fc06fd3df2ad
[task 2021-07-28T09:57:55.846Z]   22:     0x55d4fd515882 - cargo_apk::ops::build::compile::build_shared_libraries::hc27abae2c3f59d12
[task 2021-07-28T09:57:55.846Z]   23:     0x55d4fd53c95f - cargo_apk::ops::build::build::hb9836e5914cbdb16
[task 2021-07-28T09:57:55.846Z]   24:     0x55d4fd50d910 - cargo_apk::main::hf08c544555f05b17
[task 2021-07-28T09:57:55.846Z]   25:     0x55d4fd5278e3 - std::sys_common::backtrace::__rust_begin_short_backtrace::h00567408860e7d63
[task 2021-07-28T09:57:55.846Z]   26:     0x55d4fd5278f9 - std::rt::lang_start::{{closure}}::h6ab438aa64d0893e
[task 2021-07-28T09:57:55.846Z]   27:     0x55d4fdaebc57 - core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::h527fb2333ede305e
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/core/src/ops/function.rs:259:13
[task 2021-07-28T09:57:55.846Z]   28:     0x55d4fdaebc57 - std::panicking::try::do_call::h309d8aee8149866c
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panicking.rs:379:40
[task 2021-07-28T09:57:55.846Z]   29:     0x55d4fdaebc57 - std::panicking::try::h75a60c31fd16bfc6
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panicking.rs:343:19
[task 2021-07-28T09:57:55.846Z]   30:     0x55d4fdaebc57 - std::panic::catch_unwind::h1f9892423e99bc00
                             at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/panic.rs:431:14
[task 2021-07-28T09:57:55.846Z]   31:     0x55d4fdaebc57 - std::rt::lang_start_internal::hd5b67df56ca01dae
[task 2021-07-28T09:57:55.846Z]                                at /rustc/2fd73fabe469357a12c2c974c140f67e7cdd76d0/library/std/src/rt.rs:51:25
[task 2021-07-28T09:57:55.846Z]   32:     0x55d4fd5103e2 - main
[task 2021-07-28T09:57:55.846Z]   33:     0x7f89be3f809b - __libc_start_main
[task 2021-07-28T09:57:55.846Z]   34:     0x55d4fd4e4b1a - _start
[task 2021-07-28T09:57:55.846Z]   35:                0x0 - <unknown>
[taskcluster 2021-07-28 09:57:56.482Z] === Task Finished ===
[taskcluster 2021-07-28 09:57:56.578Z] Artifact "public/build/reftests.tar.gz" not found at "/builds/worker/checkouts/gecko/gfx/wr/wrench/reftests.tar.gz"
[taskcluster 2021-07-28 09:57:56.678Z] Artifact "public/build/mozdevice.tar.gz" not found at "/builds/worker/checkouts/gecko/testing/mozbase/mozdevice.tar.gz"
[taskcluster 2021-07-28 09:57:56.774Z] Artifact "public/build/wrench-release.apk" not found at "/builds/worker/checkouts/gecko/gfx/wr/target/android-artifacts/release/apk/wrench.apk"
[taskcluster 2021-07-28 09:57:56.878Z] Unsuccessful task run with exit code: 101 completed in 164.517 seconds```

Flags: needinfo?(dmalyshau)

Sandor Molnar[:smolnar]

Reporter

Comment 1

•

3 years ago

@kvark: could you take a look at these bustages?
They seem to start from your push

BugBot [:suhaib / :marco/ :calixte]

Updated

•

3 years ago

Keywords: regression

Comment hidden (Intermittent Failures Robot)

Noemi Erli[:noemi_erli]

Comment 3

•

3 years ago

•

Edited

The change that caused this was backed out: https://hg.mozilla.org/integration/autoland/rev/0e4800d5be4d74d5cf55e47c2bb763e48e1b62d3
Closing

Status: NEW → RESOLVED

Closed: 3 years ago

Resolution: --- → FIXED

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Updated

•

3 years ago

status-firefox90: --- → unaffected

status-firefox91: --- → unaffected

status-firefox92: --- → fixed

status-firefox-esr78: --- → unaffected

status-firefox-esr91: --- → unaffected

Target Milestone: --- → 92 Branch

Mike Hommey [:glandium]

Assignee

Comment 4

•

3 years ago

•

Edited

Reopening this bug to fix the underlying issue, which bug 1622846 only incidentally triggered. That is, cargo-apk is using an old cargo library that uses uninit memory in an unsafe way. cargo-apk needs an upgrade to use a newer cargo lib. Unfortunately, the newest version of cargo-apk requires a newer version of winit, or another hack in the old winit version we use to switch from android_glue (which has no new version) to ndk-glue.

Blocks: 1622846

Status: RESOLVED → REOPENED

No longer regressed by: 1622846

Resolution: FIXED → ---

Mike Hommey [:glandium]

Assignee

Comment 5

•

3 years ago

Attached file Bug 1722702 - Upgrade cargo-apk to 0.8.2. (WIP) (obsolete) — Details

Mike Hommey [:glandium]

Assignee

Comment 6

•

3 years ago

I'll check and see if I can just bump the cargo dependency in cargo-apk, since, after all, we already did that in the past.

BugBot [:suhaib / :marco/ :calixte]

Updated

•

3 years ago

status-firefox92: fixed → affected

Comment hidden (Intermittent Failures Robot)

Dzmitry Malyshau [:kvark]

Comment 8

•

3 years ago

Looking forward to see cargo-apk updated, since this is blocking us.
What's the problem with updating winit if it's required?

Flags: needinfo?(dmalyshau)

Dzmitry Malyshau [:kvark]

Updated

•

3 years ago

Blocks: 1723700

Lee Salzman [:lsalzman]

Updated

•

3 years ago

Severity: -- → S3

Ryan VanderMeulen [:RyanVM]

Updated

•

3 years ago

Assignee: nobody → mh+mozilla

Status: REOPENED → ASSIGNED

status-firefox92: affected → wontfix

status-firefox93: --- → affected

Target Milestone: 92 Branch → ---

Julien Cristau [:jcristau]

Updated

•

3 years ago

Type: defect → task

Keywords: regression

Mike Hommey [:glandium]

Assignee

Updated

•

2 years ago

Depends on: 1615148

Phabricator Automation

Updated

•

2 years ago

Attachment #9233856 - Attachment description: Bug 1722702 - Upgrade cargo-apk to 0.8.0. (WIP) → Bug 1722702 - Upgrade cargo-apk to 0.8.2. (WIP)

Mathew Hodson

Updated

•

2 years ago

No longer blocks: 1723700

Mathew Hodson

Updated

•

2 years ago

No longer blocks: 1622846

Updated

•

2 years ago

Status: ASSIGNED → RESOLVED

Closed: 3 years ago → 2 years ago

Resolution: --- → DUPLICATE

Phabricator Automation

Updated

•

2 years ago

Attachment #9233856 - Attachment is obsolete: true

Takanori MATSUURA

Updated

•

2 years ago

No longer depends on: 1615148