1033938 - Intermittent "failed to build symbols" after "zip error: Zip file structure invalid (../b2g-33.0a1.en-US.android-arm.crashreporter-symbols-full.zip)"

Status: RESOLVED FIXED

(Firefox Build System :: General, defect)

Comment 1

[Nigel Babu [:nigelb]]

b2g_mozilla-inbound_emulator-jb_dep on 2014-07-02 22:19:03 PDT for push 63538074b343

slave: bld-linux64-spot-015

https://tbpl.mozilla.org/php/getParsedLog.php?id=43003948&tree=Mozilla-Inbound

22:40:28     INFO -  2014-07-03 01:40:28: arm_ex_reader.cc:449: INFO: ExceptionTableInfo: implausible EXIDX last entry size -1; using 1 instead.
22:40:28     INFO -  2014-07-03 01:40:28: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:40:28     INFO -  2014-07-03 01:40:28: dump_symbols.cc:711: INFO: LoadSymbols:   read EXIDX from .ARM.{exidx,extab}
22:40:28     INFO -  2014-07-03 01:40:28: dump_symbols.cc:790: INFO: LoadSymbols: SUCCESS /builds/slave/b2g_m-in_emu-jb_dep-0000000000/build/objdir-gecko/dist/bin/jsapi-tests
22:41:01     INFO -  2014-07-03 01:41:01: dwarf_cu_to_module.cc:562: INFO: /builds/slave/b2g_m-in_emu-jb_dep-0000000000/build/objdir-gecko/dist/bin/libxul.so: in compilation unit 'Unified_cpp_js_src7.cpp' (offset 0x12e51f20):
22:41:01     INFO -  2014-07-03 01:41:01: dwarf_cu_to_module.cc:572: INFO: /builds/slave/b2g_m-in_emu-jb_dep-0000000000/build/objdir-gecko/dist/bin/libxul.so: the DIE at offset 0x12f107f8 has a DW_AT_specification attribute referring to the die at offset 0x1309efad, which either was not marked as a declaration, or comes later in the file
22:41:02     INFO -  2014-07-03 01:41:02: dwarf_cu_to_module.cc:562: INFO: /builds/slave/b2g_m-in_emu-jb_dep-0000000000/build/objdir-gecko/dist/bin/libxul.so: in compilation unit 'Unified_cpp_js_src8.cpp' (offset 0x130c268f):
22:41:02     INFO -  2014-07-03 01:41:02: dwarf_cu_to_module.cc:572: INFO: /builds/slave/b2g_m-in_emu-jb_dep-0000000000/build/objdir-gecko/dist/bin/libxul.so: the DIE at offset 0x131927dc has a DW_AT_specification attribute referring to the die at offset 0x131dea54, which either was not marked as a declaration, or comes later in the file
22:41:05     INFO -  2014-07-03 01:41:05: dump_symbols.cc:657: INFO: LoadSymbols:   read CFI from .debug_frame
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:474: INFO: ExtabEntryExtract: bytecode can't be represented
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:474: INFO: ExtabEntryExtract: bytecode can't be represented
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:474: INFO: ExtabEntryExtract: bytecode can't be represented
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:449: INFO: ExceptionTableInfo: implausible EXIDX last entry size -1; using 1 instead.
22:41:06     INFO -  2014-07-03 01:41:06: arm_ex_reader.cc:471: INFO: ExtabEntryExtract: function is marked CANT_UNWIND
22:41:06     INFO -  2014-07-03 01:41:06: dump_symbols.cc:711: INFO: LoadSymbols:   read EXIDX from .ARM.{exidx,extab}
22:41:06     INFO -  2014-07-03 01:41:06: dump_symbols.cc:790: INFO: LoadSymbols: SUCCESS /builds/slave/b2g_m-in_emu-jb_dep-0000000000/build/objdir-gecko/dist/bin/libxul.so
22:41:18     INFO -  echo packing symbols
22:41:18     INFO -  packing symbols
22:41:18     INFO -  dist/bin/nsinstall -D dist/
22:41:18     INFO -  cd dist/crashreporter-symbols && \
22:41:18     INFO -            zip -r9D '../b2g-33.0a1.en-US.android-arm.crashreporter-symbols-full.zip' . -x '*test*' -x '*Test*'
22:41:18     INFO -  	zip warning: missing end signature--probably not a zip file (did you
22:41:18     INFO -  	zip warning: remember to use binary mode when you transferred it?)
22:41:18     INFO -  	zip warning: (if you are trying to read a damaged archive try -F)
22:41:18     INFO -  zip error: Zip file structure invalid (../b2g-33.0a1.en-US.android-arm.crashreporter-symbols-full.zip)
22:41:18    ERROR -  make[1]: *** [buildsymbols] Error 3
22:41:18     INFO -  make[1]: Leaving directory `/builds/slave/b2g_m-in_emu-jb_dep-0000000000/build/objdir-gecko'
22:41:18     INFO -  make: *** [buildsymbols] Error 2
22:41:18     INFO -  real	1m27.022s
22:41:18     INFO -  user	2m18.442s
22:41:18     INFO -  sys	0m12.190s
22:41:18     INFO -  
22:41:18     INFO -  > Build failed! <
22:41:18     INFO -  Build with |./build.sh -j1| for better messages
22:41:18     INFO -  If all else fails, use |rm -rf objdir-gecko| to clobber gecko and |rm -rf out| to clobber everything else.
22:41:18    ERROR - Return code: 2
22:41:18    FATAL - failed to build symbols
22:41:18    FATAL - Running post_fatal callback...
22:41:18    FATAL - Exiting 2
program finished with exit code 2
elapsedTime=1329.991974

Comment 2

[Nigel Babu [:nigelb]]

05:52 < glandium> nigelb|sheriffduty: it's bad luck, and the build system not really doing its best to prevent it
05:52 < glandium> nigelb|sheriffduty: essentially a previous build left a broken symbols zip, and the new one doesn't remove it when creating its own, and zip defaults to reusing zips that exist
05:54 < glandium> nigelb|sheriffduty: ask someone on releng to clobber that slave

Comment 3

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=43372154&tree=Mozilla-B2g30-v1.4
b2g_mozilla-b2g30_v1_4_emulator-jb-debug_dep on 2014-07-08 13:34:05
revision: 1b9cee26ddf9
slave: bld-linux64-spot-065

make[3]: *** [configure] Error 1
make[2]: *** [/builds/slave/b2g_m-b30_14_emu-jb-d_dep-0000/build/objdir-gecko/Makefile] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 4

[(not currently active) Ted Mielczarek]

Apparently we delete the one symbols.zip file but not the symbols-full.zip file:
http://hg.mozilla.org/mozilla-central/annotate/340b19c14d3d//Makefile.in#l220

Should be easy to just stick $(RM) '$(DIST)/$(SYMBOL_FULL_ARCHIVE_BASENAME).zip' in there.

Comment 5

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=43986303&tree=Mozilla-Inbound
b2g_mozilla-inbound_nexus-4_periodic on 2014-07-16 19:31:26
revision: c752c9ef9596
slave: bld-linux64-spot-046

make[3]: *** [configure] Error 1
make[2]: *** [/builds/slave/b2g_m-in_nexus-4_dep-000000000/build/objdir-gecko/Makefile] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/mako/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 6

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=44270138&tree=Fx-Team
b2g_fx-team_nexus-4_eng_periodic on 2014-07-21 05:31:21
revision: 0859e0ab3934
slave: bld-linux64-spot-054

make[3]: *** [configure] Error 1
make[2]: *** [/builds/slave/b2g_fx-team_nexus-4_eng_dep-00/build/objdir-gecko/Makefile] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/mako/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 7

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=44400357&tree=Mozilla-Central
b2g_mozilla-central_nexus-4_eng_periodic on 2014-07-22 19:31:13
revision: 82df3654cd80
slave: bld-linux64-spot-162

make[3]: *** [configure] Error 1
make[2]: *** [/builds/slave/b2g_m-cen_nexus-4_eng_dep-0000/build/objdir-gecko/Makefile] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/mako/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 8

[(not currently active) Ted Mielczarek]

Attachment: rm full symbols.zip during buildsymbols

Trivial patch, should have done this sooner.

Comment 9

[Legacy TBPL/Treeherder Robot]

Tomcat
https://tbpl.mozilla.org/php/getParsedLog.php?id=44936709&tree=B2g-Inbound
b2g_b2g-inbound_emulator-kk_periodic on 2014-07-30 17:31:30
revision: 90b2d8066c1e
slave: bld-linux64-spot-187

make[3]: *** [configure] Error 1
make[2]: *** [/builds/slave/b2g_b2g-in_emu-kk_dep-00000000/build/objdir-gecko/Makefile] Error 2
make[1]: *** [build] Error 2
make: *** [out/target/product/generic/obj/DATA/gecko_intermediates/gecko] Error 2
Return code: 2
failed to build
Running post_fatal callback...
Exiting 2

Comment 10

[(not currently active) Ted Mielczarek]

https://hg.mozilla.org/integration/mozilla-inbound/rev/348a5e62d199

Comment 11

[(PTO May 7-12) Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/348a5e62d199

Comment 12

[(PTO May 7-12) Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-aurora/rev/5a92e35703c6
https://hg.mozilla.org/releases/mozilla-beta/rev/0ad2cb256eb8
https://hg.mozilla.org/releases/mozilla-b2g30_v1_4/rev/cd47f2739364

Comment 13

[(PTO May 7-12) Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-b2g32_v2_0/rev/0ad2cb256eb8
https://hg.mozilla.org/releases/mozilla-esr31/rev/d66a52a6aca2