If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

Intermittent Linux gcc 4.7.2 PGO Segmentation fault in intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp, resampler_private_AR2.c, etc.

RESOLVED WORKSFORME

Status

()

Core
Build Config
--
critical
RESOLVED WORKSFORME
4 years ago
2 years ago

People

(Reporter: RyanVM, Unassigned)

Tracking

({intermittent-failure})

Trunk
x86
Linux
intermittent-failure
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

4 years ago
+++ This bug was initially created as a clone of Bug #820796 +++

Cloning from bug 820796 so we can track this as a separate issue from the gcc 4.5 issue.

https://tbpl.mozilla.org/php/getParsedLog.php?id=23092428&tree=Mozilla-Inbound

Linux x86-64 mozilla-inbound pgo-build on 2013-05-17 12:47:09 PDT for push e5e7221a2c82
slave: bld-linux64-ec2-602

nsTIS620ToUnicode.cpp
/builds/slave/m-in-l64-pgo-00000000000000000/build/intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp:22:1: fatal error: error writing to -: Broken pipe
compilation terminated.
g++: internal compiler error: Segmentation fault (program as)
Please submit a full bug report,
with preprocessed source if appropriate.
See <http://gcc.gnu.org/bugs.html> for instructions.
make[8]: *** [nsCP1253ToUnicode.o] Error 4
make[8]: *** Deleting file `nsCP1253ToUnicode.o'
make[8]: *** Waiting for unfinished jobs....
(Reporter)

Updated

4 years ago
Summary: Intermittent Linux gcc 4.7.2 Segmentation fault in intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp → Intermittent Linux gcc 4.7.2 PGO Segmentation fault in intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp
(Reporter)

Updated

4 years ago
See Also: → bug 820796
(Reporter)

Comment 1

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23105415&tree=Mozilla-Central
The log in comment 1 seems to be a different issue from the description (as crashes in the first gcc in the second).

in any case I'm not sure there's much we can do unless we can get access to the objdir when one of these fails and the failure is reproducable given the same profile data.
https://tbpl.mozilla.org/php/getParsedLog.php?id=23137546&tree=Mozilla-Inbound

/usr/bin/ccache /tools/gcc-4.7.2-0moz1/bin/gcc -m32 -o resampler_down2.o -c -I../../dist/system_wrappers -include /builds/slave/m-in-lx-pgo-000000000000000000/build/config/gcc_hidden.h -DOPUS_BUILD -DOPUS_VERSION='"draft-11-mozilla"' -DUSE_ALLOCA -Drestrict=  -DHAVE_LRINTF -DMOZ_GLUE_IN_PROGRAM -DNO_NSPR_10_SUPPORT -I/builds/slave/m-in-lx-pgo-000000000000000000/build/media/libopus/include -I/builds/slave/m-in-lx-pgo-000000000000000000/build/media/libopus/celt -I/builds/slave/m-in-lx-pgo-000000000000000000/build/media/libopus/silk -I/builds/slave/m-in-lx-pgo-000000000000000000/build/media/libopus/src  -I/builds/slave/m-in-lx-pgo-000000000000000000/build/media/libopus/silk/float -I/builds/slave/m-in-lx-pgo-000000000000000000/build/media/libopus -I. -I../../dist/include  -I/builds/slave/m-in-lx-pgo-000000000000000000/build/obj-firefox/dist/include/nspr -I/builds/slave/m-in-lx-pgo-000000000000000000/build/obj-firefox/dist/include/nss      -fPIC  -Wall -Wpointer-arith -Wdeclaration-after-statement -Werror=return-type -Wtype-limits -Wempty-body -Wsign-compare -Wno-unused -Wcast-align -std=gnu99 -fgnu89-inline -fno-strict-aliasing -ffunction-sections -fdata-sections -pthread -pipe  -DNDEBUG -DTRIMMED -g -fprofile-use -fprofile-correction -Wcoverage-mismatch -O3 -fno-omit-frame-pointer    -include ../../mozilla-config.h -DMOZILLA_CLIENT -MD -MP -MF .deps/resampler_down2.o.pp  /builds/slave/m-in-lx-pgo-000000000000000000/build/media/libopus/silk/resampler_down2.c
resampler_private_AR2.c
<built-in>:0:0: internal compiler error: Segmentation fault
Please submit a full bug report,
with preprocessed source if appropriate.
See <http://gcc.gnu.org/bugs.html> for instructions.
make[6]: *** [resampler.o] Error 1
Summary: Intermittent Linux gcc 4.7.2 PGO Segmentation fault in intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp → Intermittent Linux gcc 4.7.2 PGO Segmentation fault in intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp, resampler_private_AR2.c
(Reporter)

Comment 4

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23212352&tree=Mozilla-Inbound
Depends on: 874528
Is it a drop-all-ICEs bug?
(In reply to Mike Hommey [:glandium] from comment #5)
> Is it a drop-all-ICEs bug?

seems that atleast, and I can't think of a particularly good argument for having multiple bugs  where the only difference is slightly different ICE text.
(Reporter)

Comment 7

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23221488&tree=Birch
We should probably try gcc 4.7.3. Maybe a good occasion to try tooltool for gcc as well?
Depends on: 875465
So, I tried doing a normal opt build but with CFLAGS / CXXFLAGS containing those for pgo use in https://tbpl.mozilla.org/?tree=Try&rev=191e3ccc2c91 and was able to reproduce the ICE on one  linux build, which I find interesting since one would hope adding those flags when there's no pgo data would have no effect.  So I wonder if its worth trying stripping the pgo use flags from the command line when there's no data for the file being compiled as a bit of a work around.
(In reply to Mike Hommey [:glandium] from comment #8)
> We should probably try gcc 4.7.3. Maybe a good occasion to try tooltool for
> gcc as well?

The list of fixed bugs in 4.7.3 doesn't seem to contain anything related to this bug:

http://gcc.gnu.org/bugzilla/buglist.cgi?bug_status=RESOLVED&resolution=FIXED&target_milestone=4.7.3

(In reply to Trevor Saunders (:tbsaunde) from comment #9)
> So, I tried doing a normal opt build but with CFLAGS / CXXFLAGS containing
> those for pgo use in https://tbpl.mozilla.org/?tree=Try&rev=191e3ccc2c91 and
> was able to reproduce the ICE on one  linux build, which I find interesting
> since one would hope adding those flags when there's no pgo data would have
> no effect.  So I wonder if its worth trying stripping the pgo use flags from
> the command line when there's no data for the file being compiled as a bit
> of a work around.

Did it reproduce consistently?  Maybe we should just try to get this fixed in GCC itself.
(In reply to Nathan Froyd (:froydnj) from comment #10)
> (In reply to Mike Hommey [:glandium] from comment #8)
> > We should probably try gcc 4.7.3. Maybe a good occasion to try tooltool for
> > gcc as well?
> 
> The list of fixed bugs in 4.7.3 doesn't seem to contain anything related to
> this bug:
> 
> http://gcc.gnu.org/bugzilla/buglist.
> cgi?bug_status=RESOLVED&resolution=FIXED&target_milestone=4.7.3

ok :/ I think its probably still worth getting bug 875465 done though I'd probably only use it on try because I hacked dumping a stack into the code to ICE and that seems a lot more useful than "I segfaulted somewhere" messages :)

> (In reply to Trevor Saunders (:tbsaunde) from comment #9)
> > So, I tried doing a normal opt build but with CFLAGS / CXXFLAGS containing
> > those for pgo use in https://tbpl.mozilla.org/?tree=Try&rev=191e3ccc2c91 and
> > was able to reproduce the ICE on one  linux build, which I find interesting
> > since one would hope adding those flags when there's no pgo data would have
> > no effect.  So I wonder if its worth trying stripping the pgo use flags from
> > the command line when there's no data for the file being compiled as a bit
> > of a work around.
> 
> Did it reproduce consistently?  Maybe we should just try to get this fixed
> in GCC itself.

I haven't found anything reproduceble :/  I have a tarball of the objdir and srcdir for the build for the buildwhere I tried borrowing the slave, but couldn't get the gcc to ICE when I ran make again by hand.

I asked in #gcc about this a while ago which resulted in http://gcc.gnu.org/ml/gcc-patches/2013-05/msg01281.html

However I suspect there has been profiling data for the file being compiled in some of the cases we have here.  When I look at  my local pgo objdir which is fairly stale I see gcda files for some of the files we ICE in here.
(Reporter)

Comment 12

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23823315&tree=Mozilla-Central
(Reporter)

Comment 13

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23849119&tree=Fx-Team


/builds/slave/fx-team-l64-pgo-00000000000000/build/intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp:1:0: internal compiler error: in default_addr_space_address_mode, at targhooks.c:1051
(In reply to Ryan VanderMeulen [:RyanVM] from comment #13)
> /builds/slave/fx-team-l64-pgo-00000000000000/build/intl/uconv/ucvlatin/
> nsCP1253ToUnicode.cpp:1:0: internal compiler error: in
> default_addr_space_address_mode, at targhooks.c:1051

That is a bizarre error; multiple address spaces aren't supported on x86.  We should never be hitting that assert.  I smell memory corruption.
(In reply to Nathan Froyd (:froydnj) from comment #14)
> (In reply to Ryan VanderMeulen [:RyanVM] from comment #13)
> > /builds/slave/fx-team-l64-pgo-00000000000000/build/intl/uconv/ucvlatin/
> > nsCP1253ToUnicode.cpp:1:0: internal compiler error: in
> > default_addr_space_address_mode, at targhooks.c:1051
> 
> That is a bizarre error; multiple address spaces aren't supported on x86. 
> We should never be hitting that assert.  I smell memory corruption.

yeah, I wonder if bad hardware being taken out of the pool and new bad hardware showing up can explain the gap of a week or two with no problems.
(Reporter)

Comment 16

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23966877&tree=Mozilla-Inbound
(Reporter)

Updated

4 years ago
Summary: Intermittent Linux gcc 4.7.2 PGO Segmentation fault in intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp, resampler_private_AR2.c → Intermittent Linux gcc 4.7.2 PGO Segmentation fault in intl/uconv/ucvlatin/nsCP1253ToUnicode.cpp, resampler_private_AR2.c, etc.
(Reporter)

Comment 17

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23961035&tree=Fx-Team
(Reporter)

Comment 18

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23973042&tree=Mozilla-Inbound
(Reporter)

Comment 19

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23976027&tree=Mozilla-Central
(Reporter)

Comment 20

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=23991561&tree=Mozilla-Central
(Reporter)

Comment 21

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=24032970&tree=Birch
(Reporter)

Comment 22

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=24165390&tree=Birch
https://tbpl.mozilla.org/php/getParsedLog.php?id=24193303&tree=Mozilla-Central
https://tbpl.mozilla.org/php/getParsedLog.php?id=24187506&tree=Profiling
https://tbpl.mozilla.org/php/getParsedLog.php?id=24198356&tree=Profiling
(Reporter)

Comment 26

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=24246284&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=24263464&tree=Mozilla-Central
(Reporter)

Comment 28

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=24609450&tree=Birch
(Reporter)

Comment 29

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=24621503&tree=Birch
https://tbpl.mozilla.org/php/getParsedLog.php?id=24629969&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=24674606&tree=Mozilla-Inbound
(Reporter)

Comment 32

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=24822776&tree=Mozilla-Aurora
(Reporter)

Comment 33

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=24886644&tree=Birch
https://tbpl.mozilla.org/php/getParsedLog.php?id=24942903&tree=Birch
https://tbpl.mozilla.org/php/getParsedLog.php?id=24943193&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=24964072&tree=Birch
(Reporter)

Comment 36

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25171472&tree=Mozilla-Inbound

I do find it interesting that many of these cases occur in the intl code.
https://tbpl.mozilla.org/php/getParsedLog.php?id=25205555&tree=Mozilla-Central
(Reporter)

Comment 38

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25219878&tree=Mozilla-Inbound
(Reporter)

Comment 39

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25231122&tree=Mozilla-Aurora
(Reporter)

Comment 40

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25316834&tree=Birch
(Reporter)

Comment 41

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25434316&tree=Birch
(Reporter)

Comment 42

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25468106&tree=Mozilla-Aurora
(Reporter)

Comment 43

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25706747&tree=Birch
(Reporter)

Comment 44

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25792313&tree=Mozilla-Inbound
(Reporter)

Comment 45

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25883830&tree=Mozilla-Aurora
(Reporter)

Comment 46

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=25893042&tree=Fx-Team
(Reporter)

Comment 47

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=26166703&tree=Mozilla-Central
(Reporter)

Comment 48

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=26267592&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=26471023&tree=Mozilla-Aurora
We switched to GCC 4.7.3 in bug 902104. Will be interesting to see if this goes away.
https://tbpl.mozilla.org/php/getParsedLog.php?id=26505702&tree=Mozilla-Beta
(Reporter)

Comment 52

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=26505702&tree=Mozilla-Beta
(Reporter)

Comment 53

4 years ago
(In reply to Gregory Szorc [:gps] from comment #50)
> We switched to GCC 4.7.3 in bug 902104. Will be interesting to see if this
> goes away.

https://tbpl.mozilla.org/php/getParsedLog.php?id=26533433&tree=B2g-Inbound

Nope.
(In reply to Ryan VanderMeulen [:RyanVM UTC-4] from comment #53)
> (In reply to Gregory Szorc [:gps] from comment #50)
> > We switched to GCC 4.7.3 in bug 902104. Will be interesting to see if this
> > goes away.
> 
> https://tbpl.mozilla.org/php/getParsedLog.php?id=26533433&tree=B2g-Inbound
> 
> Nope.

Note this one, like comment 0 is an assembler crash (binutils, not gcc) ; other were gcc ICEs, and those might be gone. We may want to investigate upgrading binutils.
(Reporter)

Comment 55

4 years ago
How about this one?

https://tbpl.mozilla.org/php/getParsedLog.php?id=26589060&tree=Mozilla-Inbound
(In reply to Ryan VanderMeulen [:RyanVM UTC-4] from comment #55)
> How about this one?
> 
> https://tbpl.mozilla.org/php/getParsedLog.php?id=26589060&tree=Mozilla-
> Inbound

That would be an assembler crash:

g++: internal compiler error: Segmentation fault (program as)

Versus a crash in GCC itself, from comment 52:

/builds/slave/m-beta-lx-00000000000000000000/build/dom/workers/WorkerPrivate.cpp: In destructor 'nsTArray_base<Alloc, Copy>::~nsTArray_base() [with Alloc = nsTArrayInfallibleAllocator; Copy = nsTArray_CopyElements<mozilla::dom::workers::WorkerRunnable*>]':
/builds/slave/m-beta-lx-00000000000000000000/build/dom/workers/WorkerPrivate.cpp:4462:1: note: correcting inconsistent profile data
/builds/slave/m-beta-lx-00000000000000000000/build/dom/workers/WorkerPrivate.cpp:4462:1: internal compiler error: Segmentation fault
Please submit a full bug report,
with preprocessed source if appropriate.
See <http://gcc.gnu.org/bugs.html> for instructions.
https://tbpl.mozilla.org/php/getParsedLog.php?id=26669098&tree=B2g-Inbound (as as usual)
(Reporter)

Comment 58

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=26792969&tree=Mozilla-Beta
(Reporter)

Comment 59

4 years ago
Love the idea of upgrading binutils.
https://tbpl.mozilla.org/php/getParsedLog.php?id=26864295&tree=Mozilla-Beta
(Reporter)

Comment 60

4 years ago
binutils
https://tbpl.mozilla.org/php/getParsedLog.php?id=26935911&tree=Mozilla-Central
(Reporter)

Comment 61

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=26941766&tree=Mozilla-Beta
(Reporter)

Comment 62

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=27003025&tree=Mozilla-Beta
(Reporter)

Comment 63

4 years ago
So if all the 4.7.3 crashes are in binutils, can we consider switching aurora/beta over to it?
(In reply to Ryan VanderMeulen [:RyanVM UTC-4] from comment #63)
> So if all the 4.7.3 crashes are in binutils, can we consider switching
> aurora/beta over to it?

"it" being binutils or 4.7.3?
(Reporter)

Comment 65

4 years ago
Sorry, that was incredibly vague on my part. Upgrading to 4.7.3. Seems like a minor release.
(Reporter)

Comment 66

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=27038382&tree=Mozilla-Central
(Reporter)

Comment 67

4 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=27068031&tree=Fx-Team
https://tbpl.mozilla.org/php/getParsedLog.php?id=27101116&tree=Mozilla-Inbound

/builds/slave/m-in-l64-pgo-00000000000000000/build/js/src/vm/Shape.cpp:1503:1: note: correcting inconsistent profile data
/builds/slave/m-in-l64-pgo-00000000000000000/build/js/src/vm/Shape.cpp: In static member function 'static bool JSObject::setParent(JSContext*, JS::HandleObject, JS::HandleObject)':
/builds/slave/m-in-l64-pgo-00000000000000000/build/js/src/vm/Shape.cpp:1503:1: internal compiler error: Segmentation fault
Please submit a full bug report,
Blocks: 910105
Inactive; closing (see bug 1180138).
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.