1392985 - Missing crash symbolication on Android 4.3 API15+ debug Xpcshell tests executed by TaskCluster test-android-4.3-arm7-api-15/debug-xpcshell-*

Status: RESOLVED DUPLICATE of bug 1389805

(Testing :: XPCShell Harness, defect)

Description

[Honza Bambas (:mayhemer)]

(Not sure of the component or if there is already a bug for this - quit an obvious bug, Ryan?)

There has been recently filed a number of intermittent crashes on this platform with missing symbols.  I will slowly add them here as dependencies so we can track them.

An example stack:


[task 2017-08-22T23:12:49.655646Z] 23:12:49     INFO -  Thread 13 (crashed)
[task 2017-08-22T23:12:49.656146Z] 23:12:49     INFO -   0  libxul.so + 0x58c40
[task 2017-08-22T23:12:49.656526Z] 23:12:49     INFO -       r0 = 0x00000086    r1 = 0x64745a60    r2 = 0x64745a60    r3 = 0x00000000
[task 2017-08-22T23:12:49.656969Z] 23:12:49     INFO -       r4 = 0x45c0b570    r5 = 0x45c0b554    r6 = 0x529f35bc    r7 = 0x45c0b540
[task 2017-08-22T23:12:49.657417Z] 23:12:49     INFO -       r8 = 0x529f35bc    r9 = 0x434d19d8   r10 = 0x43053367   r12 = 0x00000003
[task 2017-08-22T23:12:49.657859Z] 23:12:49     INFO -       fp = 0x529f3604    sp = 0x529f3590    lr = 0x40715bc3    pc = 0x40716c40
[task 2017-08-22T23:12:49.658291Z] 23:12:49     INFO -      Found by: given as instruction pointer in context
[task 2017-08-22T23:12:49.658682Z] 23:12:49     INFO -   1  libxul.so + 0x5ad57
[task 2017-08-22T23:12:49.659083Z] 23:12:49     INFO -       sp = 0x529f3598    pc = 0x40718d59
[task 2017-08-22T23:12:49.659494Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.659903Z] 23:12:49     INFO -   2  libxul.so + 0x71093
[task 2017-08-22T23:12:49.660266Z] 23:12:49     INFO -       sp = 0x529f35a8    pc = 0x4072f095
[task 2017-08-22T23:12:49.660599Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.661005Z] 23:12:49     INFO -   3  libxul.so + 0x298c4dc
[task 2017-08-22T23:12:49.661366Z] 23:12:49     INFO -       sp = 0x529f35ac    pc = 0x4304a4de
[task 2017-08-22T23:12:49.661719Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.662136Z] 23:12:49     INFO -   4  libxul.so + 0x2995365
[task 2017-08-22T23:12:49.662536Z] 23:12:49     INFO -       sp = 0x529f35c0    pc = 0x43053367
[task 2017-08-22T23:12:49.662886Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.663311Z] 23:12:49     INFO -   5  libxul.so + 0x2995365
[task 2017-08-22T23:12:49.663704Z] 23:12:49     INFO -       sp = 0x529f35ec    pc = 0x43053367
[task 2017-08-22T23:12:49.664015Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.664332Z] 23:12:49     INFO -   6  libxul.so + 0x711df
[task 2017-08-22T23:12:49.664577Z] 23:12:49     INFO -       sp = 0x529f35f8    pc = 0x4072f1e1
[task 2017-08-22T23:12:49.667310Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.667363Z] 23:12:49     INFO -   7  libxul.so + 0x1bf04eb
[task 2017-08-22T23:12:49.667441Z] 23:12:49     INFO -       sp = 0x529f3600    pc = 0x422ae4ed
[task 2017-08-22T23:12:49.667488Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.667550Z] 23:12:49     INFO -   8  libxul.so + 0x298c4dc
[task 2017-08-22T23:12:49.667729Z] 23:12:49     INFO -       sp = 0x529f360c    pc = 0x4304a4de
[task 2017-08-22T23:12:49.667794Z] 23:12:49     INFO -      Found by: stack scanning
[task 2017-08-22T23:12:49.667838Z] 23:12:49     INFO -   9  libxul.so + 0x1bf075f
[task 2017-08-22T23:12:49.667885Z] 23:12:49     INFO -       sp = 0x529f3630    pc = 0x422ae761
[task 2017-08-22T23:12:49.667927Z] 23:12:49     INFO -      Found by: stack scanning

Comment 1

[(not currently active) Ted Mielczarek]

This might be a dupe of bug 1389805.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

I will ask :gbrown to look into this when he is back next week- he is the expert on this platform.

Comment 3

[Geoff Brown [:gbrown]]

(In reply to Ted Mielczarek [:ted.mielczarek] from comment #1)
> This might be a dupe of bug 1389805.

I checked several logs from dependent bugs. All had dual libxul entries, one with the 0000... debug identifier, as in bug 1389805.

https://public-artifacts.taskcluster.net/WeEHuv5HRVOyMWelKNnzhQ/0/public/logs/live_backing.log

[task 2017-08-16T15:50:02.644901Z] 15:50:02     INFO -  Loaded modules:
[task 2017-08-16T15:50:02.645308Z] 15:50:02     INFO -  0x2a000000 - 0x2a009fff  xpcshell  ???  (main)
[task 2017-08-16T15:50:02.645710Z] 15:50:02     INFO -  0x40000000 - 0x40010fff  linker  ???
[task 2017-08-16T15:50:02.646105Z] 15:50:02     INFO -  0x40014000 - 0x40027fff  libnss3.so  ???
[task 2017-08-16T15:50:02.646611Z] 15:50:02     INFO -  0x4002d000 - 0x40182fff  libnss3.so  ???  (WARNING: No symbols, libnss3.so, 000000000000000000000000000000000)
[task 2017-08-16T15:50:02.647064Z] 15:50:02     INFO -  0x40193000 - 0x401a4fff  libmozglue.so  ???
[task 2017-08-16T15:50:02.647574Z] 15:50:02     INFO -  0x401a7000 - 0x40250fff  libmozglue.so  ???  (WARNING: No symbols, libmozglue.so, 000000000000000000000000000000000)
[task 2017-08-16T15:50:02.647993Z] 15:50:02     INFO -  0x40258000 - 0x4025cfff  liblog.so  ???
[task 2017-08-16T15:50:02.648449Z] 15:50:02     INFO -  0x4025d000 - 0x402a1fff  libc.so  ???  (WARNING: No symbols, libc.so, CB505144A14B369944610F6D1610D3010)
[task 2017-08-16T15:50:02.648808Z] 15:50:02     INFO -  0x402b5000 - 0x402b7fff  libstdc++.so  ???
[task 2017-08-16T15:50:02.649147Z] 15:50:02     INFO -  0x402b8000 - 0x402cffff  libm.so  ???
[task 2017-08-16T15:50:02.649495Z] 15:50:02     INFO -  0x402d3000 - 0x4043ffff  libxul.so  ???
[task 2017-08-16T15:50:02.649924Z] 15:50:02     INFO -  0x406be000 - 0x445a0fff  libxul.so  ???  (WARNING: No symbols, libxul.so, 000000000000000000000000000000000)

(There seems to be a similar issue for libnss3.so and libmozglue.so.)

Comment 4

[Geoff Brown [:gbrown]]

:mayhemer -- Thanks for reporting and providing all these examples. I'll try to get more attention for this in 1389805.

Comment 5

[Geoff Brown [:gbrown]]

By the way, I noticed this assertion in the logcat logs for several of those failures:

https://public-artifacts.taskcluster.net/NaZ7lWWpQBqC9yvj-wPIZQ/0/public/test_info//logcat-emulator-5554.log

08-12 08:08:52.785  1115  1130 F MOZ_Assert: Assertion failure: IsIdle(oldState) || IsRead(oldState), at /home/worker/workspace/build/src/xpcom/ds/PLDHashTable.h:118

Comment 6

[Intermittent Failures Robot]

2 failures in 943 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api16: 1
* android-4-2-x86: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1392985&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 7

[Intermittent Failures Robot]

3 failures in 885 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 3

Platform breakdown:
* android-4-2-x86: 2
* android-4-3-armv7-api16: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1392985&startday=2017-09-25&endday=2017-10-01&tree=all