900643 - Intermittent test_progress.html | This test left crash dumps behind, but we weren't expecting it to! | test_streams_element_capture.html | application crashed [@ oc_dec_residual_tokens_unpack]

Status: RESOLVED WORKSFORME

(Core :: Audio/Video, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

https://tbpl.mozilla.org/php/getParsedLog.php?id=25997544&tree=Mozilla-Inbound

Android 4.0 Panda mozilla-inbound opt test mochitest-2 on 2013-07-31 17:18:02 PDT for push c84673c64f39
slave: panda-0815

17:39:26     INFO -  23353 INFO TEST-PASS | /tests/content/media/test/test_progress.html | [finished seek.webm-4] Length of array should match number of running tests
17:39:26     INFO -  23354 INFO TEST-INFO | /tests/content/media/test/test_progress.html | Finished at Wed Jul 31 2013 17:39:02 GMT+0000 (GMT) (1375292342.962s)
17:39:26     INFO -  23355 INFO TEST-INFO | /tests/content/media/test/test_progress.html | Running time: 10.976s
17:39:26     INFO -  23356 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_progress.html | This test left crash dumps behind, but we weren't expecting it to!
17:39:26     INFO -  23357 INFO TEST-INFO | Found unexpected crash dump file /mnt/sdcard/tests/profile/minidumps/76987cee-537f-6fd6-2582488c-2206b5e7.dmp.
17:39:26     INFO -  23358 INFO TEST-INFO | Found unexpected crash dump file /mnt/sdcard/tests/profile/minidumps/76987cee-537f-6fd6-2582488c-2206b5e7.extra.
17:39:26     INFO -  23359 INFO TEST-END | /tests/content/media/test/test_progress.html | finished in 11252ms

17:39:46     INFO -  23711 INFO TEST-PASS | /tests/content/media/test/test_streams_element_capture.html | 320x240.ogv current time at end: 0.2666635513305664 should be: 0.266
17:39:46     INFO -  23712 INFO TEST-PASS | /tests/content/media/test/test_streams_element_capture.html | 320x240.ogv checking readyState
17:39:46     INFO -  23713 INFO TEST-PASS | /tests/content/media/test/test_streams_element_capture.html | 320x240.ogv checking playback has ended
17:39:46     INFO -  INFO | automation.py | Application ran for: 0:10:28.328343
17:39:46     INFO -  INFO | zombiecheck | Reading PID log: /tmp/tmpLDOBRVpidlog
17:39:47     INFO -  mozcrash INFO | Downloading symbols from: http://ftp.mozilla.org/pub/mozilla.org/mobile/tinderbox-builds/mozilla-inbound-android/1375309964/fennec-25.0a1.en-US.android-arm.crashreporter-symbols.zip
17:39:55     INFO -  /data/anr/traces.txt not found
17:39:55  WARNING -  PROCESS-CRASH | /tests/content/media/test/test_streams_element_capture.html | application crashed [@ oc_dec_residual_tokens_unpack]
17:39:55     INFO -  Crash dump filename: /tmp/tmpqCRQ57/76987cee-537f-6fd6-2582488c-2206b5e7.dmp
17:39:55     INFO -  Operating system: Android
17:39:55     INFO -                    0.0.0 Linux 3.2.0+ #2 SMP PREEMPT Thu Nov 29 08:06:57 EST 2012 armv7l pandaboard/pandaboard/pandaboard:4.0.4/IMM76I/5:eng/test-keys
17:39:55     INFO -  CPU: arm
17:39:55     INFO -       2 CPUs
17:39:55     INFO -  Crash reason:  SIGSEGV
17:39:55     INFO -  Crash address: 0xa000ec
17:39:55     INFO -  Thread 46 (crashed)
17:39:55     INFO -   0  libxul.so!oc_dec_residual_tokens_unpack [decode.c:c84673c64f39 : 1117 + 0x2]
17:39:55     INFO -       r4 = 0x0000003b    r5 = 0x6c1a7010    r6 = 0x000007a4    r7 = 0xffffffe9
17:39:55     INFO -       r8 = 0x00000003    r9 = 0x6a197958   r10 = 0x00000001    fp = 0x00000024
17:39:55     INFO -       sp = 0x6a197718    lr = 0x0000043b    pc = 0x631fac0c
17:39:55     INFO -      Found by: given as instruction pointer in context
17:39:55     INFO -   1  libxul.so!th_decode_packetin [decode.c:c84673c64f39 : 2158 + 0x3]
17:39:55     INFO -       r4 = 0x6c1a7010    r5 = 0x6c1a7010    r6 = 0x68d60000    r7 = 0x00000057
17:39:55     INFO -       r8 = 0x685afc00    r9 = 0x692b1000   r10 = 0x6635f080    fp = 0x0000001d
17:39:55     INFO -       sp = 0x6a197b80    pc = 0x631fb8a9
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   2  libxul.so!mozilla::OggReader::DecodeTheora(ogg_packet*, long long) [OggReader.cpp:c84673c64f39 : 762 + 0x7]
17:39:55     INFO -       r4 = 0x00049b74    r5 = 0x00000000    r6 = 0x00049b74    r7 = 0x00000000
17:39:55     INFO -       r8 = 0x66397220    r9 = 0x69afaf24   r10 = 0x5be55ff0    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197ca8    pc = 0x62caee95
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   3  libxul.so!mozilla::OggReader::DecodeVideoFrame(bool&, long long) [OggReader.cpp:c84673c64f39 : 856 + 0x9]
17:39:55     INFO -       r4 = 0x00049b74    r5 = 0x00000000    r6 = 0x00000000    r7 = 0x66397220
17:39:55     INFO -       r8 = 0x5be55ff0    r9 = 0x69afaf24   r10 = 0x6a197deb    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197d90    pc = 0x62caf085
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   4  libxul.so!mozilla::MediaDecoderStateMachine::DecodeLoop() [MediaDecoderStateMachine.cpp:c84673c64f39 : 905 + 0xf]
17:39:55     INFO -       r4 = 0x00049b74    r5 = 0x00000000    r6 = 0x00000001    r7 = 0x5beb2c40
17:39:55     INFO -       r8 = 0x00000000    r9 = 0x00000000   r10 = 0x00000001    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197dd0    pc = 0x62b3cf71
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   5  libxul.so!mozilla::MediaDecoderStateMachine::DecodeThreadRun() [MediaDecoderStateMachine.cpp:c84673c64f39 : 510 + 0x5]
17:39:55     INFO -       r4 = 0x5beb2c40    r5 = 0x00000000    r6 = 0x6a197e7c    r7 = 0x00000001
17:39:55     INFO -       r8 = 0x00000000    r9 = 0x6a197eaf   r10 = 0x685bbccc    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197e50    pc = 0x62b3dcdb
17:39:55     INFO -      Found by: call frame info

Comment 1

[Chris Pearce [:cpearce (Not reading bugmail)]]

Tim, does this call stack give you any clues to the cause of this crash on Android in libtheora's oc_dec_residual_tokens_unpack?


17:39:55     INFO -  /data/anr/traces.txt not found
17:39:55  WARNING -  PROCESS-CRASH | /tests/content/media/test/test_streams_element_capture.html | application crashed [@ oc_dec_residual_tokens_unpack]
17:39:55     INFO -  Crash dump filename: /tmp/tmpqCRQ57/76987cee-537f-6fd6-2582488c-2206b5e7.dmp
17:39:55     INFO -  Operating system: Android
17:39:55     INFO -                    0.0.0 Linux 3.2.0+ #2 SMP PREEMPT Thu Nov 29 08:06:57 EST 2012 armv7l pandaboard/pandaboard/pandaboard:4.0.4/IMM76I/5:eng/test-keys
17:39:55     INFO -  CPU: arm
17:39:55     INFO -       2 CPUs
17:39:55     INFO -  Crash reason:  SIGSEGV
17:39:55     INFO -  Crash address: 0xa000ec
17:39:55     INFO -  Thread 46 (crashed)
17:39:55     INFO -   0  libxul.so!oc_dec_residual_tokens_unpack [decode.c:c84673c64f39 : 1117 + 0x2]
17:39:55     INFO -       r4 = 0x0000003b    r5 = 0x6c1a7010    r6 = 0x000007a4    r7 = 0xffffffe9
17:39:55     INFO -       r8 = 0x00000003    r9 = 0x6a197958   r10 = 0x00000001    fp = 0x00000024
17:39:55     INFO -       sp = 0x6a197718    lr = 0x0000043b    pc = 0x631fac0c
17:39:55     INFO -      Found by: given as instruction pointer in context
17:39:55     INFO -   1  libxul.so!th_decode_packetin [decode.c:c84673c64f39 : 2158 + 0x3]
17:39:55     INFO -       r4 = 0x6c1a7010    r5 = 0x6c1a7010    r6 = 0x68d60000    r7 = 0x00000057
17:39:55     INFO -       r8 = 0x685afc00    r9 = 0x692b1000   r10 = 0x6635f080    fp = 0x0000001d
17:39:55     INFO -       sp = 0x6a197b80    pc = 0x631fb8a9
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   2  libxul.so!mozilla::OggReader::DecodeTheora(ogg_packet*, long long) [OggReader.cpp:c84673c64f39 : 762 + 0x7]
17:39:55     INFO -       r4 = 0x00049b74    r5 = 0x00000000    r6 = 0x00049b74    r7 = 0x00000000
17:39:55     INFO -       r8 = 0x66397220    r9 = 0x69afaf24   r10 = 0x5be55ff0    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197ca8    pc = 0x62caee95
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   3  libxul.so!mozilla::OggReader::DecodeVideoFrame(bool&, long long) [OggReader.cpp:c84673c64f39 : 856 + 0x9]
17:39:55     INFO -       r4 = 0x00049b74    r5 = 0x00000000    r6 = 0x00000000    r7 = 0x66397220
17:39:55     INFO -       r8 = 0x5be55ff0    r9 = 0x69afaf24   r10 = 0x6a197deb    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197d90    pc = 0x62caf085
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   4  libxul.so!mozilla::MediaDecoderStateMachine::DecodeLoop() [MediaDecoderStateMachine.cpp:c84673c64f39 : 905 + 0xf]
17:39:55     INFO -       r4 = 0x00049b74    r5 = 0x00000000    r6 = 0x00000001    r7 = 0x5beb2c40
17:39:55     INFO -       r8 = 0x00000000    r9 = 0x00000000   r10 = 0x00000001    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197dd0    pc = 0x62b3cf71
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   5  libxul.so!mozilla::MediaDecoderStateMachine::DecodeThreadRun() [MediaDecoderStateMachine.cpp:c84673c64f39 : 510 + 0x5]
17:39:55     INFO -       r4 = 0x5beb2c40    r5 = 0x00000000    r6 = 0x6a197e7c    r7 = 0x00000001
17:39:55     INFO -       r8 = 0x00000000    r9 = 0x6a197eaf   r10 = 0x685bbccc    fp = 0x00000001
17:39:55     INFO -       sp = 0x6a197e50    pc = 0x62b3dcdb
17:39:55     INFO -      Found by: call frame info
17:39:55     INFO -   6  libxul.so!nsRunnableMethodImpl<tag_nsresult (mozilla::dom::NotificationPermissionRequest::*)(), true>::Run() [nsThreadUtils.h:c84673c64f39 : 356 + 0x5]

Comment 2

[Timothy B. Terriberry (:derf)]

If that line number is accurate, the immediate cause that comes to mind is that something has overwritten the memory used to store the unpacked codebooks (or, we have a bug in decoding them, but if so I would not expect this to be intermittent).

Unfortunately, that doesn't narrow down the cause very much. I'd like to look at the asm to be sure what's going on... any idea how I unpack the libxul.so we ship in the apk into something objdump can use?

Comment 3

[Ed Morley [:emorley]]

Intermittent failure not seen for >3 months; filter on mass-intermittent-wfm-20140812.