Closed Bug 1171255 Opened 10 years ago Closed 8 years ago

Intermittent e10s test_peerConnection_twoAudioVideoStreams.html | application timed out after 330 seconds with no output | after ABORT: file shared_memory_posix.cc, line 221

Categories

(Core :: WebRTC, defect, P1)

defect

Tracking

()

RESOLVED INCOMPLETE
Tracking Status
e10s + ---
firefox41 --- wontfix
firefox42 --- wontfix
firefox43 --- wontfix
firefox44 --- wontfix
firefox45 --- wontfix
firefox46 --- disabled
firefox47 --- disabled
firefox-esr38 --- unaffected
firefox-esr45 --- unaffected

People

(Reporter: KWierso, Assigned: bwc)

References

(Depends on 1 open bug, Blocks 1 open bug)

Details

(Keywords: intermittent-failure, Whiteboard: [test disabled on Linux debug e10s])

Attachments

(1 file)

16:24:01 INFO - 3941 INFO TEST-PASS | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | Media flowing for pcLocal_local3_audio 16:24:01 INFO - 3942 INFO TEST-PASS | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | Media flowing for pcLocal_local4_video 16:24:01 INFO - 3943 INFO TEST-PASS | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | Media flowing for pcLocal_remote7_audio 16:24:01 INFO - 3944 INFO TEST-PASS | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | Media flowing for pcLocal_remote8_audio 16:24:01 INFO - 3945 INFO canplaythrough fired for media element pcRemote_remote5_video 16:24:01 INFO - 3946 INFO canplaythrough fired for media element pcRemote_remote6_video 16:24:01 INFO - 3947 INFO canplaythrough fired for media element pcLocal_remote5_video 16:24:01 INFO - 3948 INFO TEST-PASS | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | Media flowing for pcLocal_remote5_video 16:24:01 INFO - 3949 INFO canplaythrough fired for media element pcLocal_remote6_video 16:24:01 INFO - 3950 INFO TEST-PASS | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | Media flowing for pcLocal_remote6_video 16:24:01 INFO - 3951 INFO Run step 41: PC_REMOTE_CHECK_MEDIA_FLOW_PRESENT 16:24:01 INFO - 3952 INFO Analyzing element: pcRemote_local1_audio 16:24:01 INFO - 3953 INFO Analyzing element: pcRemote_local2_video 16:24:01 INFO - 3954 INFO Analyzing element: pcRemote_local3_audio 16:24:01 INFO - 3955 INFO Analyzing element: pcRemote_local4_video 16:24:01 INFO - 3956 INFO Analyzing element: pcRemote_remote5_video 16:24:01 INFO - 3957 INFO Analyzing element: pcRemote_remote6_video 16:24:01 INFO - 3958 INFO Analyzing element: pcRemote_remote7_audio 16:24:01 INFO - 3959 INFO Analyzing element: pcRemote_remote8_audio 16:24:01 WARNING - TEST-UNEXPECTED-TIMEOUT | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | application timed out after 330 seconds with no output 16:24:02 INFO - Xlib: extension "RANDR" missing on display ":0". 16:24:03 INFO - TEST-INFO | screentopng: exit 0 16:24:03 INFO - TEST-INFO | Main app process: killed by SIGIOT 16:24:03 WARNING - TEST-UNEXPECTED-FAIL | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | application terminated with exit code 6 16:24:03 INFO - runtests.py | Application ran for: 1:11:42.602674 16:24:03 INFO - zombiecheck | Reading PID log: /tmp/tmpFHC93cpidlog 16:24:03 INFO - ==> process 1906 launched child process 1955 16:24:03 INFO - ==> process 1906 launched child process 2933 16:24:03 INFO - ==> process 1906 launched child process 2943 16:24:03 INFO - ==> process 1906 launched child process 2956 16:24:03 INFO - ==> process 1906 launched child process 6875 16:24:03 INFO - zombiecheck | Checking for orphan process with PID: 1955 16:24:03 INFO - zombiecheck | Checking for orphan process with PID: 2933 16:24:03 INFO - zombiecheck | Checking for orphan process with PID: 2943 16:24:03 INFO - zombiecheck | Checking for orphan process with PID: 2956 16:24:03 INFO - zombiecheck | Checking for orphan process with PID: 6875 16:24:18 INFO - mozcrash Saved minidump as /builds/slave/test/build/blobber_upload_dir/1bb654a8-941f-7ec1-045f0e1f-6405d9ef.dmp 16:24:18 INFO - mozcrash Saved app info as /builds/slave/test/build/blobber_upload_dir/1bb654a8-941f-7ec1-045f0e1f-6405d9ef.extra 16:24:18 WARNING - PROCESS-CRASH | dom/media/tests/mochitest/test_peerConnection_twoAudioVideoStreams.html | application crashed [@ linux-gate.so + 0x424] 16:24:18 INFO - Crash dump filename: /tmp/tmpObEp3i.mozrunner/minidumps/1bb654a8-941f-7ec1-045f0e1f-6405d9ef.dmp 16:24:18 INFO - Operating system: Linux 16:24:18 INFO - 0.0.0 Linux 3.2.0-76-generic-pae #111-Ubuntu SMP Tue Jan 13 22:34:29 UTC 2015 i686 16:24:18 INFO - CPU: x86 16:24:18 INFO - GenuineIntel family 6 model 45 stepping 7 16:24:18 INFO - 1 CPU 16:24:18 INFO - Crash reason: SIGABRT 16:24:18 INFO - Crash address: 0x723 16:24:18 INFO - Thread 0 (crashed) 16:24:18 INFO - 0 linux-gate.so + 0x424 16:24:18 INFO - eip = 0xb779a424 esp = 0xbfdc7360 ebp = 0xbfdc73d8 ebx = 0xa0608580 16:24:18 INFO - esi = 0x00000000 edi = 0xb7626ff4 eax = 0xfffffffc ecx = 0x00000006 16:24:18 INFO - edx = 0xffffffff efl = 0x00200282 16:24:18 INFO - Found by: given as instruction pointer in context 16:24:18 INFO - 1 libglib-2.0.so.0.3200.1 + 0x4706d 16:24:18 INFO - eip = 0xb1b3a06e esp = 0xbfdc73e0 ebp = 0xa0608580 16:24:18 INFO - Found by: previous frame's frame pointer 16:24:18 INFO - 2 libglib-2.0.so.0.3200.1 + 0xf88ff 16:24:18 INFO - eip = 0xb1beb900 esp = 0xbfdc73f8 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 3 libglib-2.0.so.0.3200.1 + 0x863cf 16:24:18 INFO - eip = 0xb1b793d0 esp = 0xbfdc7400 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 4 libglib-2.0.so.0.3200.1 + 0x868f5 16:24:18 INFO - eip = 0xb1b798f6 esp = 0xbfdc7408 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 5 libxul.so!nsAppShell::ScheduleNativeEventCallback() [nsAppShell.cpp:0c9e32f0a414 : 153 + 0x4] 16:24:18 INFO - eip = 0xb39e6d73 esp = 0xbfdc7410 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 6 libglib-2.0.so.0.3200.1 + 0xf8593 16:24:18 INFO - eip = 0xb1beb594 esp = 0xbfdc7414 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 7 libglib-2.0.so.0.3200.1 + 0x46efa 16:24:18 INFO - eip = 0xb1b39efb esp = 0xbfdc742c ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 8 libglib-2.0.so.0.3200.1 + 0xf7ff3 16:24:18 INFO - eip = 0xb1beaff4 esp = 0xbfdc7430 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 9 libglib-2.0.so.0.3200.1 + 0x471c0 16:24:18 INFO - eip = 0xb1b3a1c1 esp = 0xbfdc7440 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 10 libnspr4.so!_fini + 0x113b7 16:24:18 INFO - eip = 0xb747a550 esp = 0xbfdc7448 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 11 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7450 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 12 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7454 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 13 libxul.so!nsAppShell::ProcessNextNativeEvent(bool) [nsAppShell.cpp:0c9e32f0a414 : 158 + 0xb] 16:24:18 INFO - eip = 0xb39e6b7c esp = 0xbfdc7460 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 14 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7474 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 15 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7478 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 16 libxul.so!nsBaseAppShell::DoProcessNextNativeEvent(bool, unsigned int) [nsBaseAppShell.cpp:0c9e32f0a414 : 141 + 0xc] 16:24:18 INFO - eip = 0xb39c9ba0 esp = 0xbfdc7480 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 17 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc748c ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 18 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7490 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 19 libxul.so!nsBaseAppShell::OnProcessNextEvent(nsIThreadInternal*, bool, unsigned int) [nsBaseAppShell.cpp:0c9e32f0a414 : 299 + 0xe] 16:24:18 INFO - eip = 0xb39c9cbd esp = 0xbfdc74b0 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 20 libxul.so!nsXPConnect::OnProcessNextEvent(nsIThreadInternal*, bool, unsigned int) [nsXPConnect.cpp:0c9e32f0a414 : 927 + 0xa] 16:24:18 INFO - eip = 0xb28341e1 esp = 0xbfdc74dc ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 21 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc74e0 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 22 libxul.so!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:0c9e32f0a414 : 815 + 0x1d] 16:24:18 INFO - eip = 0xb2293426 esp = 0xbfdc74f0 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 23 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7504 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 24 libxul.so!_fini + 0x1f9961f 16:24:18 INFO - eip = 0xb6db9978 esp = 0xbfdc7508 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 25 libnspr4.so!PR_Unlock [ptsynch.c:0c9e32f0a414 : 194 + 0xa] 16:24:18 INFO - eip = 0xb745af2b esp = 0xbfdc750c ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 26 libxul.so!mozilla::OffTheBooksMutex::Unlock() [BlockingResourceBase.cpp:0c9e32f0a414 : 390 + 0x8] 16:24:18 INFO - eip = 0xb22ab2cd esp = 0xbfdc7520 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 27 libxul.so!mozilla::OffTheBooksMutex::Unlock() [BlockingResourceBase.cpp:0c9e32f0a414 : 388 + 0xc] 16:24:18 INFO - eip = 0xb22ab2b5 esp = 0xbfdc7530 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 28 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7534 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 29 libxul.so!TimerThread::RemoveTimer(nsTimerImpl*) [TimerThread.cpp:0c9e32f0a414 : 431 + 0xb] 16:24:18 INFO - eip = 0xb22961a4 esp = 0xbfdc7540 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 30 libxul.so!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:0c9e32f0a414 : 733 + 0xa] 16:24:18 INFO - eip = 0xb229312f esp = 0xbfdc754c ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 31 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7550 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 32 libxul.so!NS_ProcessNextEvent(nsIThread*, bool) [nsThreadUtils.cpp:0c9e32f0a414 : 265 + 0xf] 16:24:18 INFO - eip = 0xb22bb69d esp = 0xbfdc7560 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 33 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7598 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 34 libxul.so!mozilla::ipc::MessagePump::Run(base::MessagePump::Delegate*) [MessagePump.cpp:0c9e32f0a414 : 127 + 0xb] 16:24:18 INFO - eip = 0xb253655a esp = 0xbfdc75a0 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 35 libpthread-2.15.so + 0xb87e 16:24:18 INFO - eip = 0xb777487f esp = 0xbfdc75b4 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 36 libxul.so!_fini + 0x1e2a827 16:24:18 INFO - eip = 0xb6c4ab80 esp = 0xbfdc75c4 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 37 libxul.so!_fini + 0x202422b 16:24:18 INFO - eip = 0xb6e44584 esp = 0xbfdc75c8 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 38 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc75d4 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 39 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc75d8 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 40 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc75e0 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 41 libxul.so!MessageLoop::RunInternal() [message_loop.cc:0c9e32f0a414 : 233 + 0x13] 16:24:18 INFO - eip = 0xb2515e82 esp = 0xbfdc75f0 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 42 libxul.so!MessageLoop::RunInternal() [message_loop.cc:0c9e32f0a414 : 232 + 0x4] 16:24:18 INFO - eip = 0xb2515e3d esp = 0xbfdc7600 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 43 libxul.so!MessageLoop::RunInternal() [message_loop.cc:0c9e32f0a414 : 231 + 0x9] 16:24:18 INFO - eip = 0xb2515e2c esp = 0xbfdc7610 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 44 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7614 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 45 libxul.so!MessageLoop::Run() [message_loop.cc:0c9e32f0a414 : 226 + 0x7] 16:24:18 INFO - eip = 0xb2515ea8 esp = 0xbfdc7620 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 46 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7630 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 47 libxul.so!_fini + 0x2011ba7 16:24:18 INFO - eip = 0xb6e31f00 esp = 0xbfdc7638 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 48 libxul.so!nsBaseAppShell::Run() [nsBaseAppShell.cpp:0c9e32f0a414 : 165 + 0xd] 16:24:18 INFO - eip = 0xb39c0b57 esp = 0xbfdc7650 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 49 libxul.so!nsBaseAppShell::Run() [nsBaseAppShell.cpp:0c9e32f0a414 : 165 + 0x4] 16:24:18 INFO - eip = 0xb39c0b4e esp = 0xbfdc7660 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 50 libxul.so!_fini + 0x11e59d9 16:24:18 INFO - eip = 0xb6005d32 esp = 0xbfdc7668 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 51 libnspr4.so!PR_Unlock [ptsynch.c:0c9e32f0a414 : 194 + 0xa] 16:24:18 INFO - eip = 0xb745af2b esp = 0xbfdc766c ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 52 libxul.so!_fini + 0x2011bc3 16:24:18 INFO - eip = 0xb6e31f1c esp = 0xbfdc7670 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 53 libxul.so!nsAppStartup::Run() [nsAppStartup.cpp:0c9e32f0a414 : 280 + 0x8] 16:24:18 INFO - eip = 0xb4147daa esp = 0xbfdc7680 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - 54 libxul.so!EnumValidate [nsCommandLine.cpp:0c9e32f0a414 : 588 + 0x1] 16:24:18 INFO - eip = 0xb4078126 esp = 0xbfdc7688 ebp = 0xa0608580 16:24:18 INFO - Found by: stack scanning 16:24:18 INFO - Thread 1
Randell -- Can you sanity check that the priority of this doesn't need to be higher?
backlog: --- → webRTC+
Rank: 35
Flags: needinfo?(rjesup)
Priority: -- → P3
I strongly suspect we have a race in the test; less likely there's a race in the code. Seem to be getting 1-3 a day starting 6/3 (did something land on 6/1-6/3 that might cause this?)
Flags: needinfo?(rjesup)
Flags: needinfo?(drno)
Flags: needinfo?(docfaraday)
This seems to be Linux e10s only, except one single Windows XP failure. The last three ones, which seem to the only once with logs preserved at this point, timed out at different points then the initial report, and also at different points among each other. Maybe our test machines got too slow to execute this test? Maybe Andreas new media verification takes more time and therefore pushes this over the 5min limit?
Flags: needinfo?(drno)
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → DUPLICATE
Whoops, this one is still hitting since bug 1194397 landed.
Status: RESOLVED → REOPENED
Resolution: DUPLICATE → ---
Summary: Intermittent test_peerConnection_twoAudioVideoStreams.html | application timed out after 330 seconds with no output | after ABORT: file shared_memory_posix.cc, line 221 → Intermittent e10s test_peerConnection_twoAudioVideoStreams.html | application timed out after 330 seconds with no output | after ABORT: file shared_memory_posix.cc, line 221
Blocks: e10s-tests
tracking-e10s: --- → +
Depends on: 1126078
Everybody else running in this chunk (particularly the ones which run after this test that only get to run when this doesn't hang) got together and agreed that they would be happier with you gone. 38% failure rate on Linux32 in the push where I triggered 50 runs, which surprises me. Once I started looking at it, I was expecting it to be closer to 50%.
Status: REOPENED → NEW
Keywords: leave-open
Whiteboard: [test disabled on Linux debug e10s]
Version: 40 Branch → Trunk
Bumping priority. We need to figure out why this hangs. Perhaps bandwidth estimation is causing problems with multiple flows? Perhaps the new pref would help?
Rank: 35 → 17
Flags: needinfo?(drno)
Flags: needinfo?(docfaraday)
Priority: P3 → P1
This is just bug 1126078 rearing its ugly head AFAICT.
Flags: needinfo?(docfaraday)
I think Byron is right. I was hitting this in the try runs for bug 1224845 as well.
Flags: needinfo?(drno)
Status: NEW → RESOLVED
Closed: 10 years ago8 years ago
Resolution: --- → INCOMPLETE
Removing leave-open keyword from resolved bugs, per :sylvestre.
Keywords: leave-open
Assignee: nobody → docfaraday
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: