Intermittent TEST-UNEXPECTED-TIMEOUT | dom/workers/test/test_WorkerDebugger.xhtml,test_WorkerDebugger.xhtml | application timed out after 370 seconds with no output
Categories
(Core :: DOM: Workers, defect, P3)
Tracking
()
People
(Reporter: intermittent-bug-filer, Assigned: asuth)
References
(Regressed 1 open bug)
Details
(Keywords: intermittent-failure, Whiteboard: [stockwell disabled])
Attachments
(2 files)
![]() |
||
Updated•7 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 4•7 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
![]() |
||
Updated•7 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 32•6 years ago
|
||
In the last 7 days, there have been 42 failures.
The failures are on linux64-qr platform, opt build type.
An example of a recent log file:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=228797501&repo=autoland&lineNumber=5643
And the relevant part of the log:
[task 2019-02-16T04:43:27.134Z] 04:43:27 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Non-top-level worker debugger should not have window.
[task 2019-02-16T04:43:27.134Z] 04:43:27 INFO - Terminate the top-level chrome worker and the non-top-level content worker, and wait for their debuggers to be unregistered and closed.
[task 2019-02-16T04:43:27.136Z] 04:43:27 INFO - Buffered messages finished
[task 2019-02-16T04:43:27.137Z] 04:43:27 ERROR - TEST-UNEXPECTED-TIMEOUT | dom/workers/test/test_WorkerDebugger.xul | application timed out after 370 seconds with no output
[task 2019-02-16T04:43:27.138Z] 04:43:27 ERROR - Force-terminating active process(es).
[task 2019-02-16T04:43:27.139Z] 04:43:27 INFO - Determining child pids from psutil...
[task 2019-02-16T04:43:27.142Z] 04:43:27 INFO - []
[task 2019-02-16T04:43:27.143Z] 04:43:27 INFO - ==> process 7323 launched child process 7348
[task 2019-02-16T04:43:27.145Z] 04:43:27 INFO - Found child pids: set([7348])
[task 2019-02-16T04:43:27.147Z] 04:43:27 INFO - Failed to get child procs
[task 2019-02-16T04:43:27.148Z] 04:43:27 INFO - Killing process: 7348
[task 2019-02-16T04:43:27.149Z] 04:43:27 INFO - TEST-INFO | started process screentopng
[task 2019-02-16T04:43:27.440Z] 04:43:27 INFO - TEST-INFO | screentopng: exit 0
[task 2019-02-16T04:43:27.441Z] 04:43:27 INFO - Can't trigger Breakpad, process no longer exists
[task 2019-02-16T04:43:27.442Z] 04:43:27 INFO - Killing process: 7323
[task 2019-02-16T04:43:27.444Z] 04:43:27 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-02-16T04:43:27.614Z] 04:43:27 INFO - psutil found pid 7323 dead
[task 2019-02-16T04:43:27.636Z] 04:43:27 WARNING - runtests.py | Failed to get app exit code - running/crashed?
[task 2019-02-16T04:43:27.637Z] 04:43:27 INFO - TEST-INFO | Main app process: exit 0
[task 2019-02-16T04:43:27.638Z] 04:43:27 INFO - runtests.py | Application ran for: 0:06:19.454556
[task 2019-02-16T04:43:27.639Z] 04:43:27 INFO - zombiecheck | Reading PID log: /tmp/tmp7VcOR9pidlog
[task 2019-02-16T04:43:27.640Z] 04:43:27 INFO - ==> process 7323 launched child process 7348
[task 2019-02-16T04:43:27.641Z] 04:43:27 INFO - zombiecheck | Checking for orphan process with PID: 7348
[task 2019-02-16T04:43:27.642Z] 04:43:27 INFO - mozcrash Downloading symbols from: https://queue.taskcluster.net/v1/task/fTJJ6hIwRzuuq9b6j6t2Kg/artifacts/public/build/target.crashreporter-symbols.zip
[task 2019-02-16T04:43:34.813Z] 04:43:34 INFO - mozcrash Copy/paste: /builds/worker/workspace/build/linux64-minidump_stackwalk /tmp/tmpFFNnbE.mozrunner/minidumps/0b6328d5-ff9c-c5d0-47ac-fe3cbd83197e.dmp /tmp/tmpjOkWak
[task 2019-02-16T04:43:45.980Z] 04:43:45 INFO - mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/0b6328d5-ff9c-c5d0-47ac-fe3cbd83197e.dmp
[task 2019-02-16T04:43:45.981Z] 04:43:45 INFO - mozcrash Saved app info as /builds/worker/workspace/build/blobber_upload_dir/0b6328d5-ff9c-c5d0-47ac-fe3cbd83197e.extra
[task 2019-02-16T04:43:46.136Z] 04:43:46 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ libc-2.23.so + 0xfb74d]
[task 2019-02-16T04:43:46.138Z] 04:43:46 INFO - Crash dump filename: /tmp/tmpFFNnbE.mozrunner/minidumps/0b6328d5-ff9c-c5d0-47ac-fe3cbd83197e.dmp
[task 2019-02-16T04:43:46.138Z] 04:43:46 INFO - Operating system: Linux
[task 2019-02-16T04:43:46.139Z] 04:43:46 INFO - 0.0.0 Linux 4.4.0-1014-aws #14taskcluster1-Ubuntu SMP Tue Apr 3 10:27:00 UTC 2018 x86_64
[task 2019-02-16T04:43:46.140Z] 04:43:46 INFO - CPU: amd64
[task 2019-02-16T04:43:46.141Z] 04:43:46 INFO - family 6 model 62 stepping 4
[task 2019-02-16T04:43:46.142Z] 04:43:46 INFO - 2 CPUs
[task 2019-02-16T04:43:46.143Z] 04:43:46 INFO -
[task 2019-02-16T04:43:46.144Z] 04:43:46 INFO - GPU: UNKNOWN
[task 2019-02-16T04:43:46.144Z] 04:43:46 INFO -
[task 2019-02-16T04:43:46.145Z] 04:43:46 INFO - Crash reason: SIGABRT
[task 2019-02-16T04:43:46.146Z] 04:43:46 INFO - Crash address: 0x3e800000405
[task 2019-02-16T04:43:46.147Z] 04:43:46 INFO - Process uptime: not available
[task 2019-02-16T04:43:46.148Z] 04:43:46 INFO -
[task 2019-02-16T04:43:46.149Z] 04:43:46 INFO - Thread 0 (crashed)
[task 2019-02-16T04:43:46.149Z] 04:43:46 INFO - 0 libc-2.23.so + 0xfb74d
[task 2019-02-16T04:43:46.150Z] 04:43:46 INFO - rax = 0xfffffffffffffffc rdx = 0x00000000ffffffff
[task 2019-02-16T04:43:46.151Z] 04:43:46 INFO - rcx = 0x00007f2d4c55874d rbx = 0x00007f2d4c2473c0
[task 2019-02-16T04:43:46.152Z] 04:43:46 INFO - rsi = 0x0000000000000004 rdi = 0x00007f2d2450aee0
[task 2019-02-16T04:43:46.153Z] 04:43:46 INFO - rbp = 0x00007ffe5c500720 rsp = 0x00007ffe5c5006d0
[task 2019-02-16T04:43:46.154Z] 04:43:46 INFO - r8 = 0x0000000000000004 r9 = 0x0000000000000001
[task 2019-02-16T04:43:46.155Z] 04:43:46 INFO - r10 = 0x00007f2d2450aac0 r11 = 0x0000000000000293
[task 2019-02-16T04:43:46.155Z] 04:43:46 INFO - r12 = 0x00007f2d2450aee0 r13 = 0x00007ffe5c5006e8
[task 2019-02-16T04:43:46.156Z] 04:43:46 INFO - r14 = 0x00000000ffffffff r15 = 0x0000000000000004
[task 2019-02-16T04:43:46.157Z] 04:43:46 INFO - rip = 0x00007f2d4c55874d
[task 2019-02-16T04:43:46.158Z] 04:43:46 INFO - Found by: given as instruction pointer in context
[task 2019-02-16T04:43:46.159Z] 04:43:46 INFO - 1 libxul.so!PollWrapper(_GPollFD*, unsigned int, int) [nsAppShell.cpp:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 53 + 0xf]
[task 2019-02-16T04:43:46.160Z] 04:43:46 INFO - rbp = 0x00007ffe5c500720 rsp = 0x00007ffe5c5006e0
[task 2019-02-16T04:43:46.161Z] 04:43:46 INFO - rip = 0x00007f2d3e7f39e5
[task 2019-02-16T04:43:46.161Z] 04:43:46 INFO - Found by: stack scanning
[task 2019-02-16T04:43:46.162Z] 04:43:46 INFO - 2 libglib-2.0.so.0.4800.2 + 0x4a38c
[task 2019-02-16T04:43:46.163Z] 04:43:46 INFO - rbx = 0x00007f2d4c2b8450 rbp = 0x0000000000000004
[task 2019-02-16T04:43:46.164Z] 04:43:46 INFO - rsp = 0x00007ffe5c500730 r12 = 0x00007f2d2450aee0
[task 2019-02-16T04:43:46.165Z] 04:43:46 INFO - r13 = 0x00000000ffffffff r14 = 0x00007f2d3e7f3920
[task 2019-02-16T04:43:46.166Z] 04:43:46 INFO - r15 = 0x0000000000000004 rip = 0x00007f2d48b7538c
[task 2019-02-16T04:43:46.166Z] 04:43:46 INFO - Found by: call frame info
[task 2019-02-16T04:43:46.167Z] 04:43:46 INFO - 3 libglib-2.0.so.0.4800.2 + 0x4a49c
[task 2019-02-16T04:43:46.168Z] 04:43:46 INFO - rsp = 0x00007ffe5c500790 rip = 0x00007f2d48b7549c
[task 2019-02-16T04:43:46.169Z] 04:43:46 INFO - Found by: stack scanning
[task 2019-02-16T04:43:46.170Z] 04:43:46 INFO - 4 libxul.so!nsAppShell::ProcessNextNativeEvent(bool) [nsAppShell.cpp:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 268 + 0x7]
[task 2019-02-16T04:43:46.171Z] 04:43:46 INFO - rsp = 0x00007ffe5c5007b0 rip = 0x00007f2d3e7f3b9b
[task 2019-02-16T04:43:46.172Z] 04:43:46 INFO - Found by: stack scanning
[task 2019-02-16T04:43:46.173Z] 04:43:46 INFO - 5 libxul.so!nsBaseAppShell::OnProcessNextEvent(nsIThreadInternal*, bool) [nsBaseAppShell.cpp:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 120 + 0xe]
[task 2019-02-16T04:43:46.173Z] 04:43:46 INFO - rsp = 0x00007ffe5c5007c0 rip = 0x00007f2d3e7b8bd5
[task 2019-02-16T04:43:46.174Z] 04:43:46 INFO - Found by: stack scanning
[task 2019-02-16T04:43:46.175Z] 04:43:46 INFO - 6 libxul.so!non-virtual thunk to nsBaseAppShell::OnProcessNextEvent(nsIThreadInternal*, bool) [nsBaseAppShell.cpp:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 0 + 0x5]
[task 2019-02-16T04:43:46.176Z] 04:43:46 INFO - rsp = 0x00007ffe5c500820 rip = 0x00007f2d3e7b8ccd
[task 2019-02-16T04:43:46.177Z] 04:43:46 INFO - Found by: stack scanning
[task 2019-02-16T04:43:46.178Z] 04:43:46 INFO - 7 libxul.so!nsThread::ProcessNextEvent(bool, bool*) [nsThread.cpp:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 1074 + 0x10]
[task 2019-02-16T04:43:46.179Z] 04:43:46 INFO - rsp = 0x00007ffe5c500830 rip = 0x00007f2d3c474c61
[task 2019-02-16T04:43:46.180Z] 04:43:46 INFO - Found by: stack scanning
[task 2019-02-16T04:43:46.180Z] 04:43:46 INFO -
[task 2019-02-16T04:43:46.181Z] 04:43:46 INFO - Thread 1
[task 2019-02-16T04:43:46.182Z] 04:43:46 INFO - 0 libc-2.23.so + 0x1014d9
[task 2019-02-16T04:43:46.183Z] 04:43:46 INFO - rax = 0xfffffffffffffffc rdx = 0x0000000000000020
[task 2019-02-16T04:43:46.184Z] 04:43:46 INFO - rcx = 0x00007f2d4c55e4d9 rbx = 0x00007f2d4c45bd38
[task 2019-02-16T04:43:46.185Z] 04:43:46 INFO - rsi = 0x00007f2d4c287200 rdi = 0x0000000000000011
[task 2019-02-16T04:43:46.185Z] 04:43:46 INFO - rbp = 0x00007f2d4c45bbe0 rsp = 0x00007f2d4c45bb98
[task 2019-02-16T04:43:46.186Z] 04:43:46 INFO - r8 = 0x0000001800000001 r9 = 0x00007f2d4c45bbe0
[task 2019-02-16T04:43:46.186Z] 04:43:46 INFO - r10 = 0x00000000ffffffff r11 = 0x0000000000000246
[task 2019-02-16T04:43:46.187Z] 04:43:46 INFO - r12 = 0x00000000ffffffff r13 = 0x00007f2d3a01f000
[task 2019-02-16T04:43:46.187Z] 04:43:46 INFO - r14 = 0x00007f2d3a01f110 r15 = 0x00007f2d4c2f84d0
[task 2019-02-16T04:43:46.188Z] 04:43:46 INFO - rip = 0x00007f2d4c55e4d9
[task 2019-02-16T04:43:46.188Z] 04:43:46 INFO - Found by: given as instruction pointer in context
[task 2019-02-16T04:43:46.189Z] 04:43:46 INFO - 1 libxul.so!event_base_loop [event.c:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 1947 + 0xd]
[task 2019-02-16T04:43:46.189Z] 04:43:46 INFO - rbp = 0x00007f2d4c45bc80 rsp = 0x00007f2d4c45bbf0
[task 2019-02-16T04:43:46.190Z] 04:43:46 INFO - rip = 0x00007f2d3c8dab76
[task 2019-02-16T04:43:46.190Z] 04:43:46 INFO - Found by: previous frame's frame pointer
[task 2019-02-16T04:43:46.191Z] 04:43:46 INFO - 2 libxul.so!base::MessagePumpLibevent::Run(base::MessagePump::Delegate*) [message_pump_libevent.cc:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 0 + 0xe]
[task 2019-02-16T04:43:46.191Z] 04:43:46 INFO - rbx = 0x00007f2d4c45bd38 rbp = 0x00007f2d4c45bce0
[task 2019-02-16T04:43:46.192Z] 04:43:46 INFO - rsp = 0x00007f2d4c45bc90 r12 = 0x0000000000000000
[task 2019-02-16T04:43:46.192Z] 04:43:46 INFO - r13 = 0x0000000000000000 r14 = 0x00007f2d3a02b0c0
[task 2019-02-16T04:43:46.193Z] 04:43:46 INFO - r15 = 0x00007f2d3a02b0d8 rip = 0x00007f2d3c8ca266
[task 2019-02-16T04:43:46.194Z] 04:43:46 INFO - Found by: call frame info
[task 2019-02-16T04:43:46.194Z] 04:43:46 INFO - 3 libxul.so!MessageLoop::Run() [message_loop.cc:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 315 + 0x8]
[task 2019-02-16T04:43:46.195Z] 04:43:46 INFO - rbx = 0x00007f2d4c2fff40 rbp = 0x00007f2d4c45bd10
[task 2019-02-16T04:43:46.195Z] 04:43:46 INFO - rsp = 0x00007f2d4c45bcf0 r12 = 0x0000000000000000
[task 2019-02-16T04:43:46.196Z] 04:43:46 INFO - r13 = 0x00007ffe5c500d2f r14 = 0x00007f2d4c45bd38
[task 2019-02-16T04:43:46.196Z] 04:43:46 INFO - r15 = 0x00007f2d4c2fff68 rip = 0x00007f2d3c8c8989
[task 2019-02-16T04:43:46.196Z] 04:43:46 INFO - Found by: call frame info
[task 2019-02-16T04:43:46.197Z] 04:43:46 INFO - 4 libxul.so!base::Thread::ThreadMain() [thread.cc:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 192 + 0x8]
[task 2019-02-16T04:43:46.197Z] 04:43:46 INFO - rbx = 0x00007f2d4c2fff40 rbp = 0x00007f2d4c45bf00
[task 2019-02-16T04:43:46.198Z] 04:43:46 INFO - rsp = 0x00007f2d4c45bd20 r12 = 0x0000000000000000
[task 2019-02-16T04:43:46.198Z] 04:43:46 INFO - r13 = 0x00007ffe5c500d2f r14 = 0x00007f2d4c45bd38
[task 2019-02-16T04:43:46.199Z] 04:43:46 INFO - r15 = 0x00007f2d4c2fff68 rip = 0x00007f2d3c8d0fc9
[task 2019-02-16T04:43:46.199Z] 04:43:46 INFO - Found by: call frame info
[task 2019-02-16T04:43:46.200Z] 04:43:46 INFO - 5 libxul.so!ThreadFunc(void*) [platform_thread_posix.cc:1cfd69d05aa1cd508266c37c1b27ce061bec7bb3 : 40 + 0x6]
[task 2019-02-16T04:43:46.200Z] 04:43:46 INFO - rbx = 0x0000000000000000 rbp = 0x00007f2d4c45bf10
[task 2019-02-16T04:43:46.201Z] 04:43:46 INFO - rsp = 0x00007f2d4c45bf10 r12 = 0x0000000000000000
[task 2019-02-16T04:43:46.201Z] 04:43:46 INFO - r13 = 0x00007ffe5c500d2f r14 = 0x00007f2d4c45c9c0
[task 2019-02-16T04:43:46.202Z] 04:43:46 INFO - r15 = 0x00007f2d4c2fff50 rip = 0x00007f2d3c8cdd8a
[task 2019-02-16T04:43:46.202Z] 04:43:46 INFO - Found by: call frame info
[task 2019-02-16T04:43:46.203Z] 04:43:46 INFO - 6 libpthread-2.23.so + 0x76ba
[task 2019-02-16T04:43:46.203Z] 04:43:46 INFO - rbx = 0x0000000000000000 rbp = 0x0000000000000000
[task 2019-02-16T04:43:46.204Z] 04:43:46 INFO - rsp = 0x00007f2d4c45bf20 r12 = 0x0000000000000000
[task 2019-02-16T04:43:46.204Z] 04:43:46 INFO - r13 = 0x00007ffe5c500d2f r14 = 0x00007f2d4c45c9c0
[task 2019-02-16T04:43:46.205Z] 04:43:46 INFO - r15 = 0x00007f2d4c2fff50 rip = 0x00007f2d4d4db6ba
[task 2019-02-16T04:43:46.205Z] 04:43:46 INFO - Found by: call frame info
[task 2019-02-16T04:43:46.205Z] 04:43:46 INFO - 7 libc-2.23.so + 0x10741d
[task 2019-02-16T04:43:46.206Z] 04:43:46 INFO - rsp = 0x00007f2d4c45bfc0 rip = 0x00007f2d4c56441d
[task 2019-02-16T04:43:46.206Z] 04:43:46 INFO - Found by: stack scanning
Andrew, as you are the triage owner of this component, could you please take a look at this?
Thank you!
Comment hidden (Intermittent Failures Robot) |
Comment 34•6 years ago
|
||
I think the devtools team might have better insight here.
Comment 35•6 years ago
|
||
Pinged Jan and Jason on slack but reiterating here if that's how they organise their bug work :)
Comment 36•6 years ago
|
||
@Brian: could this be caused by the recent work on breakpoints in workers?
See comment #42 - the number of failures increased in last 7 days.
Honza
Comment 37•6 years ago
|
||
Interesting to note that all the recent failures are only on the "qr" (quantum render) platforms.
Comment 38•6 years ago
|
||
Ah makes sense, they were skipped before: https://hg.mozilla.org/mozilla-central/rev/be6554246c5045d6289873709151656b5086e7d6
So I doubt the recent spike is related to a devtools change, it's just that those tests didn't run on QR platforms until recently.
Updated•6 years ago
|
Updated•6 years ago
|
Comment 39•6 years ago
|
||
Bug 1244409 also spiked recently on qr platforms (test_WorkerDebuggerManager.xul)
Comment 40•6 years ago
•
|
||
I notice that both intermittents timeout while waiting for workers to unregister after calling worker.terminate()
.
Andrew, I guess this needs more investigation in WorkerDebuggerManager.cpp, but from what you know about workers, is there anything that might be different with QuantumRender enabled?
(If no one has time to investigate the issue in WorkerDebuggerManager.cpp, the best option here and in Bug 1244409 will be to skip the tests on QR platforms)
Comment hidden (Intermittent Failures Robot) |
Comment 42•6 years ago
|
||
Sorry for not replying sooner.
(In reply to Julian Descottes [:jdescottes] from comment #40)
I notice that both intermittents timeout while waiting for workers to unregister after calling
worker.terminate()
.Andrew, I guess this needs more investigation in WorkerDebuggerManager.cpp, but from what you know about workers, is there anything that might be different with QuantumRender enabled?
Not that I know of. Yaron, can you take a quick look here and see if we can do something simple before we just skip the test (bug 1244409)?
Comment 43•6 years ago
|
||
I don't see anything that looks obvious here; the failure is related to termination of workers, which is pretty buggy as it is, so it's possible that timing differences introduced by QR cause a hidden bug to manifest itself. I don't think there's a quick win here, unfortunately.
Comment 44•6 years ago
|
||
Thanks, Yaron. Sounds like we should go ahead with disabling the test in bug 1244409 (looks like Alex and maybe Julian are active there).
Comment 45•6 years ago
|
||
Both tests started spiking after they were enabled on QR platforms.
They are timing out after terminating a worker.
The WorkerDebuggerManager never receives the expected unregister notification.
Comment 46•6 years ago
|
||
Thanks for checking Yaron!
I think we can keep bug 1244409 open because it was reopened before the corresponding test spiked on QR platforms (even if it was very low frequency at that time). Let's skip both tests on QR platforms with a link to this bug in the chrome.ini, since most of the discussion around the issue with QR platforms happened here.
Assignee | ||
Comment 47•6 years ago
|
||
So :bhackett may have a fix for this on bug 1522246 since it sounds like worker termination is broken.
Comment 48•6 years ago
|
||
Ah thanks for the info! blocking on the other bug, let's wait to see if it fixes the intermittent here.
Comment hidden (Intermittent Failures Robot) |
Comment 50•6 years ago
|
||
Update: there have been 47 failures within the last 7 days:
- 1 on Linux x32 debug
- 1 on Linux x64 pgo
- 45 on Linux x64 QuantumRender pgo opt
Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=232106472&repo=mozilla-inbound&lineNumber=5757
Comment hidden (Intermittent Failures Robot) |
Comment 52•6 years ago
|
||
Over the last 7 days there have been 58 failures on this bug.
These happen on: linux64, linux64-pgo-qr, linux64-qr
Here is the most recent log failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=233858166&repo=autoland&lineNumber=5662
[task 2019-03-14T12:11:07.112Z] 12:11:07 INFO - GECKO(7688) | FAK WorkerDebugger.postMessage_worker.js
[task 2019-03-14T12:11:07.112Z] 12:11:07 INFO - GECKO(7688) | FAK WorkerDebugger.postMessage_worker.js
[task 2019-03-14T12:11:07.175Z] 12:11:07 INFO - GECKO(7688) | FAK WorkerDebugger.postMessage_childWorker.js
[task 2019-03-14T12:11:07.195Z] 12:11:07 INFO - GECKO(7688) | MEMORY STAT | vsize 1898MB | residentFast 368MB | heapAllocated 149MB
[task 2019-03-14T12:11:07.203Z] 12:11:07 INFO - TEST-OK | dom/workers/test/test_WorkerDebugger.postMessage.xul | took 130ms
[task 2019-03-14T12:11:07.300Z] 12:11:07 INFO - TEST-START | dom/workers/test/test_WorkerDebugger.xul
[task 2019-03-14T12:11:07.342Z] 12:11:07 INFO - GECKO(7688) | FAK WorkerDebugger_worker.js
[task 2019-03-14T12:11:07.342Z] 12:11:07 INFO - GECKO(7688) | FAK WorkerDebugger_worker.js
[task 2019-03-14T12:11:07.363Z] 12:11:07 INFO - GECKO(7688) | FAK WorkerDebugger_childWorker.js
[task 2019-03-14T12:17:17.388Z] 12:17:17 INFO - Buffered messages logged at 12:11:07
[task 2019-03-14T12:17:17.389Z] 12:17:17 INFO - Create a top-level chrome worker that creates a non-top-level content worker and wait for their debuggers to be registered.
[task 2019-03-14T12:17:17.390Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Debugger with url WorkerDebugger_worker.js should be registered.
[task 2019-03-14T12:17:17.390Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Promise 1 out of 2 should be resolved.
[task 2019-03-14T12:17:17.391Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Debugger with url WorkerDebugger_childWorker.js should be registered.
[task 2019-03-14T12:17:17.392Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Promise 2 out of 2 should be resolved.
[task 2019-03-14T12:17:17.392Z] 12:17:17 INFO - Check that the top-level chrome worker debugger has the correct properties.
[task 2019-03-14T12:17:17.393Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Chrome worker debugger should be chrome.
[task 2019-03-14T12:17:17.394Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Top-level debugger should not have parent.
[task 2019-03-14T12:17:17.394Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Chrome worker debugger should be dedicated.
[task 2019-03-14T12:17:17.395Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Top-level dedicated worker debugger should have window.
[task 2019-03-14T12:17:17.396Z] 12:17:17 INFO - Check that the non-top-level content worker debugger has the correct properties.
[task 2019-03-14T12:17:17.396Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Content worker debugger should be content.
[task 2019-03-14T12:17:17.396Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Non-top-level worker debugger should have parent.
[task 2019-03-14T12:17:17.397Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Content worker debugger should be dedicated.
[task 2019-03-14T12:17:17.398Z] 12:17:17 INFO - TEST-PASS | dom/workers/test/test_WorkerDebugger.xul | Non-top-level worker debugger should not have window.
[task 2019-03-14T12:17:17.398Z] 12:17:17 INFO - Terminate the top-level chrome worker and the non-top-level content worker, and wait for their debuggers to be unregistered and closed.
[task 2019-03-14T12:17:17.400Z] 12:17:17 INFO - Buffered messages finished
[task 2019-03-14T12:17:17.401Z] 12:17:17 ERROR - TEST-UNEXPECTED-TIMEOUT | dom/workers/test/test_WorkerDebugger.xul | application timed out after 370 seconds with no output
[task 2019-03-14T12:17:17.401Z] 12:17:17 ERROR - Force-terminating active process(es).
[task 2019-03-14T12:17:17.402Z] 12:17:17 INFO - Determining child pids from psutil...
[task 2019-03-14T12:17:17.412Z] 12:17:17 INFO - []
[task 2019-03-14T12:17:17.413Z] 12:17:17 INFO - ==> process 7688 launched child process 7713
[task 2019-03-14T12:17:17.414Z] 12:17:17 INFO - Found child pids: set([7713])
[task 2019-03-14T12:17:17.416Z] 12:17:17 INFO - Failed to get child procs
[task 2019-03-14T12:17:17.417Z] 12:17:17 INFO - Killing process: 7713
[task 2019-03-14T12:17:17.418Z] 12:17:17 INFO - TEST-INFO | started process screentopng
[task 2019-03-14T12:17:17.709Z] 12:17:17 INFO - TEST-INFO | screentopng: exit 0
[task 2019-03-14T12:17:17.709Z] 12:17:17 INFO - Can't trigger Breakpad, process no longer exists
[task 2019-03-14T12:17:17.709Z] 12:17:17 INFO - Killing process: 7688
[task 2019-03-14T12:17:17.709Z] 12:17:17 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-03-14T12:17:17.850Z] 12:17:17 INFO - psutil found pid 7688 dead
[task 2019-03-14T12:17:17.850Z] 12:17:17 WARNING - runtests.py | Failed to get app exit code - running/crashed?
[task 2019-03-14T12:17:17.850Z] 12:17:17 INFO - TEST-INFO | Main app process: exit 0
[task 2019-03-14T12:17:17.850Z] 12:17:17 INFO - runtests.py | Application ran for: 0:06:19.160098
[task 2019-03-14T12:17:17.850Z] 12:17:17 INFO - zombiecheck | Reading PID log: /tmp/tmp61wtp8pidlog
Comment hidden (Intermittent Failures Robot) |
Comment 54•6 years ago
|
||
bug 1522246 landed two weeks ago but the intermittent is still here. Will land the skip if attached here.
Comment 55•6 years ago
|
||
Updated•6 years ago
|
Updated•6 years ago
|
Comment 56•6 years ago
|
||
bugherder |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Updated•6 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Updated•5 years ago
|
Updated•5 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
![]() |
||
Updated•5 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Updated•2 years ago
|
Assignee | ||
Updated•1 year ago
|
Assignee | ||
Comment 161•1 year ago
|
||
Building on my changes in bug 1828084, we:
- Leverage the changes to
dom_worker_helper.js
's waitForMultiple to
moot erroneous ordering dependencies. - Modernize the tests to use add_task so thrown exceptions turn into
rejections that the test framework can experience. - Avoid a potential GC race involving the creation of a SharedWorker by
ensuring that we root both workers. - Avoid a potential SharedWorker creation race where the test wants to
create a new SharedWorker but could potentially catch the previous
SharedWorker with the same script URL by using a name for the
SharedWorker. - Reduce the arbitrary choice of 15 seconds for the worker
self-cancellation-on-close behavior to 100ms because there was no
meaningful reason to take so long.
Both now pass --verify locally for me.
Depends on D191822
Comment 162•1 year ago
|
||
Comment 163•1 year ago
|
||
bugherder |
Assignee | ||
Comment 164•11 months ago
|
||
(This wasn't intended to be leave-open at the time of landing and bug 1861785 tracks the follow-up work, so marking fixed.)
Description
•