1727258 - Intermittent [tier 2] automation.py | application crashed [@ core::ops::function::FnOnce::call_once{{vtable.shim}}]

Status: RESOLVED WORKSFORME

(Core :: General, defect)

Description

[Treeherder Bug Filer]

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=349360320&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aCmAarGqQD2i1eBQMFkGAw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-08-24T07:34:19.498Z] 07:34:19     INFO - TEST-START | Shutdown
[task 2021-08-24T07:34:19.499Z] 07:34:19     INFO - Browser Chrome Test Summary
[task 2021-08-24T07:34:19.500Z] 07:34:19     INFO - Passed:  60
[task 2021-08-24T07:34:19.502Z] 07:34:19     INFO - Failed:  0
[task 2021-08-24T07:34:19.504Z] 07:34:19     INFO - Todo:    0
[task 2021-08-24T07:34:19.505Z] 07:34:19     INFO - Mode:    e10s
[task 2021-08-24T07:34:19.506Z] 07:34:19     INFO - *** End BrowserChrome Test Results ***
[task 2021-08-24T07:34:19.556Z] 07:34:19     INFO - GECKO(11676) | Exiting due to channel error.
[task 2021-08-24T07:34:19.557Z] 07:34:19     INFO - GECKO(11676) | Exiting due to channel error.
[task 2021-08-24T07:34:19.558Z] 07:34:19     INFO - GECKO(11676) | Exiting due to channel error.
[task 2021-08-24T07:34:19.559Z] 07:34:19     INFO - GECKO(11676) | Exiting due to channel error.
[task 2021-08-24T07:34:19.560Z] 07:34:19     INFO - GECKO(11676) | Exiting due to channel error.
[task 2021-08-24T07:34:19.561Z] 07:34:19     INFO - GECKO(11676) | Exiting due to channel error.
[task 2021-08-24T07:34:19.580Z] 07:34:19     INFO - TEST-INFO | Main app process: exit 0
[task 2021-08-24T07:34:19.580Z] 07:34:19     INFO - runtests.py | Application ran for: 0:00:07.375319
[task 2021-08-24T07:34:19.581Z] 07:34:19     INFO - zombiecheck | Reading PID log: /tmp/tmpustb86qspidlog
[task 2021-08-24T07:34:19.581Z] 07:34:19     INFO - ==> process 11676 launched child process 11696
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - ==> process 11676 launched child process 11752
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - ==> process 11676 launched child process 11773
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - ==> process 11676 launched child process 11796
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - ==> process 11676 launched child process 11871
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - ==> process 11676 launched child process 11907
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - ==> process 11676 launched child process 11933
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - zombiecheck | Checking for orphan process with PID: 11907
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - zombiecheck | Checking for orphan process with PID: 11933
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - zombiecheck | Checking for orphan process with PID: 11752
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - zombiecheck | Checking for orphan process with PID: 11696
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - zombiecheck | Checking for orphan process with PID: 11796
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - zombiecheck | Checking for orphan process with PID: 11773
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - zombiecheck | Checking for orphan process with PID: 11871
[task 2021-08-24T07:34:19.582Z] 07:34:19     INFO - Stopping web server
[task 2021-08-24T07:34:19.584Z] 07:34:19     INFO - Server shut down.
[task 2021-08-24T07:34:19.606Z] 07:34:19     INFO - Web server killed.
[task 2021-08-24T07:34:19.606Z] 07:34:19     INFO - Stopping web socket server
[task 2021-08-24T07:34:19.625Z] 07:34:19     INFO - Stopping ssltunnel
[task 2021-08-24T07:34:19.646Z] 07:34:19  WARNING - leakcheck | refcount logging is off, so leaks can't be detected!
[task 2021-08-24T07:34:19.646Z] 07:34:19     INFO - runtests.py | Running tests: end.
[task 2021-08-24T07:34:19.665Z] 07:34:19     INFO - Buffered messages finished
[task 2021-08-24T07:34:19.665Z] 07:34:19     INFO - Running manifest: dom/credentialmanagement/tests/browser/browser.ini
[task 2021-08-24T07:34:19.685Z] 07:34:19     INFO -  Setting pipeline to PAUSED ...
[task 2021-08-24T07:34:19.686Z] 07:34:19     INFO -  Pipeline is PREROLLING ...
[task 2021-08-24T07:34:19.688Z] 07:34:19     INFO -  Pipeline is PREROLLED ...
[task 2021-08-24T07:34:19.688Z] 07:34:19     INFO -  Setting pipeline to PLAYING ...
[task 2021-08-24T07:34:19.688Z] 07:34:19     INFO -  New clock: GstSystemClock
[task 2021-08-24T07:34:19.722Z] 07:34:19     INFO -  Got EOS from element "pipeline0".
[task 2021-08-24T07:34:19.722Z] 07:34:19     INFO -  Execution ended after 0:00:00.033407197
[task 2021-08-24T07:34:19.722Z] 07:34:19     INFO -  Setting pipeline to PAUSED ...
[task 2021-08-24T07:34:19.722Z] 07:34:19     INFO -  Setting pipeline to READY ...
[task 2021-08-24T07:34:19.723Z] 07:34:19     INFO -  (gst-launch-1.0:11965): GStreamer-CRITICAL **: 07:34:19.721: gst_object_unref: assertion '((GObject *) object)->ref_count > 0' failed
[task 2021-08-24T07:34:19.723Z] 07:34:19     INFO -  Setting pipeline to NULL ...
[task 2021-08-24T07:34:19.724Z] 07:34:19     INFO -  Freeing pipeline ...
[task 2021-08-24T07:34:19.986Z] 07:34:19     INFO - PID 11978 | pk12util: PKCS12 IMPORT SUCCESSFUL
[task 2021-08-24T07:34:20.051Z] 07:34:20     INFO - MochitestServer : launching ['/builds/worker/workspace/build/tests/bin/xpcshell', '-g', '/builds/worker/workspace/build/application/firefox', '-f', '/builds/worker/workspace/build/tests/bin/components/httpd.js', '-e', "const _PROFILE_PATH = '/tmp/tmpxfz0nv2o.mozrunner'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '127.0.0.1'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', '/builds/worker/workspace/build/tests/mochitest/server.js']
[task 2021-08-24T07:34:20.052Z] 07:34:20     INFO - runtests.py | Server pid: 11984
[task 2021-08-24T07:34:20.067Z] 07:34:20     INFO - runtests.py | Websocket server pid: 11987
[task 2021-08-24T07:34:20.090Z] 07:34:20     INFO - runtests.py | SSL tunnel pid: 11992
[task 2021-08-24T07:34:20.143Z] 07:34:20     INFO - runtests.py | Running with scheme: http
[task 2021-08-24T07:34:20.143Z] 07:34:20     INFO - runtests.py | Running with e10s: True
[task 2021-08-24T07:34:20.143Z] 07:34:20     INFO - runtests.py | Running with fission: False
[task 2021-08-24T07:34:20.143Z] 07:34:20     INFO - runtests.py | Running with cross-origin iframes: False
[task 2021-08-24T07:34:20.143Z] 07:34:20     INFO - runtests.py | Running with serviceworker_e10s: True
[task 2021-08-24T07:34:20.144Z] 07:34:20     INFO - runtests.py | Running with socketprocess_e10s: False
[task 2021-08-24T07:34:20.144Z] 07:34:20     INFO - runtests.py | Running tests: start.
[task 2021-08-24T07:34:20.145Z] 07:34:20     INFO - 
[task 2021-08-24T07:34:20.178Z] 07:34:20     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox -marionette -foreground -profile /tmp/tmpxfz0nv2o.mozrunner
[task 2021-08-24T07:34:20.188Z] 07:34:20     INFO - runtests.py | Application pid: 12009
[task 2021-08-24T07:34:20.188Z] 07:34:20     INFO - TEST-INFO | started process GECKO(12009)
[task 2021-08-24T07:34:20.769Z] 07:34:20     INFO - GECKO(12009) | 1629790460767	Marionette	INFO	Marionette enabled
[task 2021-08-24T07:34:20.820Z] 07:34:20     INFO - GECKO(12009) | 1629790460819	Marionette	TRACE	Received observer notification toplevel-window-ready
[task 2021-08-24T07:34:21.062Z] 07:34:21     INFO - GECKO(12009) | ExceptionHandler::GenerateDump cloned child 12073
[task 2021-08-24T07:34:21.063Z] 07:34:21     INFO - GECKO(12009) | ExceptionHandler::SendContinueSignalToChild sent continue signal to child
[task 2021-08-24T07:34:21.072Z] 07:34:21     INFO - GECKO(12009) | ExceptionHandler::WaitForContinueSignal waiting for continue signal...
[task 2021-08-24T07:34:21.175Z] 07:34:21     INFO - GECKO(12009) | Exiting due to channel error.
[task 2021-08-24T07:37:20.281Z] 07:37:20     INFO - runtests.py | Waiting for browser...
[task 2021-08-24T07:37:20.282Z] 07:37:20     INFO - TEST-INFO | Main app process: exit 11
[task 2021-08-24T07:37:20.283Z] 07:37:20     INFO - Buffered messages finished
[task 2021-08-24T07:37:20.283Z] 07:37:20    ERROR - TEST-UNEXPECTED-FAIL | automation.py | application terminated with exit code 11
[task 2021-08-24T07:37:20.284Z] 07:37:20     INFO - runtests.py | Application ran for: 0:03:00.104418
[task 2021-08-24T07:37:20.285Z] 07:37:20     INFO - zombiecheck | Reading PID log: /tmp/tmpoxx0f_thpidlog
[task 2021-08-24T07:37:20.285Z] 07:37:20     INFO - ==> process 12009 launched child process 12029
[task 2021-08-24T07:37:20.286Z] 07:37:20     INFO - ==> process 12009 launched child process 12080
[task 2021-08-24T07:37:20.286Z] 07:37:20     INFO - zombiecheck | Checking for orphan process with PID: 12080
[task 2021-08-24T07:37:20.286Z] 07:37:20     INFO - zombiecheck | Checking for orphan process with PID: 12029
[task 2021-08-24T07:37:20.288Z] 07:37:20     INFO - mozcrash Downloading symbols from: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/X1Hgi82nR7-FSrKRrrxQ1Q/artifacts/public/build/target.crashreporter-symbols.zip
[task 2021-08-24T07:37:22.787Z] 07:37:22     INFO - mozcrash Copy/paste: /builds/worker/fetches/minidump_stackwalk/minidump_stackwalk /tmp/tmpxfz0nv2o.mozrunner/minidumps/03f17d1e-b298-3855-34d2-6a5b3226aa09.dmp /tmp/tmpeppsg7mx
[task 2021-08-24T07:37:26.761Z] 07:37:26     INFO - mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/03f17d1e-b298-3855-34d2-6a5b3226aa09.dmp
[task 2021-08-24T07:37:26.761Z] 07:37:26     INFO - mozcrash Saved app info as /builds/worker/workspace/build/blobber_upload_dir/03f17d1e-b298-3855-34d2-6a5b3226aa09.extra
[task 2021-08-24T07:37:26.982Z] 07:37:26     INFO - PROCESS-CRASH | automation.py | application crashed [@ core::ops::function::FnOnce::call_once{{vtable.shim}}]
[task 2021-08-24T07:37:26.982Z] 07:37:26     INFO - Crash dump filename: /tmp/tmpxfz0nv2o.mozrunner/minidumps/03f17d1e-b298-3855-34d2-6a5b3226aa09.dmp
[task 2021-08-24T07:37:26.982Z] 07:37:26     INFO - Operating system: Linux
[task 2021-08-24T07:37:26.983Z] 07:37:26     INFO -                   0.0.0 Linux 4.4.0-1014-aws #14taskcluster1-Ubuntu SMP Tue Apr 3 10:27:00 UTC 2018 x86_64
[task 2021-08-24T07:37:26.984Z] 07:37:26     INFO - CPU: amd64
[task 2021-08-24T07:37:26.984Z] 07:37:26     INFO -      family 6 model 85 stepping 7
[task 2021-08-24T07:37:26.985Z] 07:37:26     INFO -      2 CPUs
[task 2021-08-24T07:37:26.985Z] 07:37:26     INFO - 
[task 2021-08-24T07:37:26.985Z] 07:37:26     INFO - GPU: UNKNOWN
[task 2021-08-24T07:37:26.986Z] 07:37:26     INFO - 
[task 2021-08-24T07:37:26.986Z] 07:37:26     INFO - Crash reason:  SIGSEGV / SEGV_MAPERR
[task 2021-08-24T07:37:26.987Z] 07:37:26     INFO - Crash address: 0x18
[task 2021-08-24T07:37:26.987Z] 07:37:26     INFO - Process uptime: not available
[task 2021-08-24T07:37:26.987Z] 07:37:26     INFO - 
[task 2021-08-24T07:37:26.988Z] 07:37:26     INFO - Thread 49 tid 12072 (crashed) 0  libxul.so!std::sys_common::backtrace::__rust_begin_short_backtrace [backtrace.rs:a178d0322ce20e33eac124758e837cbd80a6f633 : 125 + 0x2a]
[task 2021-08-24T07:37:26.988Z] 07:37:26     INFO -     rax = 0x0000000000000000   rdx = 0x000000000000000b
[task 2021-08-24T07:37:26.989Z] 07:37:26     INFO -     rcx = 0x0000000000000001   rbx = 0x00007f2df3b03310
[task 2021-08-24T07:37:26.989Z] 07:37:26     INFO -     rsi = 0x00007f2e0e676700   rdi = 0x00007f2e0e666088
[task 2021-08-24T07:37:26.989Z] 07:37:26     INFO -     rbp = 0x00007f2dfda7de20   rsp = 0x00007f2dfda7ddf0
[task 2021-08-24T07:37:26.990Z] 07:37:26     INFO -      r8 = 0x0000000000000000    r9 = 0x00007f2df44299e0
[task 2021-08-24T07:37:26.990Z] 07:37:26     INFO -     r10 = 0x00007f2e1a500120   r11 = 0x0000000000000002
[task 2021-08-24T07:37:26.990Z] 07:37:26     INFO -     r12 = 0x00007f2df45d1800   r13 = 0x0000000000000000
[task 2021-08-24T07:37:26.991Z] 07:37:26     INFO -     r14 = 0x00007f2dfda7de30   r15 = 0x00007f2df3b03310
[task 2021-08-24T07:37:26.991Z] 07:37:26     INFO -     rip = 0x00007f2e0d7647c5
[task 2021-08-24T07:37:26.992Z] 07:37:26     INFO -     Found by: given as instruction pointer in context
[task 2021-08-24T07:37:26.992Z] 07:37:26     INFO -  1  libxul.so!core::ops::function::FnOnce::call_once{{vtable.shim}} [function.rs:a178d0322ce20e33eac124758e837cbd80a6f633 : 227 + 0x75]
[task 2021-08-24T07:37:26.992Z] 07:37:26     INFO -     rbx = 0x00007f2df3b03310   rbp = 0x00007f2dfda7de60
[task 2021-08-24T07:37:26.993Z] 07:37:26     INFO -     rsp = 0x00007f2dfda7de30   r12 = 0x00007f2df45d1800
[task 2021-08-24T07:37:26.993Z] 07:37:26     INFO -     r13 = 0x0000000000000000   r14 = 0x00007f2dfda7de30
[task 2021-08-24T07:37:26.994Z] 07:37:26     INFO -     r15 = 0x00007f2df3b03310   rip = 0x00007f2e0d767335
[task 2021-08-24T07:37:26.994Z] 07:37:26     INFO -     Found by: call frame info
[task 2021-08-24T07:37:26.994Z] 07:37:26     INFO -  2  libxul.so!std::sys::unix::thread::Thread::new::thread_start [thread.rs:a178d0322ce20e33eac124758e837cbd80a6f633 : 71 + 0xf]
[task 2021-08-24T07:37:26.995Z] 07:37:26     INFO -     rbx = 0x00007f2e109c8178   rbp = 0x0000000000000000
[task 2021-08-24T07:37:26.995Z] 07:37:26     INFO -     rsp = 0x00007f2dfda7de70   r12 = 0x00007f2df45d1800
[task 2021-08-24T07:37:26.996Z] 07:37:26     INFO -     r13 = 0x0000000000000000   r14 = 0x0000000000000000
[task 2021-08-24T07:37:26.996Z] 07:37:26     INFO -     r15 = 0x00007f2df3b03310   rip = 0x00007f2e0da2f427
[task 2021-08-24T07:37:26.997Z] 07:37:26     INFO -     Found by: call frame info
[task 2021-08-24T07:37:26.997Z] 07:37:26     INFO -  3  libpthread.so.0 + 0x76db
[task 2021-08-24T07:37:26.998Z] 07:37:26     INFO -     rbx = 0x0000000000000000   rbp = 0x0000000000000000
[task 2021-08-24T07:37:26.998Z] 07:37:26     INFO -     rsp = 0x00007f2dfda7dec0   r12 = 0x00007f2dfda7df80
[task 2021-08-24T07:37:26.998Z] 07:37:26     INFO -     r13 = 0x0000000000000000   r14 = 0x00007f2df45d1800
[task 2021-08-24T07:37:26.999Z] 07:37:26     INFO -     r15 = 0x00007f2dfd555ed0   rip = 0x00007f2e1b62b6db
[task 2021-08-24T07:37:26.999Z] 07:37:26     INFO -     Found by: call frame info
[task 2021-08-24T07:37:27.000Z] 07:37:27     INFO -  4  libc.so.6 + 0x121a3f
[task 2021-08-24T07:37:27.000Z] 07:37:27     INFO -     rsp = 0x00007f2dfda7df80   rip = 0x00007f2e1a811a3f
[task 2021-08-24T07:37:27.001Z] 07:37:27     INFO -     Found by: stack scanning
[task 2021-08-24T07:37:27.001Z] 07:37:27     INFO - 
[task 2021-08-24T07:37:27.001Z] 07:37:27     INFO - Thread 0 tid 12009

Comment 1

[Intermittent Failures Robot]

1 failures in 2580 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727258&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 3084 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727258&startday=2021-08-30&endday=2021-09-05&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 3266 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727258&startday=2021-09-06&endday=2021-09-12&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 3375 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727258&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 3626 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727258&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Core::Graphics: WebRender' component, and is moving the bug to that component. Please revert this change in case you think the bot is wrong.