Closed Bug 1678232 Opened 5 years ago Closed 1 year ago

Intermittent runner.py | application crashed [@ 0xffff9f011198bc90] | [@ NS_DebugBreak]

Categories

(Core :: Security: Process Sandboxing, defect, P2)

defect

Tracking

()

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Assigned: bobowen)

Details

(Keywords: crash, intermittent-failure)

Crash Data

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=322260314&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HDHRKvyqQF2nOnrjfG52eA/runs/0/artifacts/public/logs/live_backing.log


[task 2020-11-19T04:42:37.243Z] 04:42:37     INFO -  raptor-webext-desktop Info: starting firefox
[task 2020-11-19T04:42:37.243Z] 04:42:37     INFO -  Application command: C:\Users\task_1605759768\build\application\firefox\firefox.exe --allow-downgrade --wait-for-browser -profile c:\users\task_1605759768\appdata\local\temp\tmpihaphy\profile
[task 2020-11-19T04:43:13.590Z] 04:43:13     INFO -  raptor-control-server Info: received webext_loaded: raptor runner.js is loaded!
[task 2020-11-19T04:43:13.600Z] 04:43:13     INFO -  raptor-control-server Info: received webext_status: testing on Firefox 85.0a1 20201118215158
[task 2020-11-19T04:43:13.610Z] 04:43:13     INFO -  raptor-control-server Info: received webext_status: test name is: raptor-youtube-playback-h264-sfr-firefox-live
[task 2020-11-19T04:43:13.629Z] 04:43:13     INFO -  raptor-control-server Info: received webext_status: test settings url is: http://127.0.0.1:49792/json/raptor-youtube-playback-h264-sfr-firefox-live.json
[task 2020-11-19T04:43:13.634Z] 04:43:13     INFO -  raptor-control-server Info: received webext_status: starting raptorRunner
[task 2020-11-19T04:43:13.639Z] 04:43:13     INFO -  raptor-control-server Info: reading test settings from json/raptor-youtube-playback-h264-sfr-firefox-live.json
[task 2020-11-19T04:43:13.639Z] 04:43:13     INFO -  raptor-control-server Info: sent test settings to webext runner
[task 2020-11-19T04:43:13.644Z] 04:43:13     INFO -  PID 1172 | console.info: "[raptor-runnerjs] getting test settings from control server"
[task 2020-11-19T04:43:13.644Z] 04:43:13     INFO -  PID 1172 | console.info: "[raptor-runnerjs] test settings received: {\"raptor-options\": {\"expected_browser_cycles\": 1, \"subtest_unit\": \"score\", \"alert_threshold\": 2.0, \"type\": \"benchmark\", \"page_cycles\": 1, \"subtest_lower_is_better\": true, \"test_url\": \"https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run\", \"page_timeout\": 2160000, \"host\": \"127.0.0.1\", \"cold\": false, \"lower_is_better\": true, \"unit\": \"score\"}}"
[task 2020-11-19T04:43:13.644Z] 04:43:13     INFO -  PID 1172 | console.info: "[raptor-runnerjs] test URL: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run"
[task 2020-11-19T04:43:13.645Z] 04:43:13     INFO -  PID 1172 | console.info: "[raptor-runnerjs] using page timeout: 2160000ms"
[task 2020-11-19T04:43:19.587Z] 04:43:19     INFO -  PID 1172 | console.info: "[raptor-runnerjs] wrote settings to ext local storage"
[task 2020-11-19T04:43:19.587Z] 04:43:19     INFO -  PID 1172 | console.info: "[raptor-runnerjs] benchmark test start"
[task 2020-11-19T04:43:19.592Z] 04:43:19     INFO -  raptor-control-server Info: received webext_status: * pausing 1 seconds to let browser settle... *
[task 2020-11-19T04:43:20.602Z] 04:43:20     INFO -  raptor-control-server Info: received webext_status: opening new tab
[task 2020-11-19T04:43:20.694Z] 04:43:20     INFO -  raptor-control-server Info: received webext_status: opened new empty tab: 2
[task 2020-11-19T04:43:20.717Z] 04:43:20     INFO -  raptor-control-server Info: received webext_status: found active tab with id 2
[task 2020-11-19T04:43:20.727Z] 04:43:20     INFO -  raptor-control-server Info: received webext_status: running 1 pagecycles of https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
[task 2020-11-19T04:43:21.740Z] 04:43:21     INFO -  raptor-control-server Info: received webext_status: begin page cycle 1
[task 2020-11-19T04:43:21.740Z] 04:43:21     INFO -  raptor-control-server Info: received webext_status: update tab 2 for https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
[task 2020-11-19T04:43:21.759Z] 04:43:21     INFO -  raptor-control-server Info: received webext_status: tab 2 updated
[task 2020-11-19T04:43:22.071Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-runnerjs] ready to poll for results; turning on page-timeout timer"
[task 2020-11-19T04:43:22.071Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-runnerjs] now is 1605761002060, set raptor alarm raptor-page-timeout to expire at 1605763162060"
[task 2020-11-19T04:43:22.072Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-runnerjs] waiting for results..."
[task 2020-11-19T04:43:22.072Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:22.315Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:22.576Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:22.817Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:22.928Z] 04:43:22     INFO -  PID 1172 | console.info: "[raptor-benchmarkjs] raptor benchmark content loaded"
[task 2020-11-19T04:43:23.068Z] 04:43:23     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:23.327Z] 04:43:23     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:23.571Z] 04:43:23     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:23.822Z] 04:43:23     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:24.072Z] 04:43:24     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:24.327Z] 04:43:24     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:24.573Z] 04:43:24     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:24.827Z] 04:43:24     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:25.075Z] 04:43:25     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:25.329Z] 04:43:25     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:25.579Z] 04:43:25     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:25.829Z] 04:43:25     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:26.079Z] 04:43:26     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:26.337Z] 04:43:26     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:26.582Z] 04:43:26     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:26.834Z] 04:43:26     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:27.081Z] 04:43:27     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:27.332Z] 04:43:27     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:27.584Z] 04:43:27     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:27.835Z] 04:43:27     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T04:43:28.089Z] 04:43:28     INFO -  PID 1172 | console.info: "[raptor-runnerjs] results pending..."
[task 2020-11-19T05:19:44.036Z] 05:19:44     INFO -  mozcrash Downloading symbols from: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fd_iGRZBQPG3tGh7ScjzSA/artifacts/public/build/target.crashreporter-symbols.zip
[task 2020-11-19T05:19:48.773Z] 05:19:48     INFO -  mozcrash Copy/paste: C:/Users/task_1605759768/fetches\minidump_stackwalk\minidump_stackwalk.exe c:\users\task_1605759768\appdata\local\temp\tmpihaphy\profile\minidumps\e1fb7f42-2f15-42b2-9e26-f4025c281c18.dmp c:\users\task_1605759768\appdata\local\temp\tmp7co05y
[task 2020-11-19T05:19:56.036Z] 05:19:56     INFO -  mozcrash Saved minidump as C:\Users\task_1605759768\build\blobber_upload_dir\e1fb7f42-2f15-42b2-9e26-f4025c281c18.dmp
[task 2020-11-19T05:19:56.036Z] 05:19:56     INFO -  mozcrash Saved app info as C:\Users\task_1605759768\build\blobber_upload_dir\e1fb7f42-2f15-42b2-9e26-f4025c281c18.extra
[task 2020-11-19T05:19:56.038Z] 05:19:56    ERROR -  PROCESS-CRASH | runner.py | application crashed [@ 0xffff9f011198bc90]
[task 2020-11-19T05:19:56.039Z] 05:19:56     INFO -  Crash dump filename: c:\users\task_1605759768\appdata\local\temp\tmpihaphy\profile\minidumps\e1fb7f42-2f15-42b2-9e26-f4025c281c18.dmp
[task 2020-11-19T05:19:56.040Z] 05:19:56     INFO -  Operating system: Windows NT
[task 2020-11-19T05:19:56.040Z] 05:19:56     INFO -                    10.0.17134
[task 2020-11-19T05:19:56.040Z] 05:19:56     INFO -  CPU: amd64
[task 2020-11-19T05:19:56.041Z] 05:19:56     INFO -       family 6 model 142 stepping 9
[task 2020-11-19T05:19:56.041Z] 05:19:56     INFO -       4 CPUs
[task 2020-11-19T05:19:56.041Z] 05:19:56     INFO -  GPU: UNKNOWN
[task 2020-11-19T05:19:56.042Z] 05:19:56     INFO -  Crash reason:  EXCEPTION_ACCESS_VIOLATION_EXEC
[task 2020-11-19T05:19:56.042Z] 05:19:56     INFO -  Crash address: 0x1198bc90
[task 2020-11-19T05:19:56.042Z] 05:19:56     INFO -  Assertion: Unknown assertion type 0x00000000
[task 2020-11-19T05:19:56.042Z] 05:19:56     INFO -  Process uptime: 16 seconds
[task 2020-11-19T05:19:56.043Z] 05:19:56     INFO -  Thread 36 (crashed)
[task 2020-11-19T05:19:56.043Z] 05:19:56     INFO -   0  0xffff9f011198bc90
[task 2020-11-19T05:19:56.043Z] 05:19:56     INFO -      rax = 0x0000000000000000   rdx = 0x0000000000000000
[task 2020-11-19T05:19:56.044Z] 05:19:56     INFO -      rcx = 0x0000007da207f8d0   rbx = 0x0000000000000000
[task 2020-11-19T05:19:56.044Z] 05:19:56     INFO -      rsi = 0x0000024a5e22c730   rdi = 0x0000024a00000000
[task 2020-11-19T05:19:56.044Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f7d0
[task 2020-11-19T05:19:56.045Z] 05:19:56     INFO -       r8 = 0x0000007da207f6c8    r9 = 0x00000000000003e8
[task 2020-11-19T05:19:56.045Z] 05:19:56     INFO -      r10 = 0x00000fffa7b1ad86   r11 = 0x0000000000000051
[task 2020-11-19T05:19:56.045Z] 05:19:56     INFO -      r12 = 0x0000000000000000   r13 = 0x0000024a54a249a0
[task 2020-11-19T05:19:56.045Z] 05:19:56     INFO -      r14 = 0x0000024a5e22c818   r15 = 0x0000007da207faa0
[task 2020-11-19T05:19:56.046Z] 05:19:56     INFO -      rip = 0xffff9f011198bc90
[task 2020-11-19T05:19:56.046Z] 05:19:56     INFO -      Found by: given as instruction pointer in context
[task 2020-11-19T05:19:56.046Z] 05:19:56     INFO -   1  igc64.dll + 0x1096a54
[task 2020-11-19T05:19:56.047Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f800
[task 2020-11-19T05:19:56.047Z] 05:19:56     INFO -      rip = 0x00007ffd3b316a54
[task 2020-11-19T05:19:56.047Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.048Z] 05:19:56     INFO -   2  igc64.dll + 0x10af065
[task 2020-11-19T05:19:56.048Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f830
[task 2020-11-19T05:19:56.048Z] 05:19:56     INFO -      rip = 0x00007ffd3b32f065
[task 2020-11-19T05:19:56.048Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.049Z] 05:19:56     INFO -   3  ntdll.dll!RtlpAllocateHeapInternal + 0x5e5
[task 2020-11-19T05:19:56.049Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f880
[task 2020-11-19T05:19:56.049Z] 05:19:56     INFO -      rip = 0x00007ffd485f9725
[task 2020-11-19T05:19:56.050Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.050Z] 05:19:56     INFO -   4  0x24a5e22c730
[task 2020-11-19T05:19:56.050Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f960
[task 2020-11-19T05:19:56.050Z] 05:19:56     INFO -      rip = 0x0000024a5e22c730
[task 2020-11-19T05:19:56.051Z] 05:19:56     INFO -      Found by: call frame info
[task 2020-11-19T05:19:56.051Z] 05:19:56     INFO -   5  igd10iumd64.dll + 0x302e0c
[task 2020-11-19T05:19:56.051Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f970
[task 2020-11-19T05:19:56.052Z] 05:19:56     INFO -      rip = 0x00007ffd3d932e0c
[task 2020-11-19T05:19:56.052Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.052Z] 05:19:56     INFO -   6  igc64.dll + 0x10b3887
[task 2020-11-19T05:19:56.053Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f990
[task 2020-11-19T05:19:56.053Z] 05:19:56     INFO -      rip = 0x00007ffd3b333887
[task 2020-11-19T05:19:56.053Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.053Z] 05:19:56     INFO -   7  igd10iumd64.dll + 0x302cad
[task 2020-11-19T05:19:56.054Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f9a0
[task 2020-11-19T05:19:56.054Z] 05:19:56     INFO -      rip = 0x00007ffd3d932cad
[task 2020-11-19T05:19:56.054Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.055Z] 05:19:56     INFO -   8  igd10iumd64.dll + 0xefc73
[task 2020-11-19T05:19:56.055Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207f9f0
[task 2020-11-19T05:19:56.055Z] 05:19:56     INFO -      rip = 0x00007ffd3d71fc73
[task 2020-11-19T05:19:56.055Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.056Z] 05:19:56     INFO -   9  igd10iumd64.dll + 0x3015a0
[task 2020-11-19T05:19:56.056Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207fa18
[task 2020-11-19T05:19:56.056Z] 05:19:56     INFO -      rip = 0x00007ffd3d9315a0
[task 2020-11-19T05:19:56.056Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.057Z] 05:19:56     INFO -  10  firefox.exe!sandbox::TargetNtSetInformationThread64(void*, _NT_THREAD_INFORMATION_CLASS, void*, unsigned long) [interceptors_64.cc:9d797387f57c6f7256d94f2d9c4a4b3576de3745 : 61 + 0xd]
[task 2020-11-19T05:19:56.057Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207fa60
[task 2020-11-19T05:19:56.057Z] 05:19:56     INFO -      rip = 0x00007ff7358b3e01
[task 2020-11-19T05:19:56.058Z] 05:19:56     INFO -      Found by: stack scanning
[task 2020-11-19T05:19:56.058Z] 05:19:56     INFO -  11  KERNELBASE.dll!RtlpHpLfhContextAllocate + 0x1
[task 2020-11-19T05:19:56.058Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207fa90
[task 2020-11-19T05:19:56.058Z] 05:19:56     INFO -      rip = 0x00007ffd4520f2d1
[task 2020-11-19T05:19:56.059Z] 05:19:56     INFO -      Found by: call frame info
[task 2020-11-19T05:19:56.059Z] 05:19:56     INFO -  12  0x24a5e3b37b0
[task 2020-11-19T05:19:56.059Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207fac0
[task 2020-11-19T05:19:56.060Z] 05:19:56     INFO -      rip = 0x0000024a5e3b37b0
[task 2020-11-19T05:19:56.060Z] 05:19:56     INFO -      Found by: call frame info
[task 2020-11-19T05:19:56.060Z] 05:19:56     INFO -  13  firefox.exe!sandbox::TargetNtSetInformationThread64(void*, _NT_THREAD_INFORMATION_CLASS, void*, unsigned long) [interceptors_64.cc:9d797387f57c6f7256d94f2d9c4a4b3576de3745 : 61 + 0xd]
[task 2020-11-19T05:19:56.060Z] 05:19:56     INFO -      rbp = 0x0000007da207faf0   rsp = 0x0000007da207faf0
[task 2020-11-19T05:19:56.061Z] 05:19:56     INFO -      rip = 0x00007ff7358b3e01
[task 2020-11-19T05:19:56.061Z] 05:19:56     INFO -      Found by: stack scanning```
Component: Raptor → Security: Process Sandboxing
Product: Testing → Core
Assignee: nobody → bobowencode
Priority: -- → P2

I would suggest that we hold off on looking at this until more hits come in. My initial suspicion is that this was just some random one-off badness on the machine.

Summary: Intermittent runner.py | application crashed [@ 0xffff9f011198bc90] | [@ NS_DebugBreak(unsigned int, char const*, char const*, char const*, int)] → Intermittent runner.py | application crashed [@ 0xffff9f011198bc90] | [@ NS_DebugBreak]
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.