Closed Bug 1478854 Opened 6 years ago Closed 6 years ago

Permafailing tier2 tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16125. (code 3, args "") [0.5 s]

Categories

(Core :: JavaScript Engine, defect, P5)

defect

Tracking

()

RESOLVED FIXED
mozilla63
Tracking Status
firefox63 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: arai)

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=190403583&repo=mozilla-central

https://queue.taskcluster.net/v1/task/cSWdIEsNRfOHxUHipBIthA/runs/0/artifacts/public/logs/live_backing.log

[task 2018-07-26T23:07:24.077Z] 23:07:24     INFO -  {"action": "test_start", "jitflags": "--baseline-eager", "pid": 16111, "source": "jittests", "test": "debug/Debugger-findScripts-24.js", "thread": "main", "time": 1532646443.6417542}
[task 2018-07-26T23:07:24.077Z] 23:07:24     INFO -  {"action": "test_end", "extra": {"jitflags": "--baseline-eager", "pid": 16111}, "jitflags": "--baseline-eager", "message": "Success", "pid": 16111, "source": "jittests", "status": "PASS", "test": "debug/Debugger-findScripts-24.js", "thread": "main", "time": 1532646444.071963}
[task 2018-07-26T23:07:24.574Z] 23:07:24     INFO -  [CodeCoverage] Setting handlers for process 16123.
[task 2018-07-26T23:07:24.574Z] 23:07:24     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-26T23:07:24.574Z] 23:07:24     INFO -  Stack:
[task 2018-07-26T23:07:24.574Z] 23:07:24     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-26T23:07:24.574Z] 23:07:24     INFO -  Exit code: 3
[task 2018-07-26T23:07:24.574Z] 23:07:24     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-26T23:07:24.574Z] 23:07:24  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16123. (code 3, args "") [0.5 s]
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  {"action": "test_start", "jitflags": "", "pid": 16123, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.037419}
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  {"action": "test_end", "extra": {"jitflags": "", "pid": 16123}, "jitflags": "", "message": "[CodeCoverage] Setting handlers for process 16123.", "pid": 16123, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.56799}
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  INFO exit-status     : 3
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  INFO timed-out       : False
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16123.
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  INFO stderr         2> Stack:
[task 2018-07-26T23:07:24.575Z] 23:07:24     INFO -  INFO stderr         2> @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  [CodeCoverage] Setting handlers for process 16137.
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  Stack:
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  Exit code: 3
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-26T23:07:24.634Z] 23:07:24  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16137. (code 3, args "--baseline-eager") [0.6 s]
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  {"action": "test_start", "jitflags": "--baseline-eager", "pid": 16137, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.073974}
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  {"action": "test_end", "extra": {"jitflags": "--baseline-eager", "pid": 16137}, "jitflags": "--baseline-eager", "message": "[CodeCoverage] Setting handlers for process 16137.", "pid": 16137, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.627961}
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  INFO exit-status     : 3
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  INFO timed-out       : False
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16137.
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-26T23:07:24.634Z] 23:07:24     INFO -  INFO stderr         2> Stack:
[task 2018-07-26T23:07:24.635Z] 23:07:24     INFO -  INFO stderr         2> @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-26T23:07:24.806Z] 23:07:24     INFO -  [CodeCoverage] Setting handlers for process 16124.
[task 2018-07-26T23:07:24.806Z] 23:07:24     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-26T23:07:24.806Z] 23:07:24     INFO -  Stack:
[task 2018-07-26T23:07:24.806Z] 23:07:24     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-26T23:07:24.808Z] 23:07:24     INFO -  Exit code: 3
[task 2018-07-26T23:07:24.808Z] 23:07:24     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-26T23:07:24.810Z] 23:07:24  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16124. (code 3, args "--ion-eager --ion-offthread-compile=off") [0.8 s]
[task 2018-07-26T23:07:24.810Z] 23:07:24     INFO -  {"action": "test_start", "jitflags": "--ion-eager --ion-offthread-compile=off", "pid": 16124, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.054314}
[task 2018-07-26T23:07:24.813Z] 23:07:24     INFO -  {"action": "test_end", "extra": {"jitflags": "--ion-eager --ion-offthread-compile=off", "pid": 16124}, "jitflags": "--ion-eager --ion-offthread-compile=off", "message": "[CodeCoverage] Setting handlers for process 16124.", "pid": 16124, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.80821}
[task 2018-07-26T23:07:24.813Z] 23:07:24     INFO -  INFO exit-status     : 3
[task 2018-07-26T23:07:24.813Z] 23:07:24     INFO -  INFO timed-out       : False
[task 2018-07-26T23:07:24.813Z] 23:07:24     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16124.
[task 2018-07-26T23:07:24.813Z] 23:07:24     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-26T23:07:24.813Z] 23:07:24     INFO -  INFO stderr         2> Stack:
[task 2018-07-26T23:07:24.813Z] 23:07:24     INFO -  INFO stderr         2> @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-26T23:07:24.845Z] 23:07:24     INFO -  [CodeCoverage] Setting handlers for process 16127.
[task 2018-07-26T23:07:24.845Z] 23:07:24     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-26T23:07:24.845Z] 23:07:24     INFO -  Stack:
[task 2018-07-26T23:07:24.845Z] 23:07:24     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-26T23:07:24.845Z] 23:07:24     INFO -  Exit code: 3
[task 2018-07-26T23:07:24.845Z] 23:07:24     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-26T23:07:24.849Z] 23:07:24  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16127. (code 3, args "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads") [0.8 s]
[task 2018-07-26T23:07:24.849Z] 23:07:24     INFO -  {"action": "test_start", "jitflags": "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads", "pid": 16127, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.059742}
[task 2018-07-26T23:07:24.849Z] 23:07:24     INFO -  {"action": "test_end", "extra": {"jitflags": "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads", "pid": 16127}, "jitflags": "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads", "message": "[CodeCoverage] Setting handlers for process 16127.", "pid": 16127, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532646444.84078}
[task 2018-07-26T23:07:24.849Z] 23:07:24     INFO -  INFO exit-status     : 3
[task 2018-07-26T23:07:24.850Z] 23:07:24     INFO -  INFO timed-out       : False
Flags: needinfo?(arai.unmht)
Over the last 7 days there are 42 failures on this bug. These happen on windows10-64-ccov, linux64-ccov.

Here is the latest log example: https://treeherder.mozilla.org/logviewer.html#?job_id=190771949&repo=mozilla-central&lineNumber=10024

[task 2018-07-29T11:04:30.491Z] 11:04:30     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.491Z] 11:04:30     INFO -  Stack:
[task 2018-07-29T11:04:30.491Z] 11:04:30     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:30.491Z] 11:04:30     INFO -  Exit code: 3
[task 2018-07-29T11:04:30.491Z] 11:04:30     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-29T11:04:30.491Z] 11:04:30  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16125. (code 3, args "") [0.5 s]
[task 2018-07-29T11:04:30.491Z] 11:04:30     INFO -  {"action": "test_start", "jitflags": "", "pid": 16125, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862269.978137}
[task 2018-07-29T11:04:30.491Z] 11:04:30     INFO -  {"action": "test_end", "extra": {"jitflags": "", "pid": 16125}, "jitflags": "", "message": "[CodeCoverage] Setting handlers for process 16125.", "pid": 16125, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.484354}
[task 2018-07-29T11:04:30.492Z] 11:04:30     INFO -  INFO exit-status     : 3
[task 2018-07-29T11:04:30.492Z] 11:04:30     INFO -  INFO timed-out       : False
[task 2018-07-29T11:04:30.492Z] 11:04:30     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16125.
[task 2018-07-29T11:04:30.492Z] 11:04:30     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.492Z] 11:04:30     INFO -  INFO stderr         2> Stack:
[task 2018-07-29T11:04:30.492Z] 11:04:30     INFO -  INFO stderr         2> @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:30.672Z] 11:04:30     INFO -  [CodeCoverage] Setting handlers for process 16139.
[task 2018-07-29T11:04:30.672Z] 11:04:30     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.673Z] 11:04:30     INFO -  Stack:
[task 2018-07-29T11:04:30.673Z] 11:04:30     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:30.673Z] 11:04:30     INFO -  Exit code: 3
[task 2018-07-29T11:04:30.673Z] 11:04:30     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-29T11:04:30.674Z] 11:04:30  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16139. (code 3, args "--baseline-eager") [0.5 s]
[task 2018-07-29T11:04:30.674Z] 11:04:30     INFO -  {"action": "test_start", "jitflags": "--baseline-eager", "pid": 16139, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.12245}
[task 2018-07-29T11:04:30.674Z] 11:04:30     INFO -  {"action": "test_end", "extra": {"jitflags": "--baseline-eager", "pid": 16139}, "jitflags": "--baseline-eager", "message": "[CodeCoverage] Setting handlers for process 16139.", "pid": 16139, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.66435}
[task 2018-07-29T11:04:30.675Z] 11:04:30     INFO -  INFO exit-status     : 3
[task 2018-07-29T11:04:30.675Z] 11:04:30     INFO -  INFO timed-out       : False
[task 2018-07-29T11:04:30.675Z] 11:04:30     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16139.
[task 2018-07-29T11:04:30.675Z] 11:04:30     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.675Z] 11:04:30     INFO -  INFO stderr         2> Stack:
[task 2018-07-29T11:04:30.675Z] 11:04:30     INFO -  INFO stderr         2> @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:30.756Z] 11:04:30     INFO -  [CodeCoverage] Setting handlers for process 16131.
[task 2018-07-29T11:04:30.757Z] 11:04:30     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.757Z] 11:04:30     INFO -  Stack:
[task 2018-07-29T11:04:30.757Z] 11:04:30     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:30.758Z] 11:04:30     INFO -  Exit code: 3
[task 2018-07-29T11:04:30.758Z] 11:04:30     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-29T11:04:30.759Z] 11:04:30  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16131. (code 3, args "--ion-eager --ion-offthread-compile=off") [0.8 s]
[task 2018-07-29T11:04:30.761Z] 11:04:30     INFO -  {"action": "test_start", "jitflags": "--ion-eager --ion-offthread-compile=off", "pid": 16131, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862269.9966729}
[task 2018-07-29T11:04:30.762Z] 11:04:30     INFO -  {"action": "test_end", "extra": {"jitflags": "--ion-eager --ion-offthread-compile=off", "pid": 16131}, "jitflags": "--ion-eager --ion-offthread-compile=off", "message": "[CodeCoverage] Setting handlers for process 16131.", "pid": 16131, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.753871}
[task 2018-07-29T11:04:30.762Z] 11:04:30     INFO -  INFO exit-status     : 3
[task 2018-07-29T11:04:30.763Z] 11:04:30     INFO -  INFO timed-out       : False
[task 2018-07-29T11:04:30.763Z] 11:04:30     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16131.
[task 2018-07-29T11:04:30.764Z] 11:04:30     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.764Z] 11:04:30     INFO -  INFO stderr         2> Stack:
[task 2018-07-29T11:04:30.765Z] 11:04:30     INFO -  INFO stderr         2> @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:30.827Z] 11:04:30     INFO -  [CodeCoverage] Setting handlers for process 16137.
[task 2018-07-29T11:04:30.827Z] 11:04:30     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.827Z] 11:04:30     INFO -  Stack:
[task 2018-07-29T11:04:30.827Z] 11:04:30     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:30.828Z] 11:04:30     INFO -  Exit code: 3
[task 2018-07-29T11:04:30.828Z] 11:04:30     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-29T11:04:30.828Z] 11:04:30  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16137. (code 3, args "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads") [0.8 s]
[task 2018-07-29T11:04:30.828Z] 11:04:30     INFO -  {"action": "test_start", "jitflags": "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads", "pid": 16137, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.0429769}
[task 2018-07-29T11:04:30.828Z] 11:04:30     INFO -  {"action": "test_end", "extra": {"jitflags": "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads", "pid": 16137}, "jitflags": "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads", "message": "[CodeCoverage] Setting handlers for process 16137.", "pid": 16137, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.820397}
[task 2018-07-29T11:04:30.828Z] 11:04:30     INFO -  INFO exit-status     : 3
[task 2018-07-29T11:04:30.829Z] 11:04:30     INFO -  INFO timed-out       : False
[task 2018-07-29T11:04:30.829Z] 11:04:30     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16137.
[task 2018-07-29T11:04:30.829Z] 11:04:30     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:30.829Z] 11:04:30     INFO -  INFO stderr         2> Stack:
[task 2018-07-29T11:04:30.829Z] 11:04:30     INFO -  INFO stderr         2> @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:31.000Z] 11:04:30     INFO -  [CodeCoverage] Setting handlers for process 16145.
[task 2018-07-29T11:04:31.001Z] 11:04:30     INFO -  /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:31.001Z] 11:04:30     INFO -  Stack:
[task 2018-07-29T11:04:31.002Z] 11:04:30     INFO -    @/builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5
[task 2018-07-29T11:04:31.002Z] 11:04:30     INFO -  Exit code: 3
[task 2018-07-29T11:04:31.002Z] 11:04:30     INFO -  FAIL - debug/Debugger-findScripts-uncompleted-01.js
[task 2018-07-29T11:04:31.002Z] 11:04:30  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js | [CodeCoverage] Setting handlers for process 16145. (code 3, args "--no-baseline --no-ion") [0.5 s]
[task 2018-07-29T11:04:31.002Z] 11:04:30     INFO -  {"action": "test_start", "jitflags": "--no-baseline --no-ion", "pid": 16145, "source": "jittests", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.486958}
[task 2018-07-29T11:04:31.003Z] 11:04:30     INFO -  {"action": "test_end", "extra": {"jitflags": "--no-baseline --no-ion", "pid": 16145}, "jitflags": "--no-baseline --no-ion", "message": "[CodeCoverage] Setting handlers for process 16145.", "pid": 16145, "source": "jittests", "status": "FAIL", "test": "debug/Debugger-findScripts-uncompleted-01.js", "thread": "main", "time": 1532862270.993083}
[task 2018-07-29T11:04:31.003Z] 11:04:30     INFO -  INFO exit-status     : 3
[task 2018-07-29T11:04:31.003Z] 11:04:30     INFO -  INFO timed-out       : False
[task 2018-07-29T11:04:31.003Z] 11:04:30     INFO -  INFO stderr         2> [CodeCoverage] Setting handlers for process 16145.
[task 2018-07-29T11:04:31.003Z] 11:04:30     INFO -  INFO stderr         2> /builds/worker/workspace/build/tests/jit-test/jit-test/tests/debug/Debugger-findScripts-uncompleted-01.js:47:5 Error: Assertion failed: got false, expected true: Scripts inside uncompiled script shouldn't be found
[task 2018-07-29T11:04:31.003Z] 11:04:31     INFO -  INFO stderr         2> Stack:
Flags: needinfo?(sdetar)
we have to disable the test, given that the assumption about when script is parsed lazily doesn't hold on ccov.
Assignee: nobody → arai.unmht
Status: NEW → ASSIGNED
Flags: needinfo?(arai.unmht)
Flags: needinfo?(sdetar)
Disabled tests which needs lazy parsing.
Attachment #8996170 - Flags: review?(nicolas.b.pierron)
(In reply to Tooru Fujisawa [:arai] from comment #4)
> Disabled tests which needs lazy parsing.

Looking at the tests, I fail to see what this is related to the expectation of script being lazy parsed.
Can you explain that to me?
(In reply to Nicolas B. Pierron [:nbp] {backlog: 39} from comment #5)
> (In reply to Tooru Fujisawa [:arai] from comment #4)
> > Disabled tests which needs lazy parsing.
> 
> Looking at the tests, I fail to see what this is related to the expectation
> of script being lazy parsed.
> Can you explain that to me?

these tests verify that Debugger doesn't report scripts (LazyScript) which won't be exposed to user, that is,
scripts created while compiling script and then bytecode emitter throws before finishing compilation.
those scripts are basically just waiting for GC, but Debugger can hit them because it iterates over arenas.

then, currently LazyScripts subtree is supported properly, but JSScripts tree is not yet (bug 1478532),
so, if lazy parsing is disabled, those tests fail.
Attachment #8996170 - Flags: review?(nicolas.b.pierron) → review+
https://hg.mozilla.org/integration/mozilla-inbound/rev/c05259217944d727639448c3d475f5254812d908
Bug 1478854 - Disable tests for uncomplete JSScript and inner LazyScript in ccov. r=nbp
https://hg.mozilla.org/mozilla-central/rev/c05259217944
Status: ASSIGNED → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla63
We are trying to build a tool to automatically classify intermittent failures, which would provide a starting point for fixing the bug, reducing the manual work for the developers.
We are collecting some feedback on the results, to see if they’re good enough and where we need to improve.
    
For this bug, the tool says that the intermittent failure is most likely a:
Concurrency Issue: This includes tests in which failures occur due to thread management issues (different threads or their outcomes depending on an implicit ordering), race conditions and/or deadlocks, and issues related to an asynchronous waits (e.g. a process trying to access an external resource or continuing before the external resource is available).


Once you’re done investigating and/or fixing the bug, could you tell me:
- Did the tool correctly recognize the type of intermittent failure?
- Did the information from the tool help your analysis, the bug fixing process, or anything in the process? (please also let us know how the tool was useful and/or what would improve the tool's usefulness for you)
Flags: needinfo?(arai.unmht)
(In reply to meck93 from comment #9)
> Once you’re done investigating and/or fixing the bug, could you tell me:
> - Did the tool correctly recognize the type of intermittent failure?

At least it's not saying anything meaningful for this case.


> - Did the information from the tool help your analysis, the bug fixing
> process, or anything in the process? (please also let us know how the tool
> was useful and/or what would improve the tool's usefulness for you)

No.
Without the reasoning (input data set, classification algorithm, and how it results in the output for this specific case) behind the result, and also the other classes,
this output itself alone is not persuasive and it's something more like a spam.

also, without them, I cannot tell how it can be improved.

So, please provide them.
Flags: needinfo?(arai.unmht)
@[:arai]: Thanks for the feedback! 

Short General Tool Information: 
1. We've built a training data set by classifying intermittent-failures by the Mozilla developers which had fixed the failure. 
2. We are using a 2-stage classifier: 
   1. stage: input is a bag-of-words model from all the log file and source code data associated with the failure 
   => output: failure type/class probabilities
   2. stage input: category probabilities (from stage 1) + manual features created from the log file (e.g. certain keywords, 
   timeout time, test suite run time, etc.) 
3. The most likely category is predicted for the 'not-fixed' intermittent-failure trying to provide a starting point for fixing the failure. 

> At least it's not saying anything meaningful for this case.

I guess this would mean that the classifier needs to be more precise i.e. give more detailed information about why the concurrency issue was predicted, correct? 

> Without the reasoning (input data set, classification algorithm, and how it results in the output for this specific case) behind > the result, and also the other classes, this output itself alone is not persuasive and it's something more like a spam.

The question was meant more general e.g. the tool posts the most likely failure category for the bug as a comment and the question was more directed towards - what else (e.g. failure file, failure lines, etc.) would the tool need to provide in the comment in order for it to be useful?
Flags: needinfo?(arai.unmht)
(In reply to meck93 from comment #11)
> > At least it's not saying anything meaningful for this case.
> 
> I guess this would mean that the classifier needs to be more precise i.e.
> give more detailed information about why the concurrency issue was
> predicted, correct? 

This is permafailure because of the different behavior from build configuration, and not something related to intermittent or concurrency issue.

Also, yes, the "why" part is important.
Only when the "why" part sounds reasonable, it makes sense to take the automatic classification into account.
Otherwise, IMO it's not a good idea to reduce the probability from the beginning.


> > Without the reasoning (input data set, classification algorithm, and how it results in the output for this specific case) behind > the result, and also the other classes, this output itself alone is not persuasive and it's something more like a spam.
> 
> The question was meant more general e.g. the tool posts the most likely
> failure category for the bug as a comment and the question was more directed
> towards - what else (e.g. failure file, failure lines, etc.) would the tool
> need to provide in the comment in order for it to be useful?

then, I think it's better setting up some dedicated forum thread or something,
so everyone's feedback is visible at once there.
also, this is not a discussion about the bug itself, but your tool,
so it's not a good idea to send these messages to all CCed people.

anyway, I think the following would be make this more useful:
  * how likely the class is, and why
    * which specific feature (word, etc) from where (a line in log or code) lead to the conclusion
  * how not-likely other classes are, and why
  * similar (near?) bugs in the same class (bug numbers, summary, commit message, filed/fixed date, etc)
Flags: needinfo?(arai.unmht)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: