Closed
Bug 1459784
Opened 7 years ago
Closed 7 years ago
intermittent test-verify TinderboxPrint: Per-test run of .../unit/test_TelemetryHistograms.js<br/>: FAILURE
Categories
(Toolkit :: Telemetry, defect)
Toolkit
Telemetry
Tracking
()
RESOLVED
DUPLICATE
of bug 1460666
People
(Reporter: tiberius_oros, Unassigned)
Details
[task 2018-05-07T19:30:11.455Z] 19:30:11 INFO - ::: Test verification summary for: /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/telemetry/tests/unit/test_TelemetryHistograms.js
[task 2018-05-07T19:30:11.455Z] 19:30:11 INFO - :::
[task 2018-05-07T19:30:11.456Z] 19:30:11 INFO - ::: 1. Run each test 10 times, sequentially. : Pass
[task 2018-05-07T19:30:11.457Z] 19:30:11 INFO - ::: 2. Run each test 10 times, sequentially, in chaos mode. : Pass
[task 2018-05-07T19:30:11.457Z] 19:30:11 INFO - :::
[task 2018-05-07T19:30:11.458Z] 19:30:11 INFO - ::: Test verification PASSED
[task 2018-05-07T19:30:11.458Z] 19:30:11 INFO - :::
[task 2018-05-07T19:30:11.474Z] 19:30:11 INFO - Return code: 0
[task 2018-05-07T19:30:11.474Z] 19:30:11 INFO - TinderboxPrint: xpcshell<br/>20/0/0
[task 2018-05-07T19:30:11.474Z] 19:30:11 INFO - ##### xpcshell log ends
[task 2018-05-07T19:30:11.475Z] 19:30:11 INFO - # TBPL FAILURE #
[task 2018-05-07T19:30:11.475Z] 19:30:11 INFO - TinderboxPrint: Per-test run of .../unit/test_TelemetryHistograms.js<br/>: FAILURE
[task 2018-05-07T19:30:11.475Z] 19:30:11 INFO - Running post-action listener: _package_coverage_data
[task 2018-05-07T19:30:11.475Z] 19:30:11 INFO - Running post-action listener: _resource_record_post_action
[task 2018-05-07T19:30:11.475Z] 19:30:11 INFO - Running post-action listener: stop_emulator
[task 2018-05-07T19:30:11.485Z] 19:30:11 INFO - Let's kill every process called emulator64-arm
[task 2018-05-07T19:30:11.485Z] 19:30:11 INFO - Killing pid 904.
[task 2018-05-07T19:30:11.485Z] 19:30:11 INFO - [mozharness: 2018-05-07 19:30:11.485666Z] Finished run-tests step (success)
[task 2018-05-07T19:30:11.486Z] 19:30:11 INFO - Running post-run listener: _resource_record_post_run
[task 2018-05-07T19:30:11.602Z] 19:30:11 INFO - Total resource usage - Wall time: 1742s; CPU: 25.0%; Read bytes: 287379456; Write bytes: 4269367296; Read time: 19644; Write time: 806388
[task 2018-05-07T19:30:11.603Z] 19:30:11 INFO - TinderboxPrint: CPU usage<br/>24.7%
[task 2018-05-07T19:30:11.603Z] 19:30:11 INFO - TinderboxPrint: I/O read bytes / time<br/>287,379,456 / 19,644
[task 2018-05-07T19:30:11.603Z] 19:30:11 INFO - TinderboxPrint: I/O write bytes / time<br/>4,269,367,296 / 806,388
[task 2018-05-07T19:30:11.604Z] 19:30:11 INFO - TinderboxPrint: CPU idle<br/>5,164.4 (74.9%)
[task 2018-05-07T19:30:11.604Z] 19:30:11 INFO - TinderboxPrint: CPU user<br/>1,674.0 (24.3%)
[task 2018-05-07T19:30:11.604Z] 19:30:11 INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2018-05-07T19:30:11.609Z] 19:30:11 INFO - verify-emulator - Wall time: 345s; CPU: 28.0%; Read bytes: 5451776; Write bytes: 1234784256; Read time: 80; Write time: 304880
[task 2018-05-07T19:30:11.611Z] 19:30:11 INFO - install - Wall time: 51s; CPU: 36.0%; Read bytes: 0; Write bytes: 199348224; Read time: 0; Write time: 20880
[task 2018-05-07T19:30:11.625Z] 19:30:11 INFO - run-tests - Wall time: 1347s; CPU: 24.0%; Read bytes: 281526272; Write bytes: 2835234816; Read time: 19548; Write time: 480628
[task 2018-05-07T19:30:12.120Z] 19:30:12 INFO - Running post-run listener: copy_logs_to_upload_dir
[task 2018-05-07T19:30:12.120Z] 19:30:12 INFO - Copying logs to upload dir...
[task 2018-05-07T19:30:12.120Z] 19:30:12 INFO - mkdir: /builds/worker/workspace/build/upload/logs
[task 2018-05-07T19:30:12.122Z] 19:30:12 INFO - Copying logs to upload dir...
[task 2018-05-07T19:30:12.124Z] 19:30:12 WARNING - returning nonzero exit status 2
[task 2018-05-07T19:30:12.143Z] /builds/worker/bin/test-linux.sh: line 190: 80 Killed compiz 2>&1
[task 2018-05-07T19:30:12.143Z] cleanup
[task 2018-05-07T19:30:12.143Z] + cleanup
[task 2018-05-07T19:30:12.143Z] + local rv=2
[task 2018-05-07T19:30:12.143Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2018-05-07T19:30:12.143Z] + cp /builds/worker/.xsession-errors /builds/worker/artifacts/public/xsession-errors.log
[task 2018-05-07T19:30:12.147Z] + true
[task 2018-05-07T19:30:12.147Z] + cleanup_xvfb
[task 2018-05-07T19:30:12.147Z] pidof Xvfb
[task 2018-05-07T19:30:12.147Z] ++ pidof Xvfb
[task 2018-05-07T19:30:12.151Z] + local xvfb_pid=26
[task 2018-05-07T19:30:12.151Z] + local vnc=false
[task 2018-05-07T19:30:12.151Z] + local interactive=false
[task 2018-05-07T19:30:12.151Z] + '[' -n 26 ']'
[task 2018-05-07T19:30:12.151Z] + [[ false == false ]]
[task 2018-05-07T19:30:12.151Z] + [[ false == false ]]
[task 2018-05-07T19:30:12.151Z] + kill 26
[task 2018-05-07T19:30:12.151Z] + screen -XS xvfb quit
[task 2018-05-07T19:30:12.350Z] No screen session found.
[task 2018-05-07T19:30:12.351Z] + true
[task 2018-05-07T19:30:12.351Z] + exit 2
[taskcluster 2018-05-07 19:30:12.774Z] === Task Finished ===
[taskcluster 2018-05-07 19:30:22.543Z] Unsuccessful task run with exit code: 2 completed in 2177.911 seconds
Comment 1•7 years ago
|
||
This is my first experience with tinderbox. Could you provide some information about what actions we can take to examine this failure?
Flags: needinfo?(toros)
Reporter | ||
Comment 2•7 years ago
|
||
:gfritzsche could you please help :chutten with some info? Thank you!
Flags: needinfo?(toros) → needinfo?(gfritzsche)
Comment 3•7 years ago
|
||
I'm not sure if i can add much here.
Do you have any links you can add to specific tasks that failed and their logs?
Flags: needinfo?(gfritzsche) → needinfo?(toros)
Comment hidden (Intermittent Failures Robot) |
Reporter | ||
Comment 5•7 years ago
|
||
Here is a link to the one of the jobs that failed:
https://treeherder.mozilla.org/#/jobs?repo=autoland&tochange=e0dc79c04031b1f01c6ff849d372311107b6e758&fromchange=711118ca7f15ba2f9a3b0e00d60dd5533d1958a2&selectedJob=177305974
and a link to the log file:
https://treeherder.mozilla.org/logviewer.html#?job_id=177305974&repo=autoland
:gfritzsche, hope this helps.
Flags: needinfo?(toros)
Comment 6•7 years ago
|
||
Can you help me understand the log? Towards the bottom I see it running test_TelemetryHistogram.js 20 times without failure, then it says "Test verification PASSED"... but then there's a TBPL Failure without any interleaving logs.
What does this mean? Does it mean one of the 20 test runs was actually a failure? I feel I'm lacking some basic context to understand what tinderbox is and how our tests might be failing it. The documentation I can find seems out-of-date (https://wiki.mozilla.org/Tinderbox says tinderbox was replaced, for instance).
Flags: needinfo?(toros)
Comment 7•7 years ago
|
||
(In reply to Chris H-C :chutten from comment #6)
> Can you help me understand the log? Towards the bottom I see it running
> test_TelemetryHistogram.js 20 times without failure, then it says "Test
> verification PASSED"... but then there's a TBPL Failure without any
> interleaving logs.
>
> What does this mean? Does it mean one of the 20 test runs was actually a
> failure? I feel I'm lacking some basic context to understand what tinderbox
> is and how our tests might be failing it. The documentation I can find seems
> out-of-date (https://wiki.mozilla.org/Tinderbox says tinderbox was replaced,
> for instance).
In the log i see that the test suite ran 6 times, each test running 10 times. I don't think this means that at some point the test failed, being that each test suite has:
[task 2018-05-07T19:30:11.458Z] 19:30:11 INFO - ::: Test verification PASSED
[task 2018-05-07T19:30:11.458Z] 19:30:11 INFO - :::
[task 2018-05-07T19:30:11.474Z] 19:30:11 INFO - Return code: 0
ni? Aryx as he most likely can shed light on this.
Thank you.
Flags: needinfo?(toros) → needinfo?(aryx.bugmail)
![]() |
||
Updated•7 years ago
|
Status: NEW → RESOLVED
Closed: 7 years ago
Flags: needinfo?(aryx.bugmail)
Resolution: --- → DUPLICATE
![]() |
||
Comment 9•7 years ago
|
||
(In reply to Chris H-C :chutten from comment #6)
> Can you help me understand the log? Towards the bottom I see it running
> test_TelemetryHistogram.js 20 times without failure, then it says "Test
> verification PASSED"... but then there's a TBPL Failure without any
> interleaving logs.
Redirecting to Geoff.
> The documentation I can find seems
> out-of-date (https://wiki.mozilla.org/Tinderbox says tinderbox was replaced,
> for instance).
"TBPL" and "Tinderbox" are just markers for failures/log parsing which remained unchanged.
Flags: needinfo?(gbrown)
![]() |
||
Comment 10•7 years ago
|
||
test-verify was broken for a while, producing these odd failures; I think this was fixed in bug 1460666.
Flags: needinfo?(gbrown)
You need to log in
before you can comment on or make changes to this bug.
Description
•