1352647 - Intermittent TEST-UNEXPECTED-PASS | toolkit/crashreporter/test/unit/test_crash_rust_panic.js | xpcshell return code: 0

Status: RESOLVED FIXED

(Toolkit :: General, defect)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=88026621&repo=mozilla-central

https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-central-win64-pgo/1491013893/mozilla-central_win8_64_test_pgo-xpcshell-bm119-tests1-windows-build4.txt.gz

Comment 1

[Intermittent Failures Robot]

12 failures in 845 pushes (0.014 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 5
* autoland: 4
* mozilla-central: 3

Platform breakdown:
* windows8-64: 12

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1352647&startday=2017-03-27&endday=2017-04-02&tree=all

Comment 2

[Geoff Brown [:gbrown]]

:ted - Are you aware of this? Can you have a look?

Comment 3

[(not currently active) Ted Mielczarek]

Well that's interesting! I expect the test to fail on Win64 because of bug 1302078, but apparently it sometimes passes?

21:28:49     INFO -  TEST-START | toolkit/crashreporter/test/unit/test_crash_rust_panic.js
21:28:49  WARNING -  TEST-UNEXPECTED-PASS | toolkit/crashreporter/test/unit/test_crash_rust_panic.js | xpcshell return code: 0
21:28:49     INFO -  TEST-INFO expected FAIL | took 259ms
21:28:49     INFO -  >>>>>>>
21:28:49     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
21:28:49     INFO -  TEST-PASS | toolkit/crashreporter/test/unit/test_crash_rust_panic.js | handleMinidump - [handleMinidump : 130] true == true
21:28:49     INFO -  TEST-PASS | toolkit/crashreporter/test/unit/test_crash_rust_panic.js | run_test/< - [run_test/< : 7] "OH NO" == "OH NO"
21:28:49     INFO -  (xpcshell/head.js) | test MAIN run_test finished (1)
21:28:49     INFO -  exiting test
21:28:49     INFO -  <<<<<<<

Doubly interesting--looking at the OrangeFactor report all of the unexpected passes are on PGO builds. Weird! I'm just going to change this from `fail-if` to `skip-if` to skip the test entirely on Win64 until bug 1302078 gets fixed.

Comment 4

[(not currently active) Ted Mielczarek]

https://hg.mozilla.org/integration/mozilla-inbound/rev/037f23e2cb4ad44710dcb4d8621b2d138f0defa0
bug 1352647 - skip test_crash_rust_panic on Win64 as it sometimes unexpectedly passes. r=me

Comment 5

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/037f23e2cb4a

Comment 6

[Intermittent Failures Robot]

28 failures in 867 pushes (0.032 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-central: 12
* autoland: 11
* mozilla-inbound: 3
* oak: 2

Platform breakdown:
* windows8-64: 28

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1352647&startday=2017-04-03&endday=2017-04-09&tree=all