1065539 - Intermittent test_aboutmemory6.xul | Test timed out | test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run | This test left crash dumps behind, but we weren't expecting it to!

Status: RESOLVED INCOMPLETE

(Toolkit :: about:memory, defect, P3)

Description

[Ryan VanderMeulen [:RyanVM]]

https://tbpl.mozilla.org/php/getParsedLog.php?id=47744909&tree=Mozilla-Inbound

Ubuntu VM 12.04 x64 mozilla-inbound opt test mochitest-other on 2014-09-09 19:37:58 PDT for push bf3cb1e5ea63
slave: tst-linux64-spot-873

19:58:13     INFO -  1512 INFO must wait for load
19:58:13     INFO -  1513 INFO TEST-PASS | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | two log entries generated
19:58:13     INFO -  1514 INFO TEST-PASS | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | GC log file exists
19:58:13     INFO -  1515 INFO TEST-PASS | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | CC log file exists
19:58:13     INFO -  1516 INFO TEST-PASS | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | two log entries generated
19:58:13     INFO -  1517 INFO TEST-PASS | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | GC log file exists
19:58:13     INFO -  1518 INFO TEST-PASS | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | CC log file exists
19:58:13     INFO -  1519 INFO MEMORY STAT vsize after test: 1579110400
19:58:13     INFO -  1520 INFO MEMORY STAT residentFast after test: 421740544
19:58:13     INFO -  1521 INFO MEMORY STAT heapAllocated after test: 224068624
19:58:13     INFO -  1522 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - expected PASS
19:58:13     INFO -  1523 INFO TEST-OK | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | took 314018ms
19:58:13     INFO -  Not taking screenshot here: see the one that was previously logged
19:58:13     INFO -  1524 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - Result logged after SimpleTest.finish()
19:58:13     INFO -  1525 INFO TEST-START | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul
19:58:13     INFO -  Xlib:  extension "RANDR" missing on display ":0".
19:58:13     INFO -  Xlib:  extension "RANDR" missing on display ":0".
19:58:13     INFO -  Xlib:  extension "RANDR" missing on display ":0".
19:58:13     INFO -  1526 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) - expected PASS
19:58:13     INFO -  1527 INFO TEST-OK | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | took 1990ms
19:58:15     INFO -  1528 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) - Result logged after SimpleTest.finish()

Comment 1

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-11-19T18:06:13
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-aurora&job_id=407611
repository: mozilla-aurora
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-888
buildname: Ubuntu VM 12.04 x64 mozilla-aurora debug test mochitest-other
revision: 776650aa7757

1696 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - expected PASS
1698 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - Result logged after SimpleTest.finish()

Comment 2

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2015-01-03T19:54:11
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-inbound&job_id=5056317
repository: mozilla-inbound
who: philringnalda[at]gmail[dot]com
machine: talos-mtnlion-r5-086
buildname: Rev5 MacOSX Mountain Lion 10.8 mozilla-inbound opt test mochitest-other
revision: 811c950c8df6

1793 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - expected PASS
1795 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - Result logged after SimpleTest.finish()
1797 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) - expected PASS
1829 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | called finish() multiple times
2440 INFO TEST-UNEXPECTED-FAIL | toolkit/mozapps/update/tests/chrome/test_0102_background_restartNotification_staging.xul | Test timed out. Maximum time allowed is 240 seconds - expected PASS
2441 INFO TEST-UNEXPECTED-FAIL | toolkit/mozapps/update/tests/chrome/test_0102_background_restartNotification_staging.xul | Checking if TESTS[0] test was performed... callback function name = defaultCallback, pageid = finishedBackground - expected PASS

Comment 3

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=5665528
repository: mozilla-inbound
start_time: 2015-01-20T11:23:56
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-324
buildname: Ubuntu VM 12.04 x64 mozilla-inbound opt test mochitest-other
revision: 930d666b36fe

1797 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - expected PASS
1799 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - Result logged after SimpleTest.finish()
1801 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) - expected PASS
1806 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) - Result logged after SimpleTest.finish()
1834 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | called finish() multiple times

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2041884
repository: fx-team
start_time: 2015-02-20T00:56:03
who: gijskruitbosch[at]gmail[dot]com
machine: tst-linux64-spot-058
buildname: Ubuntu VM 12.04 x64 fx-team opt test mochitest-other
revision: ee9a8d36a96a

1860 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - expected PASS
1862 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out. - Result logged after SimpleTest.finish()
1864 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) - expected PASS
1869 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) - Result logged after SimpleTest.finish()
1961 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_memoryReporters.xul | called finish() multiple times

Comment 5

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-b2g30_v1_4&job_id=118157
repository: mozilla-b2g30_v1_4
start_time: 2015-03-07T04:58:27
who: philringnalda[at]gmail[dot]com
machine: tst-linux64-spot-1032
buildname: Ubuntu VM 12.04 x64 mozilla-b2g30_v1_4 debug test mochitest-other
revision: 7879a8d3334b

2728 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | Test timed out.
2788 INFO TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_memoryReporters.xul | [SimpleTest.finish()] this test already called finish!
2789 ERROR TEST-UNEXPECTED-FAIL | chrome://mochitests/content/chrome/toolkit/components/aboutmemory/tests/test_memoryReporters.xul | called finish() multiple times

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=5619963
repository: try
start_time: 2015-03-13T00:56:01
who: bowen[at]mozilla[dot]com
machine: t-yosemite-r5-0050
buildname: Rev5 MacOSX Yosemite 10.10 try opt test mochitest-other
revision: 9616679f399a

TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
2287 INFO TEST-UNEXPECTED-FAIL | toolkit/content/tests/chrome/test_tooltip.xul | Test timed out. - expected PASS

Comment 7

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=5608175
repository: try
start_time: 2015-03-12T15:36:11
who: bowen[at]mozilla[dot]com
machine: t-yosemite-r5-0032
buildname: Rev5 MacOSX Yosemite 10.10 try opt test mochitest-other
revision: 9616679f399a

TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
TypeError: this.connection.client.mainRoot is null: exports.AppManager.isMainProcessDebuggable@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/webide/app-manager.js:436:1
2287 INFO TEST-UNEXPECTED-FAIL | toolkit/content/tests/chrome/test_tooltip.xul | Test timed out. - expected PASS

Comment 8

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=6175749
repository: try
start_time: 2015-04-01T17:53:04
who: philip[dot]chee[at]gmail[dot]com
machine: t-xp32-ix-107
buildname: Windows XP 32-bit try debug test mochitest-other
revision: 49a03ed3f724

2076 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2078 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
PROCESS-CRASH | Main app process exited normally | application crashed [@ moz_abort]
Return code: 1
Return code: 1
Return code: 1

Comment 9

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2532640
repository: fx-team
start_time: 2015-04-02T05:39:20
who: rvandermeulen[at]mozilla[dot]com
machine: t-xp32-ix-007
buildname: Windows XP 32-bit fx-team debug test mochitest-other
revision: 626392506fc4

2078 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2080 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
PROCESS-CRASH | Main app process exited normally | application crashed [@ moz_abort]
Return code: 1
Return code: 1
Return code: 1

Comment 10

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2578386
repository: fx-team
start_time: 2015-04-06T13:07:02
who: rvandermeulen[at]mozilla[dot]com
machine: t-xp32-ix-158
buildname: Windows XP 32-bit fx-team debug test mochitest-other
revision: 1cf4808e78d9

2116 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2118 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
PROCESS-CRASH | Main app process exited normally | application crashed [@ moz_abort]
Return code: 1
Return code: 1
Return code: 1

Comment 11

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9940252
repository: mozilla-inbound
start_time: 2015-05-18T10:09:15
who: rvandermeulen[at]mozilla[dot]com
machine: t-xp32-ix-102
buildname: Windows XP 32-bit mozilla-inbound debug test mochitest-other
revision: 2d2577321beb

2535 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2537 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
3523 INFO TEST-UNEXPECTED-FAIL | widget/tests/test_wheeltransaction.xul | uncaught exception - TypeError: gCurrentTest is undefined at chrome://mochitests/content/chrome/widget/tests/window_wheeltransaction.xul:1442
PROCESS-CRASH | Main app process exited normally | application crashed [@ moz_abort]
Return code: 1
Return code: 1
Return code: 1

Comment 12

[Eric Rahm [:erahm]]

Is there a way to get the stack trace for the crash?

Comment 13

[Jed Davis [:jld] ⟨⏰|UTC-8⟩ ⟦he/him⟧]

(In reply to Eric Rahm [:erahm] from comment #12)
> Is there a way to get the stack trace for the crash?

There's a stack in the treeherder log after the PROCESS-CRASH line.  The one from comment #11 is:

10:51:45 INFO - Crash reason: EXCEPTION_BREAKPOINT
10:51:45 INFO - Crash address: 0x3a32e9
10:51:45 INFO - Assertion: Unknown assertion type 0x00000000
10:51:45 INFO - Thread 0 (crashed)
10:51:45 INFO - 0 mozglue.dll!moz_abort [jemalloc_config.c:2d2577321beb : 50 + 0x34]
10:51:45 INFO - eip = 0x003a32e9 esp = 0x0012f564 ebp = 0x0012f5e0 ebx = 0x00000001
10:51:45 INFO - esi = 0x05c00b5c edi = 0x05e000c4 eax = 0x00000000 ecx = 0x00980ad9
10:51:45 INFO - edx = 0x00a40ea0 efl = 0x00000212
10:51:45 INFO - Found by: given as instruction pointer in context
10:51:45 INFO - 1 mozglue.dll!arena_avail_tree_remove [jemalloc.c:2d2577321beb : 3256 + 0x14f]
10:51:45 INFO - eip = 0x003a3c84 esp = 0x0012f568 ebp = 0x0012f5e0
10:51:45 INFO - Found by: call frame info
10:51:45 INFO - 2 mozglue.dll!arena_run_dalloc [jemalloc.c:2d2577321beb : 3872 + 0x16]
10:51:45 INFO - eip = 0x003a6548 esp = 0x0012f5e8 ebp = 0x0012f604
10:51:45 INFO - Found by: call frame info
10:51:45 INFO - 3 mozglue.dll!arena_dalloc_small [jemalloc.c:2d2577321beb : 4616 + 0x8]
10:51:45 INFO - eip = 0x003a5300 esp = 0x0012f60c ebp = 0x0012f628
10:51:45 INFO - Found by: call frame info
10:51:45 INFO - 4 mozglue.dll!arena_dalloc [jemalloc.c:2d2577321beb : 4719 + 0xc]
10:51:45 INFO - eip = 0x003a51b6 esp = 0x0012f630 ebp = 0x0012f69c
10:51:45 INFO - Found by: call frame info
10:51:45 INFO - 5 mozglue.dll!je_free [jemalloc.c:2d2577321beb : 6459 + 0x6]
10:51:45 INFO - eip = 0x003aa10e esp = 0x0012f6a4 ebp = 0x0012f6ac
10:51:45 INFO - Found by: call frame info
10:51:45 INFO - 6 xul.dll!PLDHashTable::Finish() [pldhash.cpp:2d2577321beb : 368 + 0x8]
10:51:45 INFO - eip = 0x10130d66 esp = 0x0012f6b4 ebp = 0x0012f6c4
10:51:45 INFO - Found by: call frame info
10:51:45 INFO - 7 xul.dll!nsTHashtable<nsBaseHashtableET<nsPtrHashKey<PRThread>,nsRefPtr<nsThread> > >::~nsTHashtable<nsBaseHashtableET<nsPtrHashKey<PRThread>,nsRefPtr<nsThread> > >() [nsTHashtable.h:2d2577321beb : 415 + 0x5]
10:51:45 INFO - eip = 0x10100c6b esp = 0x0012f6cc ebp = 0x0012f6e8
10:51:45 INFO - Found by: call frame info
10:51:45 INFO - 8 xul.dll!_CRT_INIT [crtdll.c : 414 + 0x1]
10:51:45 INFO - eip = 0x12c02b1e esp = 0x0012f6d4 ebp = 0x0012f6e8
10:51:45 INFO - Found by: call frame info

Comment 14

[Eric Rahm [:erahm]]

So this feels like several different issues. It started as a series of two issues:
 - test_aboutmemory6.xul times out
 - test_dumpGCAndCCLogsToFile.xul finished without calling any checks

Comment #1 is a timeout
Comment #2 is a timeout, and then test_dumpGCAndCCLogsToFile.xul called finish a few times
Comment #3 is the same as comment #0
Comment #4 is the same as comment #0, but now test_memoryReporters.xul has decided to join the party
Comment #5 is the a slight variation, test_aboutmemory6.xul times out, test_memoryReporters.xul calls finish a few times
Comment #6, comment #7 are unrelated
Comment #8 - #11 are WinXP-32 debug only shutdown crashes most likely unrelated to this test specifically

This leaves us with a few questions:
 #1 - Is the original issue still happening? Hard to say, the last report was 2015-03-08
 #2 - Why is test_dumpGCAndCCLogsToFile.xul finishing w/o performing any checks?
 #3 - Why are test_dumpGCAndCCLogsToFile.xul and test_memoryReporters.xul calling finish multiple times?
 #4 - The shutdown crash is in an assert, but we’re not seeing an actual message logged. It would be really helpful to get that.

I think we can answer #2 and #3 through code inspection. #1, only time will tell. #4 is interesting, but we need more info to get anywhere with it. I did a bit of code spelunking and found that it's happening during nsThreadManager's static dtor which gets hit after |exit| is called. Specifically it's the destruction of mThreadsByPRIndex [1] that is triggering the assert somewhere deep in jemalloc, at least for comment #11.

[1] https://hg.mozilla.org/mozilla-central/annotate/4fb7ff694bf5/xpcom/threads/nsThreadManager.h#l113

Comment 15

[Jed Davis [:jld] ⟨⏰|UTC-8⟩ ⟦he/him⟧]

(In reply to Eric Rahm [:erahm] from comment #14)
>  #2 - Why is test_dumpGCAndCCLogsToFile.xul finishing w/o performing any
> checks?

From a look at the test it shouldn't be possible for it to call SimpleTest.finish() without at least one is().

>  #3 - Why are test_dumpGCAndCCLogsToFile.xul and test_memoryReporters.xul
> calling finish multiple times?

For the former, if dumpGCAndCCLogsToFile calls the finish callback multiple times that could happen.  The latter appears to not be async, so that doesn't even make sense.

Unless I'm missing something, something weird is going on with those errors.

Comment 16

[Eric Rahm [:erahm]]

(In reply to Jed Davis [:jld] {UTC-7} from comment #15)
> (In reply to Eric Rahm [:erahm] from comment #14)
> >  #2 - Why is test_dumpGCAndCCLogsToFile.xul finishing w/o performing any
> > checks?
> 
> From a look at the test it shouldn't be possible for it to call
> SimpleTest.finish() without at least one is().
> 
> >  #3 - Why are test_dumpGCAndCCLogsToFile.xul and test_memoryReporters.xul
> > calling finish multiple times?
> 
> For the former, if dumpGCAndCCLogsToFile calls the finish callback multiple
> times that could happen.  The latter appears to not be async, so that
> doesn't even make sense.
> 
> Unless I'm missing something, something weird is going on with those errors.

Well, I guess hypothetically it could be:
  - Previous test times out
  - New test starts
  - Previous test still calls finish

This could result in both finishing twice and finishing w/ no checks. I'm not familiar enough w/ SimpleTest to know if that's possible though...

Comment 17

[Jed Davis [:jld] ⟨⏰|UTC-8⟩ ⟦he/him⟧]

(In reply to Eric Rahm [:erahm] from comment #16)
> Well, I guess hypothetically it could be:
>   - Previous test times out
>   - New test starts
>   - Previous test still calls finish
> 
> This could result in both finishing twice and finishing w/ no checks. I'm
> not familiar enough w/ SimpleTest to know if that's possible though...

I think it's not?  Loading SimpleTest.js creates a new SimpleTest object, so each test page should have separate state for things like the “already called finish!” check.  But I'm not sure if I trust my knowledge of JS enough to be certain about that.

Comment 18

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=10144813
repository: mozilla-inbound
start_time: 2015-05-26T01:42:33
who: tomcat[at]mozilla[dot]com
machine: t-xp32-ix-091
buildname: Windows XP 32-bit mozilla-inbound debug test mochitest-other
revision: dc683817edec

2535 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2537 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
PROCESS-CRASH | Main app process exited normally | application crashed [@ moz_abort]
Return code: 1
Return code: 1
Return code: 1

Comment 19

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=10333689
repository: mozilla-inbound
start_time: 2015-06-01T15:45:42
who: wkocher[at]mozilla[dot]com
machine: t-xp32-ix-093
buildname: Windows XP 32-bit mozilla-inbound debug test mochitest-other
revision: 14d7c8dce3e4

2533 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2535 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
PROCESS-CRASH | Main app process exited normally | application crashed [@ moz_abort]
Return code: 1
Return code: 1
Return code: 1

Comment 20

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=8840615
repository: try
start_time: 2015-06-25T18:17:37
who: bkelly[at]mozilla[dot]com
machine: t-snow-r4-0158
buildname: Rev4 MacOSX Snow Leopard 10.6 try debug test mochitest-other
revision: 688f4ebe6df9

2673 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2675 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
PROCESS-CRASH | Main app process exited normally | application crashed [None]
Return code: 1

Comment 21

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4539193
repository: fx-team
start_time: 2015-09-03T13:38:03
who: wkocher[at]mozilla[dot]com
machine: t-snow-r4-0100
buildname: Rev4 MacOSX Snow Leopard 10.6 fx-team debug test mochitest-other
revision: 09ad75a2d51f

2706 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | This test left crash dumps behind, but we weren't expecting it to!
2708 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory6.xul | undefined assertion name - Result logged after SimpleTest.finish()
PROCESS-CRASH | Main app process exited normally | application crashed [None]
TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks!
Return code: 1

Comment 22

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=13769259
repository: mozilla-inbound
start_time: 2015-09-07T23:20:55
who: nigelbabu[at]gmail[dot]com
machine: t-snow-r4-0100
buildname: Rev4 MacOSX Snow Leopard 10.6 mozilla-inbound debug test mochitest-other
revision: 321303b7d428

2714 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | GC/CC logs for each child process - got 2, expected 3
2715 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | This test left crash dumps behind, but we weren't expecting it to!
2717 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | undefined assertion name - Result logged after SimpleTest.finish()
TEST-UNEXPECTED-FAIL | toolkit/content/tests/chrome/test_arrowpanel.xul | application terminated with exit code 1
PROCESS-CRASH | toolkit/content/tests/chrome/test_arrowpanel.xul | application crashed [@ js::ObjectGroup::sweep(js::AutoClearTypeInferenceStateOnOOM*)]
PROCESS-CRASH | toolkit/content/tests/chrome/test_arrowpanel.xul | application crashed [@ DoMarking<JSString*>(js::GCMarker*, JSString*)]
TEST-UNEXPECTED-FAIL | leakcheck | default process: missing output line for total leaks!
TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks!
Return code: 1
No tests run or test summary not found

Comment 23

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4792412
repository: fx-team
start_time: 2015-09-22T20:08:12
who: tomcat[at]mozilla[dot]com
machine: t-w864-ix-155
buildname: Windows 8 64-bit fx-team debug test mochitest-other
revision: 73d128e70978

1397 INFO TEST-UNEXPECTED-ERROR | dom/ipc/tests/test_process_error.xul | Assertion count 1 is greater than expected range 0-0 assertions.
2646 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_aboutmemory5.xul | Test timed out.
2648 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_aboutmemory5.xul | Assertion count 3 is greater than expected range 0-0 assertions.
2652 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | Test timed out.
2654 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | Assertion count 2 is greater than expected range 0-0 assertions.
2658 INFO TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_memoryReporters2.xul | Test timed out.
2660 INFO TEST-UNEXPECTED-ERROR | toolkit/components/aboutmemory/tests/test_memoryReporters2.xul | Assertion count 3 is greater than expected range 0-0 assertions.
2790 INFO TEST-UNEXPECTED-FAIL | toolkit/content/tests/chrome/test_bug451286.xul | GC/CC logs for each child process - got 2, expected 3
2793 INFO TEST-UNEXPECTED-FAIL | toolkit/content/tests/chrome/test_bug451286.xul | correct resident count
2797 INFO TEST-UNEXPECTED-FAIL | toolkit/content/tests/chrome/test_bug451286.xul | correct non-empty process name count
2799 INFO TEST-UNEXPECTED-ERROR | toolkit/content/tests/chrome/test_bug451286.xul | called finish() multiple times
2803 INFO TEST-UNEXPECTED-ERROR | toolkit/content/tests/chrome/test_bug451286.xul | called finish() multiple times
TEST-UNEXPECTED-FAIL | leakcheck | default process: 9088 bytes leaked (CondVar, GeckoChildProcessHost, Mutex, StoreRef)
Return code: 1
Return code: 1

Comment 24

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4825016
repository: fx-team
start_time: 2015-09-24T19:05:15
who: tomcat[at]mozilla[dot]com
machine: t-snow-r4-0019
buildname: Rev4 MacOSX Snow Leopard 10.6 fx-team opt test mochitest-other
revision: a23053342d5b

TEST-UNEXPECTED-FAIL | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | application terminated with exit code 1
PROCESS-CRASH | toolkit/components/aboutmemory/tests/test_dumpGCAndCCLogsToFile.xul | application crashed [@ mozilla::layers::AutoLayerTransactionParentAsyncMessageSender::~AutoLayerTransactionParentAsyncMessageSender()]

Comment 25

[BMO Automation]

Bulk assigning P3 to all open intermittent bugs without a priority set in Firefox components per bug 1298978.

Comment 26

[Firefox Bug Husbandry Bot]

Closing as INCOMPLETE per https://bugzilla.mozilla.org/show_bug.cgi?id=1581949