897076 - [fig] Intermittent testNewTab | Number of tabs increased - got 2, expected 3

Status: RESOLVED INVALID

(Firefox for Android Graveyard :: General, defect)

Description

[:Margaret Leibovic]

https://tbpl.mozilla.org/php/getParsedLog.php?id=25589625&tree=Fig

0 INFO SimpleTest START
1 INFO TEST-START | testNewTab
EventExpecter: no longer listening for Gecko:Ready
2 INFO TEST-PASS | testNewTab | Checking elements - all elements present
3 INFO TEST-PASS | testNewTab | Initial number of tabs correct - 1 should equal 1
4 INFO TEST-PASS | testNewTab | checking that tabs clicked - tabs element clicked
5 INFO TEST-PASS | testNewTab | waiting for add tab view - add tab view available
6 INFO TEST-PASS | testNewTab | checking that add_tab clicked - add_tab element clicked
EventExpecter: no longer listening for DOMContentLoaded
7 INFO TEST-PASS | testNewTab | Number of tabs increased - 2 should equal 2
8 INFO TEST-PASS | testNewTab | checking that tabs clicked - tabs element clicked
9 INFO TEST-PASS | testNewTab | waiting for add tab view - add tab view available
10 INFO TEST-PASS | testNewTab | checking that add_tab clicked - add_tab element clicked
EventExpecter: no longer listening for DOMContentLoaded
11 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 2, expected 3
Exception caught during test!
junit.framework.AssertionFailedError: 11 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 2, expected 3
	at junit.framework.Assert.fail(Assert.java:47)
	at org.mozilla.fennec_fig.FennecMochitestAssert._logMochitestResult(FennecMochitestAssert.java:107)
	at org.mozilla.fennec_fig.FennecMochitestAssert.ok(FennecMochitestAssert.java:136)
	at org.mozilla.fennec_fig.FennecMochitestAssert.is(FennecMochitestAssert.java:142)
	at org.mozilla.fennec_fig.tests.testNewTab.testNewTab(testNewTab.java:51)
	at java.lang.reflect.Method.invokeNative(Native Method)
	at java.lang.reflect.Method.invoke(Method.java:521)
	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204)
	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194)
	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
	at org.mozilla.fennec_fig.tests.BaseTest.runTest(BaseTest.java:157)
	at junit.framework.TestCase.runBare(TestCase.java:127)
	at junit.framework.TestResult$1.protect(TestResult.java:106)
	at junit.framework.TestResult.runProtected(TestResult.java:124)
	at junit.framework.TestResult.run(TestResult.java:109)
	at junit.framework.TestCase.run(TestCase.java:118)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:520)
	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1447)
12 INFO TEST-UNEXPECTED-FAIL | testNewTab | Exception caught - junit.framework.AssertionFailedError: 11 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 2, expected 3
13 INFO TEST-END | testNewTab | finished in 24975ms
14 INFO TEST-START | Shutdown
15 INFO Passed: 9
16 INFO Failed: 2
17 INFO Todo: 0
18 INFO SimpleTest FINISHED

Comment 1

[Adrian Tamas (:AdrianT)]

Attachment: fix for testNewTab

Try run: https://tbpl.mozilla.org/?tree=Try&rev=74c6b649a9c1

I am still waiting for the Tegra results which seem to be particularly slow today so I will re-trigger the rc1 a few times tomorrow to ensure the intermittent fail was fixed.

I added verifications for the pages titles to ensure the tab is loaded and active before checking the count and also I loaded a page in the first tab since about:home is no longer a web page. Unfortunatly it seems that on the debug builds there is quite a delay between DOMContentLoaded and the display of the page so I am waiting for the page title before verifying the title is correct.

Comment 2

[Adrian Tamas (:AdrianT)]

Comment on attachment 780382 [details] [diff] [review]
fix for testNewTab

Canceling review since this was fixed by bug 895816

Comment 3

[:Margaret Leibovic]

(In reply to Adrian Tamas (:AdrianT) from comment #2)
> Comment on attachment 780382 [details] [diff] [review]
> fix for testNewTab
> 
> Canceling review since this was fixed by bug 895816

Sorry for the churn. Does this mean we can close this bug as INVALID?

Comment 4

[Lucas Rocha (:lucasr)]

Closing.

Comment 5

[Ed Morley [:emorley]]

Seems back

Comment 6

[Legacy TBPL/Treeherder Robot]

edmorley
https://tbpl.mozilla.org/php/getParsedLog.php?id=28324954&tree=Mozilla-Central
Android 2.2 Tegra mozilla-central opt test robocop-1 on 2013-09-24 21:24:18
revision: 68d279364a8b
slave: tegra-168

7 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 1, expected 2
junit.framework.AssertionFailedError: 7 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 1, expected 2
8 INFO TEST-UNEXPECTED-FAIL | testNewTab | Exception caught - junit.framework.AssertionFailedError: 7 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 1, expected 2
09-24 21:31:37.168 I/Robocop ( 2356): 7 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 1, expected 2
09-24 21:31:37.266 I/Robocop ( 2356): junit.framework.AssertionFailedError: 7 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 1, expected 2
09-24 21:31:37.266 I/Robocop ( 2356): 8 INFO TEST-UNEXPECTED-FAIL | testNewTab | Exception caught - junit.framework.AssertionFailedError: 7 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 1, expected 2
09-24 21:31:38.357 I/TestRunner( 2356): junit.framework.AssertionFailedError: 8 INFO TEST-UNEXPECTED-FAIL | testNewTab | Exception caught - junit.framework.AssertionFailedError: 7 INFO TEST-UNEXPECTED-FAIL | testNewTab | Number of tabs increased - got 1, expected 2

Comment 7

[Ed Morley [:emorley]]

Though different tab count, so instead filed as bug 920512.