1022037 - TestSuggestedSites.testLocaleChanges Android instrumentation tests AssertionFailed

Status: RESOLVED WONTFIX

(Firefox for Android Graveyard :: Testing, defect)

Description

[Chenxia Liu [:liuche]]

Are these tests regularly run somewhere, or are dev builds the only places where these are run? This is an fx-team build, 6/6, run on my Asus Transformer.

junit.framework.AssertionFailedError: expected:<3> but was:<5>
at org.mozilla.gecko.browser.tests.TestSuggestedSites.testLocaleChanges(TestSuggestedSites.java:262)
at java.lang.reflect.Method.invokeNative(Native Method)
at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186)
at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:537)
at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1551)

Comment 1

[Richard Newman [:rnewman]]

No, these aren't run anywhere automatically yet.

Dumping this in Testing until we determine whether it's a test error or a bug!

Comment 2

[Nick Alexander :nalexander [he/him]]

I wonder if lucasr hard-coded some data about suggestedsites.json, which was recently revved?  I'm thrilled that folks are running these locally, and filing bugs!  Thanks!

Comment 3

[Lucas Rocha (:lucasr)]

Hmm, I see no errors here.  Have you tried running these tests on another device to see if it makes any difference?

Comment 4

[Chenxia Liu [:liuche]]

I see this error on the following devices:
Asus Transformer 1 (4.0)
Motorola Droid 4 (2.3)
HTC One V (4.0)
Moto X (4.4.3)

Comment 5

[Geoff Brown [:gbrown]]

Mass closing Firefox for Android :: Testing bugs with no progress in 2017.

If this bug is important to you, please re-open.