1146420 - Android 4.3 testAdobeFlash | Pixel at 0, 0 - Color rgba(255,255,255,255) not close enough to expected rgb(0,255,0)

Status: RESOLVED WONTFIX

(Firefox for Android Graveyard :: Testing, defect)

Description

[Geoff Brown [:gbrown]]

testAdobeFlash fails consistently on the Android 4.3 emulator:

http://ftp.mozilla.org/pub/mozilla.org/mobile/try-builds/[e-mail]-8215e218bc55/try-android-api-9/try_ubuntu64_vm_mobile_test-robocop-1-bm113-tests1-linux64-build46.txt.gz

18:20:58     INFO -  TEST-PASS | testAdobeFlash | Expecting preference array to have one element - 1 should equal 1
18:20:58     INFO -  TEST-PASS | testAdobeFlash | Expecting returned preference name to be the same as the set name - plugin.enable should equal plugin.enable
18:20:58     INFO -  TEST-PASS | testAdobeFlash | Expecting returned preference type to be the same as the set type - string should equal string
18:20:58     INFO -  TEST-PASS | testAdobeFlash | Expecting returned preference value to be the same as the set value - 1 should equal 1
18:20:58     INFO -  EventExpecter: no longer listening for Preferences:Data
18:20:58     INFO -  EventExpecter: no longer listening for Gecko:Ready
18:20:58     INFO -  TEST-PASS | testAdobeFlash | Given message occurred for registered event: {"type":"Preferences:Data","requestId":7,"preferences":[{"value":false,"type":"bool","name":"gfx.android.rgb16.force"}]} - Preferences:Data should equal Preferences:Data
18:20:58     INFO -  PaintExpecter: no longer listening for events
18:20:58  WARNING -  TEST-UNEXPECTED-FAIL | testAdobeFlash | Pixel at 0, 0 - Color rgba(255,255,255,255) not close enough to expected rgb(0,255,0)
18:20:58     INFO -  0 ERROR Exception caught during test! - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testAdobeFlash | Pixel at 0, 0 - Color rgba(255,255,255,255) not close enough to expected rgb(0,255,0)
18:20:58     INFO -  	at junit.framework.Assert.fail(Assert.java:50)
18:20:58     INFO -  	at org.mozilla.gecko.FennecMochitestAssert._logMochitestResult(FennecMochitestAssert.java:128)
18:20:58     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.ok(FennecMochitestAssert.java:150)
18:20:58     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.ispixel(FennecMochitestAssert.java:170)
18:20:58     INFO -  	at org.mozilla.gecko.tests.testAdobeFlash.testLoad(testAdobeFlash.java:41)
18:20:58     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
18:20:58     INFO -  	at java.lang.reflect.Method.invoke(Method.java:525)
18:20:58     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
18:20:59     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
18:20:59     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
18:20:59     INFO -  	at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:132)
18:20:59     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:134)
18:20:59     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:115)
18:20:59     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:133)
18:20:59     INFO -  	at junit.framework.TestResult.run(TestResult.java:118)
18:20:59     INFO -  	at junit.framework.TestCase.run(TestCase.java:124)
18:20:59     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
18:20:59     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
18:20:59     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
18:20:59     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)
18:20:59     INFO -  
18:20:59  WARNING -  TEST-UNEXPECTED-FAIL | testAdobeFlash | Exception caught - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testAdobeFlash | Pixel at 0, 0 - Color rgba(255,255,255,255) not close enough to expected rgb(0,255,0)
18:20:59     INFO -  TEST-OK | testAdobeFlash | took 79363ms
18:20:59     INFO -  TEST-START | Shutdown
18:20:59     INFO -  Passed: 13
18:20:59     INFO -  Failed: 2

Comment 1

[Geoff Brown [:gbrown]]

We currently run testAdobeFlash on the Android 2.3 emulator but not on the 4.3 emulator. It also runs in autophone's rca job (Android 4.2 and 4.4, I believe). 

I have a vague memory of flash causing instability on the 4.3 emulator, but I cannot find that documented anywhere. It was installed in the original 4.3 image (bug 1062365) but it is not installed on 4.3 currrently.

:snorp -- Once 2.3 is retired, testAdobeFlash will only be running on autophone. If you are comfortable with that coverage, we can WONTFIX this bug; if not, I can try installing flash on the 4.3 emulator. Your preference?

Comment 2

[James Willcox (:snorp) ([e-mail]) (he/him)]

I think we can just rely on the autophone test.