1389808 - Intermittent testPanCorrectness | Pixel at 0, 0 - Color rgba(128,88,64,255) not close enough to expected rgb(0,0,0)

Status: RESOLVED DUPLICATE of bug 1390059

(Firefox for Android Graveyard :: Testing, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=122745799&repo=autoland

https://queue.taskcluster.net/v1/task/Nnbs88gyQhGdR6hGVVrGyA/runs/0/artifacts/public/logs/live_backing.log

[task 2017-08-12T12:31:17.641889Z] 12:31:17     INFO -  TEST-START | testPanCorrectness
[task 2017-08-12T12:31:17.641965Z] 12:31:17     INFO -  GECKO | EventExpecter: no longer listening for Gecko:Ready
[task 2017-08-12T12:31:17.642028Z] 12:31:17     INFO -  GECKO | EventExpecter: no longer listening for Content:DOMContentLoaded
[task 2017-08-12T12:31:17.642088Z] 12:31:17     INFO -  GECKO | PaintExpecter: no longer listening for events
[task 2017-08-12T12:31:17.642145Z] 12:31:17     INFO -  Buffered messages logged at 12:30:31
[task 2017-08-12T12:31:17.642242Z] 12:31:17     INFO -  TEST-PASS | testPanCorrectness | Robocop tests need the test device screen to be powered on. -
[task 2017-08-12T12:31:17.642290Z] 12:31:17     INFO -  Buffered messages logged at 12:30:41
[task 2017-08-12T12:31:17.642378Z] 12:31:17     INFO -  TEST-PASS | testPanCorrectness | Given message occurred for registered event: {type=null} - Gecko:Ready should equal Gecko:Ready
[task 2017-08-12T12:31:17.642434Z] 12:31:17     INFO -  Buffered messages logged at 12:30:52
[task 2017-08-12T12:31:17.642536Z] 12:31:17     INFO -  TEST-PASS | testPanCorrectness | Given message occurred for registered event: {metadata=null, bgColor=rgba(0, 0, 0, 0), type=null, tabID=0, errorType=} - Content:DOMContentLoaded should equal Content:DOMContentLoaded
[task 2017-08-12T12:31:17.642582Z] 12:31:17     INFO -  Buffered messages finished
[task 2017-08-12T12:31:17.642661Z] 12:31:17  WARNING -  TEST-UNEXPECTED-FAIL | testPanCorrectness | Pixel at 0, 0 - Color rgba(128,88,64,255) not close enough to expected rgb(0,0,0)
[task 2017-08-12T12:31:17.642768Z] 12:31:17     INFO -  0 ERROR Exception caught during test! - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testPanCorrectness | Pixel at 0, 0 - Color rgba(128,88,64,255) not close enough to expected rgb(0,0,0)
[task 2017-08-12T12:31:17.642830Z] 12:31:17     INFO -  	at junit.framework.Assert.fail(Assert.java:50)
[task 2017-08-12T12:31:17.642911Z] 12:31:17     INFO -  	at org.mozilla.gecko.FennecMochitestAssert._logMochitestResult(FennecMochitestAssert.java:124)
[task 2017-08-12T12:31:17.642981Z] 12:31:17     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.ok(FennecMochitestAssert.java:145)
[task 2017-08-12T12:31:17.643246Z] 12:31:17     INFO -  	at org.mozilla.gecko.FennecMochitestAssert.ispixel(FennecMochitestAssert.java:164)
[task 2017-08-12T12:31:17.643511Z] 12:31:17     INFO -  	at org.mozilla.gecko.tests.PixelTest.checkScrollWithBoxes(PixelTest.java:95)
[task 2017-08-12T12:31:17.643760Z] 12:31:17     INFO -  	at org.mozilla.gecko.tests.PixelTest.loadAndVerifyBoxes(PixelTest.java:112)
[task 2017-08-12T12:31:17.644024Z] 12:31:17     INFO -  	at org.mozilla.gecko.tests.testPanCorrectness.testPanCorrectness(testPanCorrectness.java:25)
[task 2017-08-12T12:31:17.644291Z] 12:31:17     INFO -  	at java.lang.reflect.Method.invokeNative(Native Method)
[task 2017-08-12T12:31:17.644533Z] 12:31:17     INFO -  	at java.lang.reflect.Method.invoke(Method.java:525)
[task 2017-08-12T12:31:17.644796Z] 12:31:17     INFO -  	at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
[task 2017-08-12T12:31:17.645051Z] 12:31:17     INFO -  	at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
[task 2017-08-12T12:31:17.645345Z] 12:31:17     INFO -  	at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
[task 2017-08-12T12:31:17.645603Z] 12:31:17     INFO -  	at org.mozilla.gecko.tests.BaseRobocopTest.runTest(BaseRobocopTest.java:188)
[task 2017-08-12T12:31:17.645840Z] 12:31:17     INFO -  	at junit.framework.TestCase.runBare(TestCase.java:134)
[task 2017-08-12T12:31:17.646085Z] 12:31:17     INFO -  	at junit.framework.TestResult$1.protect(TestResult.java:115)
[task 2017-08-12T12:31:17.646398Z] 12:31:17     INFO -  	at junit.framework.TestResult.runProtected(TestResult.java:133)
[task 2017-08-12T12:31:17.646634Z] 12:31:17     INFO -  	at junit.framework.TestResult.run(TestResult.java:118)
[task 2017-08-12T12:31:17.646876Z] 12:31:17     INFO -  	at junit.framework.TestCase.run(TestCase.java:124)
[task 2017-08-12T12:31:17.647148Z] 12:31:17     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
[task 2017-08-12T12:31:17.647404Z] 12:31:17     INFO -  	at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
[task 2017-08-12T12:31:17.647661Z] 12:31:17     INFO -  	at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
[task 2017-08-12T12:31:17.647922Z] 12:31:17     INFO -  	at org.mozilla.gecko.FennecInstrumentationTestRunner.onStart(FennecInstrumentationTestRunner.java:64)
[task 2017-08-12T12:31:17.648192Z] 12:31:17     INFO -  	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)
[task 2017-08-12T12:31:17.648539Z] 12:31:17  WARNING -  TEST-UNEXPECTED-FAIL | testPanCorrectness | Exception caught - junit.framework.AssertionFailedError: TEST-UNEXPECTED-FAIL | testPanCorrectness | Pixel at 0, 0 - Color rgba(128,88,64,255) not close enough to expected rgb(0,0,0)
[task 2017-08-12T12:31:17.648807Z] 12:31:17     INFO -  TEST-OK | testPanCorrectness | took 50953ms

Comment 1

[Intermittent Failures Robot]

1 failures in 901 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-api-15-gradle: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1389808&startday=2017-08-07&endday=2017-08-13&tree=all

Comment 2

[Intermittent Failures Robot]

10 failures in 949 pushes (0.011 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5
* mozilla-inbound: 3
* mozilla-central: 2

Platform breakdown:
* android-4-3-armv7-api15: 6
* android-api-15-gradle: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1389808&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

this is picking up, we might want to look at this soon.

Comment 4

[Intermittent Failures Robot]

27 failures in 908 pushes (0.03 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 12
* mozilla-central: 6
* mozilla-inbound: 5
* try: 4

Platform breakdown:
* android-api-15-gradle: 14
* android-4-3-armv7-api15: 13

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1389808&startday=2017-08-21&endday=2017-08-27&tree=all

Comment 6

[Intermittent Failures Robot]

5 failures in 939 pushes (0.005 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5

Platform breakdown:
* android-api-16-gradle: 2
* android-4-3-armv7-api-16: 2
* android-4-3-armv7-api15: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1389808&startday=2017-08-28&endday=2017-09-03&tree=all