936364 - Intermittent Travis Gaia UI Tests TEST-UNEXPECTED-FAIL | test_settings_wallpaper.py test_settings_wallpaper.TestWallpaper.test_change_wallpaper | AssertionError: Wallpaper has not changed from default.

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Julien Wajsberg [:julienw]]

Traceback (most recent call last):

File "/usr/local/lib/python2.7/dist-packages/marionette_client-0.6.1-py2.7.egg/marionette/marionette_test.py", line 143, in run

testMethod()

File "/home/travis/build/mozilla-b2g/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/settings/test_settings_wallpaper.py", line 27, in test_change_wallpaper

self.assertFalse(new_wallpaper_src == self._default_wallpaper_src, 'Wallpaper has not changed from default.')

TEST-UNEXPECTED-FAIL | test_settings_wallpaper.py test_settings_wallpaper.TestWallpaper.test_change_wallpaper | AssertionError: Wallpaper has not changed from default.

Comment 1

[Zac C (:zac)]

Having a bash at this.

Comment 2

[Zac C (:zac)]

Attachment: github pr

Comment 3

[Florin Strugariu [:Bebe]]

merged in https://github.com/mozilla-b2g/gaia/commit/f274b269bf3c042e94697965ecdb4c7b455daec6

Comment 4

[Florin Strugariu [:Bebe]]

Do we need this on 1.2?

Comment 5

[Zac C (:zac)]

I think this would be good on v1.2 so setting the flag.

Nothing I can tell changed but there was a performance slowdown and the test kept going quickly, hence race.

Comment 6

[Florin Strugariu [:Bebe]]

Attachment: Pointer to Github pull request: https://github.com/mozilla-b2g/gaia/pull/13518

Pointer to Github pull-request

Comment 7

[Julien Wajsberg [:julienw]]

1.2 is very stable on Travis since yesterday, so I don't think we need it. But if it does no harm, then why not.

Comment 8

[Julien Wajsberg [:julienw]]

Note that if you think there is a performance issue, it's worth looking if this happens on the device and file a bug, right?

Comment 9

[Zac C (:zac)]

We didn't see the intermittent on device. It's probably related to Activities I think there would be a better reduced test case for performance testing dataflow between apps.

Comment 10

[Bob Silverberg [:bsilverberg]]

Landed in v1.2: https://github.com/mozilla-b2g/gaia/commit/88d2a25bea0921f312156e146502b2725d5640de