1004472 - [v2.0] Investigate failure in test_browser_play_youtube_video.py

Status: RESOLVED WONTFIX

(Firefox OS Graveyard :: Gaia::UI Tests, defect, P1)

Description

[No-Jun Park [:njpark]]

The script fails on wait on following lines of test_browser_play_youtube_video.py:
Line 39: self.wait_for_element_displayed(*self._video_element_locator)
Stacktrace
Line 44:
player.wait_for_video_loaded()

After following fix, it passed regularly:
Line 39: self.wait_for_element_displayed(*self._video_element_locator,timeout=30)

Line 20 of html5_player.py:
            int(self.root_element.get_attribute('readyState')) == 4,timeout=60)


Traceback (most recent call last):
  File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.6-py2.7.egg/marionette/marionette_test.py", line 163, in run
    testMethod()
  File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/browser/test_browser_play_youtube_video.py", line 44, in test_play_youtube_video
    player.wait_for_video_loaded()
  File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/browser/regions/html5_player.py", line 19, in wait_for_video_loaded
    lambda m:
  File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/apps/base.py", line 54, in wait_for_condition
    Wait(self.marionette, timeout).until(method, message=message)
  File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.6-py2.7.egg/marionette/wait.py", line 143, in until
    cause=last_exc)
TimeoutException: TimeoutException: Timed out after 30.0 seconds


Version info:
Gaia      8873166797fecfa65c0afa644d2ebcc7d7cb4ed3
Gecko     https://hg.mozilla.org/mozilla-central/rev/b227a707080f
BuildID   20140501040203
Version   32.0a1
ro.build.version.incremental=324
ro.build.date=Thu Dec 19 14:04:55 CST 2013

Comment 1

[Zac C (:zac)]

> After following fix, it passed regularly:
> Line 39: self.wait_for_element_displayed(*self._video_element_locator,timeout=30)

30 is the value passed in at the command line by Jenkins so this probably doesn't have any real effect.

> Line 20 of html5_player.py:
>            int(self.root_element.get_attribute('readyState')) == 4,timeout=60)

This might have some effect though, if the video is particularly slow to load.

Comment 2

[Johan Lorenzo [:jlorenzo]]

Cannot reproduce locally. What network do the test device use ?

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

(In reply to jlorenzo from comment #2)
> Cannot reproduce locally. What network do the test device use ?

Mozilla Guest, if on Wi-Fi; T-Mobile or AT&T (both 3G), if on data.

Comment 4

[Zac C (:zac)]

(In reply to jlorenzo from comment #2)
> Cannot reproduce locally. What network do the test device use ?

You can expect this kind of scenario often. In this case we need to work with the information from the failures we've seen and put in preventative measures.

Comment 5

[Zac C (:zac)]

AndreiH and I were talking about this

Comment 6

[[:AndreiH]]

Attachment: download.png

Latest failure I have see was in: 
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Hamachi/job/b2g.hamachi.mozilla-b2g30_v1_4.ui.smoketest/34/HTML_Report/

Traceback (most recent call last):
  File "/var/jenkins/workspace/b2g.hamachi.mozilla-b2g30_v1_4.ui.smoketest/.env/local/lib/python2.7/site-packages/marionette_client-0.7.5-py2.7.egg/marionette/marionette_test.py", line 163, in run
    testMethod()
  File "/var/jenkins/workspace/b2g.hamachi.mozilla-b2g30_v1_4.ui.smoketest/tests/python/gaia-ui-tests/gaiatest/tests/functional/browser/test_browser_play_youtube_video.py", line 45, in test_play_youtube_video
    self.assertTrue(player.is_video_playing())
AssertionError: False is not true

Comment 7

[Florin Strugariu [:Bebe]]

Started a console run on master to see if we can still reproduce this
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Hamachi/job/b2g.hamachi.mozilla-central.ui.adhoc/406/console

Comment 8

[Florin Strugariu [:Bebe]]

The master build was "clean" and the test did not failed in the smoke test job since May 13, 2014 5:50:52 PM

I started a 1.4 job http://selenium.qa.mtv2.mozilla.com:8080/job/b2g.hamachi.mozilla-b2g30_v1_4.adhoc/6/console

Comment 9

[Florin Strugariu [:Bebe]]

The 1.4 build was all green I think we can close this issue as we can't reproduce it any more.

If we see this fail again please reopen the bug

Comment 10

[Viorela Ioia [:viorela]]

I had to reopen this as the issue was reproducible in latest v2.0 build. 
Test test_browser_play_youtube_video.py has failed with the failure pasted in comment 6. We need to still investigate this.

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/.env/local/lib/python2.7/site-packages/marionette_client_mozilla_b2g32_v2_0-0.1-py2.7.egg/marionette/marionette_test.py", line 170, in run
testMethod()
File "/var/jenkins/1/workspace/flame.mozilla-b2g32_v2_0.ui.functional.smoke/tests/python/gaia-ui-tests/gaiatest/tests/functional/browser/test_browser_play_youtube_video.py", line 55, in test_play_youtube_video
self.assertTrue(player.is_video_playing())
AssertionError: False is not true

Gaia      f6702e2aab77ac144955b3cbc042483b1c5eefa7
Gecko     https://hg.mozilla.org/releases/mozilla-b2g32_v2_0/rev/b87b3b927d3a
BuildID   20140731000246
Version   32.0
ro.build.version.incremental=109
ro.build.date=Mon Jun 16 16:51:29 CST 2014
B1TC00011220

Jenkins report: http://jenkins1.qa.scl3.mozilla.com/job/flame.mozilla-b2g32_v2_0.ui.functional.smoke/24/HTML_Report/

Comment 11

[Zac C (:zac)]

We'll replace this with:
https://bugzilla.mozilla.org/show_bug.cgi?id=1047168