1115180 - Get test_cost_control_data_alert_mobile.py re-enabled

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Martijn Wargers (dead)]

This is a follow-up from bug 1097605.
I got test_cost_control_data_alert_mobile.py working locally, but on Jenkins, it is timing out in connect_to_cell_data.

There might be something wrong with the credentials in the lab devices, I don't know.

Comment 1

[Martijn Wargers (dead)]

Anyone of you have an idea what needs to be done to get this enabled?

This is working locally for me (although there might be an intermittent failure lurking in the test, need to investigate that).

Comment 2

[Martijn Wargers (dead)]

Talked to njpark on irc, only a few of the devices in the lab have data connection enabled.
So I should try this out with the manifest.ini file.

Comment 3

[Martijn Wargers (dead)]

Ok, this was the intermittent failure I was sometimes getting:
seconds


Traceback (most recent call last):
  File "/Users/mwargers/.virtualenvs/gaia-py-latest/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/marionette_test.py", line 264, in run
    testMethod()
  File "/Users/mwargers/B2G/gaia_clean/tests/python/gaia-ui-tests/gaiatest/tests/functional/cost_control/test_cost_control_data_alert_mobile.py", line 46, in test_cost_control_data_alert_mobile
    browser = search.go_to_url('http://www.mozilla.org/')
  File "/Users/mwargers/B2G/gaia_clean/tests/python/gaia-ui-tests/gaiatest/apps/search/app.py", line 29, in go_to_url
    return search_panel.go_to_url(url)
  File "/Users/mwargers/B2G/gaia_clean/tests/python/gaia-ui-tests/gaiatest/apps/homescreen/regions/search_panel.py", line 60, in go_to_url
    Wait(self.marionette).until(lambda m: self.keyboard.is_keyboard_displayed)
  File "/Users/mwargers/.virtualenvs/gaia-py-latest/lib/python2.7/site-packages/marionette_client-0.8.4-py2.7.egg/marionette/wait.py", line 143, in until
    cause=last_exc)
TEST-INFO took 135709ms

The Browser app then fails to show up.

Comment 4

[Martijn Wargers (dead)]

Attachment: test_cost_control_data_alert_mobile.py.diff

With this patch, I haven't seen the failure mentioned in comment 3, yet.
Also, this makes it wait a little longer for the page to load (when you have a very slow 2G connection).

Comment 5

[Martijn Wargers (dead)]

(In reply to Martijn Wargers [:mwargers] (QA) from comment #4)
> With this patch, I haven't seen the failure mentioned in comment 3, yet.

Although, I can't really see why this would work.

Comment 6

[Martijn Wargers (dead)]

(In reply to Martijn Wargers [:mwargers] (QA) from comment #2)
> Talked to njpark on irc, only a few of the devices in the lab have data
> connection enabled.
> So I should try this out with the manifest.ini file.

Did this now with: https://github.com/mozilla-b2g/gaia/pull/27015
http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.ui.adhoc/519/

Comment 7

[Martijn Wargers (dead)]

Sorry, did something wrong in the previous run, here a new one:
http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.ui.adhoc/520/
I still get timeouts in connect_to_cell_data.

I'm out of ideas on what to do. How does this work for the other tests that use cell data? (like test_browser_cell_data.py for instance)

Comment 8

[Johan Lorenzo [:jlorenzo]]

This issue is due to bug 1114955. We can't activate cell data on master for a couple of days.

Comment 9

[Martijn Wargers (dead)]

Bug 1114955 is fixed, but now there is bug 1118049 that prevents this test from being re-enabled.

Comment 10

[Geo Mealer [:geo] -- This account is inactive after 2015-07-07]

Plussing this since it's currently being worked on.

Comment 11

[Geo Mealer [:geo] -- This account is inactive after 2015-07-07]

Resetting back to in-qa-testsuite? per decision this morning. Note that this is still not needed when adding the QA Whiteboard flags, which are generally more expressive.

Comment 12

[Viorela Ioia [:viorela]]

Bug 1118049 is fixed, I think we can re-enable test_cost_control_data_alert_mobile.py.
Martin, are you working on this? Can you update the PR (if needed), in order to get this test enabled? Thanks!

Comment 13

[Martijn Wargers (dead)]

Attachment: cost_control

Yes, this can be re-enabled, I think. It works locally fine here.

Comment 14

[Viorela Ioia [:viorela]]

Comment on attachment 8552527 [details] [review]
cost_control

The patch looks good, but there are merge conflicts. Can you fix them and ask me for review again? Thanks!

Comment 15

[Martijn Wargers (dead)]

Attachment: cost_control2

Ok, updated patch, this should be mergeable.

Comment 16

[Viorela Ioia [:viorela]]

Comment on attachment 8553090 [details] [review]
cost_control2

Merged in https://github.com/mozilla-b2g/gaia/commit/155461a49ea339ff8fa57478296d633015521f96

Comment 17

[Martijn Wargers (dead)]

Hi Teri, I noticed this was disabled in your automation report:
Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 - Need ability to work in the shadow root/shadow DOM

This is the bug that enabled it on master, this should be possible to backport to 2.2.

Comment 18

[Eric Chang [:ericcc] [:echang]]

Got the info from Cynthia, that we need to fix the bug 1141447 or we will fail on test_cost_control_data_alert_mobile.py

Comment 19

[GitHub Autolander Bot]

Attachment: [gaia] teriwen:gaia-costcontrol > mozilla-b2g:v2.2

Comment 20

[Teri Wen [:twen]]

Comment on attachment 8582914 [details] [review]
[gaia] teriwen:gaia-costcontrol > mozilla-b2g:v2.2

Hi Viorela, please help review this on v2.2.

Comment 21

[Martijn Wargers (dead)]

Comment on attachment 8582914 [details] [review]
[gaia] teriwen:gaia-costcontrol > mozilla-b2g:v2.2

Ok, bug 1141447 landed on v2.2, so it's only a matter of turning on this test then, right? r+

Comment 22

[Eric Chang [:ericcc] [:echang]]

For some reason, the taskcluster seems to be running lots of tests, and it fails a couple of times, Martijn, have you seen anything like that?
https://github.com/mozilla-b2g/gaia/pull/29128
https://treeherder.mozilla.org/#/jobs?repo=gaia&revision=443d687446cc52cbcda19e90e6ef8c17f0002aac

Comment 23

[Martijn Wargers (dead)]

Afaik, taskcluster is currently unreliable (because of bug 1147176?).
I hit this problem myself in bug 1146877 and John in bug 1139083.

Comment 24

[Martijn Wargers (dead)]

It seems like Treeherder try for v2.2 is green now, so the v2.2 pull request can be checked in now?

Comment 25

[Eric Chang [:ericcc] [:echang]]

Hi Edward, Please help with this, thank you.

Comment 26

[GitHub Autolander Bot]

Attachment: [gaia] edwardchen40:bug1115180 > mozilla-b2g:master

Comment 27

[GitHub Autolander Bot]

Attachment: [gaia] edwardchen40:bug1115180 > mozilla-b2g:v2.2

Comment 28

[Edward Chen[:edchen]]

Attachment: Re-enable test_cost_control_data_alert_mobile.py

Comment 29

[Martijn Wargers (dead)]

Comment on attachment 8606823 [details] [review]
Re-enable test_cost_control_data_alert_mobile.py

https://github.com/mozilla-b2g/gaia/commit/5212c658a651e04d6d84dfc1bce06b499c0d0d96