1031295 - [b2gperf] Timeout when testing localized app

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Originally filed at: https://github.com/mozilla/b2gperf/issues/10

Testing an app in a non-english locale throws an error:

Traceback (most recent call last):
File "b2gperf.py", line 193, in test_startup
result = self.marionette.execute_async_script('launch_app("%s")' % app_name)
File "/Users/zbraniecki/.local/env/b2perf/lib/python2.7/site-packages/marionette_client-0.5.27-py2.7.egg/marionette/marionette.py", line 618, in execute_async_script
scriptTimeout=script_timeout)
File "/Users/zbraniecki/.local/env/b2perf/lib/python2.7/site-packages/marionette_client-0.5.27-py2.7.egg/marionette/marionette.py", line 344, in _send_message
self._handle_error(response)
File "/Users/zbraniecki/.local/env/b2perf/lib/python2.7/site-packages/marionette_client-0.5.27-py2.7.egg/marionette/marionette.py", line 393, in _handle_error
raise ScriptTimeoutException(message=message, status=status, stacktrace=stacktrace)
ScriptTimeoutException: timed out

Steps to reproduce:
1. install pvt build
2. go to settings, switch locale to Polish
3. run python b2gperf.py --delay=5 --iterations=30 Settings

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Now that bug 921939 is fixed, a new gaiatest release will allow us to fix this in b2gperf.

Comment 2

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Attachment: Support localised app names. v1.0

Zac: Mind reviewing this patch for b2gperf? If you want to test it just use the in-tree gaiatest, as we'll need another release before we can land this.

Comment 3

[Zac C (:zac)]

Comment on attachment 8447157 [details] [diff] [review]
Support localised app names. v1.0

I can't get this to run, I keep hitting numerous different barriers. Is there someone better prepared who has environments set up and knows the nuances, to review it?

Aside from one errant console.log the code looks fine.

Comment 4

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Attachment: Link to Github pull-request: https://github.com/mozilla/b2gperf/pull/54/files

Thanks Zac, I've removed the console.log and added the dependency on gaiatest 0.25, which is yet to be released. I'm concerned that you were having issues testing this though, as it's worked fine for me.

What you will need to do is create a clean virtual environment, and then install gaiatest from master, with the patch from bug 1031297 applied. You should then be able to run |python setup.py install| from b2gperf.

Note that if you run |python setup.py develop| then the numpy installation may fail, so you would need to do a |pip install numpy==1.7.1| first.

Then you should be able to run b2gperf using:

$ b2gperf --iterations=2 --settle-time=0 --reset Phone
$ b2gperf --iterations=2 --settle-time=0 --reset Téléphone

Comment 5

[Zac C (:zac)]

That's basically exactly what I did aside from the bug 1031297. I'll try again soon.

Comment 6

[Zac C (:zac)]

Comment on attachment 8448582 [details]
Link to Github pull-request: https://github.com/mozilla/b2gperf/pull/54/files

It works for me now, using Dave's two test cases.

r+

Comment 7

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Landed in:
https://github.com/mozilla/b2gperf/commit/15039e1f5854b90ef71b8868a1eb66a0e257d585

Comment 8

[Dave Hunt [:davehunt] [he/him] ⌚BST]

Bumped version:
https://github.com/mozilla/b2gperf/commit/3813821a94efe7f521b7a61a49f688b3369d84eb

Released as:
https://pypi.python.org/pypi/b2gperf/0.30