1601009 - Add support to raptor-browsertime for running the speedometer benchmark on Firefox android

Status: RESOLVED FIXED

(Testing :: Raptor, enhancement, P3)

Comment 1

[Florin Strugariu [:Bebe]]

Attachment: Bug 1601009 - Add support to raptor-browsertime for running the speedometer benchmark on Firefox android

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c1b764e0ddb3
Add support to raptor-browsertime for running the speedometer benchmark on Firefox android r=tarek

Comment 3

[Cosmin Sabou [:CosminS]]

Backed out changeset c1b764e0ddb3 (Bug 1601009) for massive raptor failures.

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception&fromchange=c1b764e0ddb311109436603c252cc0f556831843&tochange=3bcf437014eeb859253e928e36b4384475ecb259&searchStr=raptor&selectedJob=287424716

Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=287424716&repo=autoland

Backout link: https://hg.mozilla.org/integration/autoland/rev/3bcf437014eeb859253e928e36b4384475ecb259

[task 2020-02-04T10:14:04.929Z] 10:14:04 INFO - raptor-mitmproxy Info: Turning off the browser proxy
[task 2020-02-04T10:14:04.929Z] 10:14:04 INFO - raptor-mitmproxy Info: writing: /home/cltbld/tasks/task_1580811196/build/application/firefox/distribution/policies.json
[task 2020-02-04T10:14:04.929Z] 10:14:04 INFO - raptor-webext Info: raptor webext not installed - not attempting removal
[task 2020-02-04T10:14:04.930Z] 10:14:04 INFO - raptor-control-server Info: shutting down control server
[task 2020-02-04T10:14:05.156Z] 10:14:05 INFO - raptor-webext Info: finished
[task 2020-02-04T10:14:05.156Z] 10:14:05 ERROR - Traceback (most recent call last):
[task 2020-02-04T10:14:05.156Z] 10:14:05 INFO - File "/home/cltbld/tasks/task_1580811196/build/tests/raptor/raptor/raptor.py", line 185, in <module>
[task 2020-02-04T10:14:05.156Z] 10:14:05 INFO - main()
[task 2020-02-04T10:14:05.156Z] 10:14:05 INFO - File "/home/cltbld/tasks/task_1580811196/build/tests/raptor/raptor/raptor.py", line 135, in main
[task 2020-02-04T10:14:05.156Z] 10:14:05 INFO - success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2020-02-04T10:14:05.157Z] 10:14:05 INFO - File "/home/cltbld/tasks/task_1580811196/build/tests/raptor/raptor/perftest.py", line 307, in run_tests
[task 2020-02-04T10:14:05.157Z] 10:14:05 INFO - self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2020-02-04T10:14:05.157Z] 10:14:05 INFO - File "/home/cltbld/tasks/task_1580811196/build/tests/raptor/raptor/webextension/desktop.py", line 91, in run_test
[task 2020-02-04T10:14:05.157Z] 10:14:05 INFO - self.__run_test_cold(test, timeout)
[task 2020-02-04T10:14:05.157Z] 10:14:05 INFO - File "/home/cltbld/tasks/task_1580811196/build/tests/raptor/raptor/webextension/desktop.py", line 144, in __run_test_cold
[task 2020-02-04T10:14:05.158Z] 10:14:05 INFO - self.run_test_setup(test)
[task 2020-02-04T10:14:05.158Z] 10:14:05 INFO - File "/home/cltbld/tasks/task_1580811196/build/tests/raptor/raptor/webextension/base.py", line 69, in run_test_setup
[task 2020-02-04T10:14:05.158Z] 10:14:05 INFO - b_port=int(self.benchmark.port),
[task 2020-02-04T10:14:05.158Z] 10:14:05 INFO - AttributeError: 'NoneType' object has no attribute 'port'
[task 2020-02-04T10:14:05.187Z] 10:14:05 ERROR - Return code: 1
[task 2020-02-04T10:14:05.187Z] 10:14:05 WARNING - setting return code to 1
[task 2020-02-04T10:14:05.187Z] 10:14:05 INFO - Copying Raptor results to upload dir:
[task 2020-02-04T10:14:05.187Z] 10:14:05 INFO - /home/cltbld/tasks/task_1580811196/build/blobber_upload_dir/perfherder-data.json

Comment 4

[Florin Strugariu [:Bebe]]

Patch updated.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e9ff6095ca5a
Add support to raptor-browsertime for running the speedometer benchmark on Firefox android r=tarek

Comment 6

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/e9ff6095ca5a