Closed Bug 1611397 Opened 5 years ago Closed 5 years ago

Perma reference-browser raptor-webext-android Error: Exception launching org.mozilla.reference.browser.raptor

Categories

(Testing :: Raptor, defect, P1)

Product:
Testing
Component:
Raptor
Version:
Version 3
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: intermittent-bug-filer, Assigned: sparky)

Details

Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=286023252&repo=reference-browser
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/DRjmCQXjQCW9uumeBa-JlQ/runs/0/artifacts/public/logs/live_backing.log

This showed up after bug 1609754 got fixed.

[task 2020-01-23T00:39:11.158Z] 00:39:09 INFO - adb launch_application: am start -W -n org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity -a android.intent.action.MAIN -d about:blank
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell am start -W -n org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity -a android.intent.action.MAIN -d about:blank, timeout: None, root: False, timedout: None, exitcode: 0, output: Starting: Intent { act=android.intent.action.MAIN dat=about:blank cmp=org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity }
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - Error type 3
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - Error: Activity class {org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity} does not exist.
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb Starting: Intent { act=android.intent.action.MAIN dat=about:blank cmp=org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity }
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb Error type 3
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb Error: Activity class {org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity} does not exist.
[task 2020-01-23T00:39:11.158Z] 00:39:10 ERROR - raptor-webext-android Error: Exception launching org.mozilla.reference.browser.raptor
[task 2020-01-23T00:39:11.158Z] 00:39:10 CRITICAL - raptor-webext-android Error: Exception: ADBError launch_activity org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity failed
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - raptor-webext-android Info: removing reverse socket connections
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb command_output: adb -s ZY322MQ97M wait-for-device reverse --remove-all, timeout: None, timedout: None, exitcode: 0, output:
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - raptor-webext-android Info: skipping check_for_crashes: application has not been launched
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - raptor-webext Info: removing webext /builds/worker/workspace/build/tests/raptor/raptor/webextension/../../webext/raptor
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - raptor-webext-android Info: removing test folder for raptor: /sdcard/raptor
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell sync, timeout: None, root: False, timedout: None, exitcode: 0, output:
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell rm -r /sdcard/raptor, timeout: None, root: False, timedout: None, exitcode: 0, output:
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell sync, timeout: None, root: False, timedout: None, exitcode: 0, output:
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - adb shell_bool: adb -s ZY322MQ97M wait-for-device shell test -e /sdcard/raptor, timeout: None, root: False, timedout: None, exitcode: 1, output:
[task 2020-01-23T00:39:11.158Z] 00:39:10 INFO - raptor-control-server Info: shutting down control server
[task 2020-01-23T00:39:11.158Z] 00:39:11 INFO - raptor-webext Info: finished
[task 2020-01-23T00:39:11.158Z] 00:39:11 ERROR - Traceback (most recent call last):
[task 2020-01-23T00:39:11.158Z] 00:39:11 INFO - File "/builds/worker/workspace/build/tests/raptor/raptor/raptor.py", line 185, in <module>
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - main()
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - File "/builds/worker/workspace/build/tests/raptor/raptor/raptor.py", line 135, in main
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - File "/builds/worker/workspace/build/tests/raptor/raptor/webextension/android.py", line 187, in run_tests
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - return super(WebExtensionAndroid, self).run_tests(tests, test_names)
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - File "/builds/worker/workspace/build/tests/raptor/raptor/perftest.py", line 304, in run_tests
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - File "/builds/worker/workspace/build/tests/raptor/raptor/webextension/android.py", line 217, in run_test
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - self.__run_test_warm(test, timeout)
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - File "/builds/worker/workspace/build/tests/raptor/raptor/webextension/android.py", line 355, in __run_test_warm
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - self.launch_firefox_android_app(test["name"])
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - File "/builds/worker/workspace/build/tests/raptor/raptor/webextension/android.py", line 151, in launch_firefox_android_app
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - fail_if_running=False,
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/mozdevice/adb.py", line 3245, in launch_application
[task 2020-01-23T00:39:30.472Z] 00:39:11 CRITICAL - raise ADBError('launch_activity %s/%s failed' % (app_name, activity_name))
[task 2020-01-23T00:39:30.472Z] 00:39:11 CRITICAL - mozdevice.adb.ADBError: launch_activity org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity failed
[task 2020-01-23T00:39:30.472Z] 00:39:11 ERROR - Return code: 1
[task 2020-01-23T00:39:30.472Z] 00:39:11 WARNING - setting return code to 1
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - Killing logcat pid 593.
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - Copying Raptor results to upload dir:
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - /builds/worker/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - Copying raptor results from /builds/worker/workspace/build/raptor.json to /builds/worker/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2020-01-23T00:39:30.472Z] 00:39:11 CRITICAL - Error copying results /builds/worker/workspace/build/raptor.json to upload dir /builds/worker/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - [Errno 2] No such file or directory: u'/builds/worker/workspace/build/raptor.json'
[task 2020-01-23T00:39:30.472Z] 00:39:11 INFO - return code 1 changed to 4 due to log output
[task 2020-01-23T00:39:30.472Z] 00:39:11 WARNING - setting return code to 4

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INCOMPLETE

Who is responsible for fixing this: perf or mobile/geckoview/reference-browser?

Status: RESOLVED → REOPENED
Flags: needinfo?(dave.hunt)
Keywords: intermittent-failure
Resolution: INCOMPLETE → ---

Did anyone check the adb logcat output yet what's causing this problem?

The nightly reference browser smoke tests are passing [1], so this is likely an issue with the GitHub->TaskCluster integration [2]. It looks like we're currently only running the Speedometer benchmark against Reference Browser. I'm not sure if these are being monitored, or if they're still considered valuable. Perhaps we can disable these?

[1] https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&selectedJob=290303996&tier=1%2C2%2C3&searchStr=Rap-refbrow
[2] https://github.com/mozilla-mobile/reference-browser/blob/cee6d21b7843466484ba911627c1a972e6da688f/taskcluster/ci/raptor/kind.yml

Flags: needinfo?(dave.hunt) → needinfo?(s.kaspari)

Switching needinfo to :csadilek by suggestion from :pocmo

Flags: needinfo?(s.kaspari) → needinfo?(csadilek)

Looking at the logs above, I agree with :davehunt that this is a TC integration issue. Raptor is being started with the wrong activity. It is currently started for GeckoViewActivity which only exists in GeckoViewExample, not Reference Browser.

The activity to use for reference browser is BrowserTestActivity:
https://github.com/mozilla-mobile/reference-browser/blob/master/app/src/main/java/org/mozilla/reference/browser/BrowserTestActivity.kt

Relevant line from the logs:

[task 2020-01-23T00:39:30.472Z] 00:39:11 CRITICAL - mozdevice.adb.ADBError: launch_activity org.mozilla.reference.browser.raptor/org.mozilla.reference.browser.GeckoViewActivity failed
Flags: needinfo?(csadilek)

Wait the problem is in the Taskcluster config:

https://github.com/mozilla-mobile/reference-browser/blob/cee6d21b7843466484ba911627c1a972e6da688f/taskcluster/ci/raptor/kind.yml#L70

Greg, can you please fix that?

Flags: needinfo?(gmierz2)

Yup, I'll start a PR for it.

Assignee: nobody → gmierz2
Status: REOPENED → ASSIGNED
Flags: needinfo?(gmierz2)
Priority: P5 → P1
Flags: needinfo?(gmierz2)
Status: ASSIGNED → RESOLVED
Closed: 5 years ago → 5 years ago
Flags: needinfo?(gmierz2)
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.