Closed Bug 1548008 Opened 5 months ago Closed 5 months ago

Permafailing tier2 AttributeError: 'RaptorAndroid' object has no attribute 'device_profile'

Categories

(Testing :: Raptor, defect, P5)

Version 3
defect

Tracking

(firefox-esr60 unaffected, firefox66 unaffected, firefox67 unaffected, firefox68 fixed)

RESOLVED FIXED
mozilla68
Tracking Status
firefox-esr60 --- unaffected
firefox66 --- unaffected
firefox67 --- unaffected
firefox68 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: aerickson)

References

Details

(Keywords: intermittent-failure, regression)

Attachments

(1 file)

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=243623448&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/CHrTQSa8SNutaEtspkdgcA/runs/0/artifacts/public/logs/live_backing.log


14:23:45 INFO - adb command_output: adb -s ZY322MQ8RN wait-for-device reverse --remove-all, timeout: None, timedout: None, exitcode: 0, output:
14:23:45 INFO - raptor-control-server shutting down control server
14:23:45 INFO - raptor-main finished
14:23:45 ERROR - Traceback (most recent call last):
14:23:45 INFO - File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 964, in <module>
14:23:45 INFO - main()
14:23:45 INFO - File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 927, in main
14:23:45 INFO - raptor.run_test(next_test, timeout=int(next_test['page_timeout']))
14:23:45 INFO - File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 714, in run_test
14:23:45 INFO - self.run_test_teardown()
14:23:45 INFO - File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 180, in run_test_teardown
14:23:45 INFO - self.check_for_crashes()
14:23:45 INFO - File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 850, in check_for_crashes
14:23:45 INFO - remote_dir = posixpath.join(self.device_profile, 'minidumps')
14:23:45 INFO - AttributeError: 'RaptorAndroid' object has no attribute 'device_profile'
14:23:45 ERROR - Return code: 1
14:23:45 WARNING - setting return code to 1
14:23:45 INFO - Killing logcat pid 468.
14:23:45 CRITICAL - PERFHERDER_DATA was seen 0 times, expected 1.
14:23:45 INFO - copying raptor results to upload dir:
14:23:45 INFO - /builds/task_1556634133/workspace/build/blobber_upload_dir/perfherder-data.json
14:23:45 INFO - copying raptor results from /builds/task_1556634133/workspace/build/raptor.json to /builds/task_1556634133/workspace/build/blobber_upload_dir/perfherder-data.json
14:23:45 CRITICAL - Error copying results /builds/task_1556634133/workspace/build/raptor.json to upload dir /builds/task_1556634133/workspace/build/blobber_upload_dir/perfherder-data.json

Maybe regressed by bug 1547069? (I don't see how.)

17:41:04 INFO - mozproxy INFO - Attempting to fetch from 'https://tooltool.mozilla-releng.net/'...
17:41:11 INFO - mozproxy INFO - File host-utils-68.0a1.en-US.linux-x86_64.tar.gz fetched from https://tooltool.mozilla-releng.net/ as /builds/task_1556645985/workspace/testing/mozproxy/tmpejhaxG
17:41:12 INFO - mozproxy INFO - File integrity verified, renaming tmpejhaxG to host-utils-68.0a1.en-US.linux-x86_64.tar.gz
17:41:12 INFO - mozproxy INFO - Updating local cache /builds/tooltool_cache...
17:41:12 INFO - mozproxy INFO - Local cache /builds/tooltool_cache updated with host-utils-68.0a1.en-US.linux-x86_64.tar.gz
17:41:12 INFO - mozproxy INFO - untarring "host-utils-68.0a1.en-US.linux-x86_64.tar.gz"
17:41:13 INFO - mozproxy unable to find certutil at /builds/task_1556645985/workspace/testing/mozproxy/host-utils-68.0a1.en-US.linux-x86_64.checksum/certutil
17:41:13 INFO - mozproxy Stopping mitmproxy playback, killing process 560

Flags: needinfo?(rwood)

midair

4:23:45     INFO -  mozproxy unable to find certutil at /builds/task_1556634133/workspace/testing/mozproxy/host-utils-68.0a1.en-US.linux-x86_64.checksum/certutil
14:23:45     INFO -  mozproxy Stopping mitmproxy playback, killing process 562
14:23:45     INFO -  mozproxy Successfully killed the mitmproxy playback process
14:23:45     INFO -  raptor-main removing reverse socket connections
14:23:45     INFO -  adb command_output: adb -s ZY322MQ8RN wait-for-device reverse --remove-all, timeout: None, timedout: None, exitcode: 0, output:
14:23:45     INFO -  raptor-control-server shutting down control server
14:23:45     INFO -  raptor-main finished
14:23:45    ERROR -  Traceback (most recent call last):
14:23:45     INFO -    File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 964, in <module>
14:23:45     INFO -      main()
14:23:45     INFO -    File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 927, in main
14:23:45     INFO -      raptor.run_test(next_test, timeout=int(next_test['page_timeout']))
14:23:45     INFO -    File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 714, in run_test
14:23:45     INFO -      self.run_test_teardown()
14:23:45     INFO -    File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 180, in run_test_teardown
14:23:45     INFO -      self.check_for_crashes()
14:23:45     INFO -    File "/builds/task_1556634133/workspace/build/tests/raptor/raptor/raptor.py", line 850, in check_for_crashes
14:23:45     INFO -      remote_dir = posixpath.join(self.device_profile, 'minidumps')
14:23:45     INFO -  AttributeError: 'RaptorAndroid' object has no attribute 'device_profile'

The test is shutting down after the certutil failure but it hasn't initialized the profile.

I don't know why it is looking for /builds/task_1556634133/workspace/testing/mozproxy/host-utils-68.0a1.en-US.linux-x86_64.checksum/certutil. aerickson: Do you have any idea of what is going on here? certutil is in the host utils tar ball, just not under directory called host-utils-68.0a1.en-US.linux-x86_64.checksum.

The real error is the certutil issue. Of course, Raptor should gracefully handle the case where the device wasn't completely initialized.

Flags: needinfo?(aerickson)

It is possible to be affected by bug 1533330 but I am not 100% sure about it.

It's the only thing related to tooltool that can affect it and has been pushed to all trees.

Central

https://hg.mozilla.org/mozilla-central/pushloghtml?changeset=626ad97710e3

Inbound

https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?changeset=626ad97710e3

Autoland

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=626ad97710e3

It's a glob failure. Not sure why the checksum file is being created now. I recently changed the version of tooltool to an in-tree one - perhaps that did it.

testing/mozbase/mozproxy/mozproxy/backends/mitm.py
434: os.path.join(self.mozproxy_dir, "host-utils*[!z]")

I'll work on a fix.

Assignee: nobody → aerickson
Status: NEW → ASSIGNED
Flags: needinfo?(aerickson)
Attachment #9061729 - Attachment description: Bug 1548008: fix glob → Bug 1548008: update glob used to find host-utils in mozproxy
Keywords: checkin-needed

Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/bb6e8015f975
update glob used to find host-utils in mozproxy r=gbrown

Keywords: checkin-needed
Status: ASSIGNED → RESOLVED
Closed: 5 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68

...for a different reason:

23:53:46 INFO - certutil: function failed: SEC_ERROR_BAD_DATABASE: security library: bad database.

Flags: needinfo?(aerickson)
See Also: → 1551064
You need to log in before you can comment on or make changes to this bug.