962743 - Full logcat for Android 4.0 tests

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Geoff Brown [:gbrown]]

Once the solution for full logcats for Android x86 is proven, I want to look at doing the same thing for Android 4.0 / Panda tests. This will be especially useful for resolving failures in Android 4.0 Debug tests.

Comment 1

[Geoff Brown [:gbrown]]

Attachment: (1) 'adb logcat' replacement using sut

Full logcats for Android x86 have proven useful and reliable. For Android x86, we launch "adb logcat" for the duration of a test job, redirecting output to the blobber upload directory. For Pandas, we don't use adb, so here's a replacement for "adb logcat", in the form of a python script that issues devicemanagerSUT commands. 

Running logcat is easy: Basically just "exec logcat", redirecting output to a specified file. 

Cleanup is slightly complicated. logcat.py provides for 2 ways of ending:
 - being signalled via SIGINT
 - timeout after 1 hour
In either case, we "clean up", which basically means killing the remote logcat process. (I expect this is going to happen at the end of a test job, just before the device is rebooted, but I want to avoid an accumulation of logcat processes in case the device is not rebooted, or logcat.py is being used in some unanticipated way.) 

Killing the remote process is complicated because most devicemanager / sutagent process operations only work on Android applications, like org.mozilla.fennec, but not on native processes, like logcat. We need to exec ps, parse its output to find the logcat pid, and then exec kill to end the logcat process.

This works fine for me in local testing on Pandaboards and phones.

Comment 2

[Geoff Brown [:gbrown]]

Attachment: (2) use logcat.py to collect logcats during panda test jobs

I don't have a convenient way to test this. I'd like to land (1) and then test on ash.

Comment 3

[Geoff Brown [:gbrown]]

(1) https://hg.mozilla.org/build/tools/rev/980f7e6b6920

Comment 4

[Geoff Brown [:gbrown]]

Attachment: (3) cleanup logcat.py if necessary in checkStalled

Patch (2) kills logcat.py when the tests finish, but if that doesn't happen for some reason, this update to checkStalled should clean up any left-over "python -u logcat.py <ip> ..." processes.

Comment 5

[Geoff Brown [:gbrown]]

(3) https://hg.mozilla.org/build/tools/rev/bf6a10e61e4f

Comment 6

[Geoff Brown [:gbrown]]

Successful trial of patch (2) at https://tbpl.mozilla.org/?tree=Ash&rev=53bb6beeb1dc.

Comment 7

[Geoff Brown [:gbrown]]

(2) https://hg.mozilla.org/build/mozharness/rev/259573a46acd

Comment 8

[Armen [:armenzg]]

Mozharness change live in production.

Comment 9

[Geoff Brown [:gbrown]]

All looks fine to me. 

Armen, Justin - thanks for your help!