649690 - Tegra Debug build reftests, crashtests

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P4)

Description

[Martijn Wargers (dead)]

From bug 643607, comment 18 and 19:
"
It was mentioned on the meeting today (
https://wiki.mozilla.org/Mobile/Notes/13-Apr-2011#Test_Automation ), that the
JS team would like to have debug builds tested on the tegra boards, testing js
tests/js reftests.
Mfinkle mentioned that you should be able to get to the logcat output , because
there is no other way to get the stdout.

Perhaps a new bug be filed for this, Aki?
"
Aki:
"
We have bug 581290 for debug builds.
And sure, we need a bug for debug build tests.
"

Comment 1

[Aki Sasaki (not active)]

[11:13]	<bmoss>	ok, so assuming the run doesn't cause the log file to rotate we could do an 'exec su -c "logcat -d" ' and put that output into a file
[11:14]	<aki>	after the test run?
[11:14]	<bmoss>	kinda like calling cat
[11:14]	<bmoss>	yes after the run

Comment 2

[Aki Sasaki (not active)]

http://developer.android.com/guide/developing/tools/adb.html#logcat

Comment 3

[Aki Sasaki (not active)]

Attachment: enable debug reftests/crashtests

I need to investigate the logcat + do some testing.
But this passes test_masters and I see the debug test builders in dump_masters.

Comment 4

[Aki Sasaki (not active)]

I'm running these tests now.

* They're running!
* Crashtests have 29 test fails (1893/29/45) so orange.
* Reftests are still running in staging.

Would it help to enable these without having the full logcat, or are they useless without that?

Asking because we can enable them very soon, or we can leave 'em off until we have more ability to get stdout. Not sure how long that will take but I suspect it won't be perfect in the near future.

Comment 5

[Aki Sasaki (not active)]

Per the mobile meeting,

* running these without logcat will be useful, so turn them on now
* m-c only til they're no longer perma-orange.

I will rescope the patch for review.

Comment 6

[Aki Sasaki (not active)]

Attachment: android debug tests for m-c and try

This makes enable_opt_unittests true by default and cleans up some related cruft.
(have to turn it back off on devtools to pass test-masters.)

It also adds the debug unittests, off by default, and enables them on Try and m-c.

Comment 7

[Aki Sasaki (not active)]

Comment on attachment 555558 [details] [diff] [review]
android debug tests for m-c and try

http://hg.mozilla.org/build/buildbot-configs/rev/2c7565040114

Comment 8

[Aki Sasaki (not active)]

These are now on in m-c and Try.
I'll file a followup bug to add logcat to debug tegra unittests, but this isn't an easy ask so may take a while.
Once these tests are no longer perma-orange, we can enable them on all branches.