[Meta] Some "Android 4.0 debug" tests fail

NEW
Assigned to

Status

Release Engineering
General Automation
--
major
4 years ago
2 years ago

People

(Reporter: gbrown, Assigned: blassey)

Tracking

(Depends on: 3 bugs)

Firefox Tracking Flags

(Not tracked)

Details

+++ This bug was initially created as a clone of Bug #866795 +++

We have tests running on Cedar for Android 4.0 debug builds and there is interest in running those tests on all trunk trees, but several tests fail frequently.

This meta bug tracks our efforts to turn this green:

https://tbpl.mozilla.org/?tree=Cedar&showall=1&jobname=android.*debug
Blocks: 866795
Depends on: 940080
Depends on: 940087
(Assignee)

Updated

4 years ago
Assignee: nobody → blassey.bugs
Depends on: 950824
Depends on: 682129
Bug 682129 is important here because most of the remaining failures are assertion failures, reported in the main log only as "Assertion count N is greater than expected range m-n assertions." The specific assertions have been reported in logcat, but the logcat buffer has been over-written before being dumped to the main log.
Depends on: 960378
Depends on: 962658
Depends on: 962663
Depends on: 962676
Depends on: 962743
(In reply to Geoff Brown [:gbrown] from comment #1)
> Bug 682129 is important here because most of the remaining failures are
> assertion failures, reported in the main log only as "Assertion count N is
> greater than expected range m-n assertions." The specific assertions have
> been reported in logcat, but the logcat buffer has been over-written before
> being dumped to the main log.

Complete logcats are available now. See http://gbrownmozilla.wordpress.com/2014/02/12/complete-logcats-for-android-tests/.
Depends on: 977679
Depends on: 974699
No longer depends on: 682129
Depends on: 982875
Depends on: 1000995
Depends on: 1008373
Depends on: 1008423
Depends on: 1008426
Depends on: 1008433
Android Debug test status:
 - mochitests (M1-M8) and js-reftests (J1-J3) are running on trunk
 - mochitest-gl has a consistent crash - bug 1008433
 - robocop has 2 consistent crashes - bug 1008423 and bug 1008426
 - crashtests have a few remaining assertion mismatches - bug 962676
 - we have not yet tried to run plain-reftests, xpcshell, or cppunit tests - bug 1008373
 - we would like to report assertions better - bug 1000995
Depends on: 1019178
Depends on: 1019192
Depends on: 1019209
Android 4.0 Debug xpcshell tests now run on trunk trees.
We hope to start running Android Debug tests soon on the 4.3 emulator and retire the corresponding Android 4.0 Debug tests. Further efforts to resolve Android debug test failures might be better applied to Android 4.3, bug 1140454.
You need to log in before you can comment on or make changes to this bug.