[Meta] Some "Android 4.0 debug" tests fail

NEW
Assigned to

Status

Release Engineering
General Automation
--
major
4 years ago
2 years ago

People

(Reporter: gbrown, Assigned: blassey)

Tracking

(Depends on: 3 bugs)

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

4 years ago
+++ This bug was initially created as a clone of Bug #866795 +++

We have tests running on Cedar for Android 4.0 debug builds and there is interest in running those tests on all trunk trees, but several tests fail frequently.

This meta bug tracks our efforts to turn this green:

https://tbpl.mozilla.org/?tree=Cedar&showall=1&jobname=android.*debug
(Reporter)

Updated

4 years ago
Blocks: 866795
(Reporter)

Updated

4 years ago
Depends on: 940080
(Reporter)

Updated

4 years ago
Depends on: 940087
(Assignee)

Updated

4 years ago
Assignee: nobody → blassey.bugs
(Reporter)

Updated

3 years ago
Depends on: 950824
(Reporter)

Updated

3 years ago
Depends on: 682129
(Reporter)

Comment 1

3 years ago
Bug 682129 is important here because most of the remaining failures are assertion failures, reported in the main log only as "Assertion count N is greater than expected range m-n assertions." The specific assertions have been reported in logcat, but the logcat buffer has been over-written before being dumped to the main log.
(Reporter)

Updated

3 years ago
Depends on: 960378
(Reporter)

Updated

3 years ago
Depends on: 962658
(Reporter)

Updated

3 years ago
Depends on: 962663
(Reporter)

Updated

3 years ago
Depends on: 962676
(Reporter)

Updated

3 years ago
Depends on: 962743
(Reporter)

Comment 2

3 years ago
(In reply to Geoff Brown [:gbrown] from comment #1)
> Bug 682129 is important here because most of the remaining failures are
> assertion failures, reported in the main log only as "Assertion count N is
> greater than expected range m-n assertions." The specific assertions have
> been reported in logcat, but the logcat buffer has been over-written before
> being dumped to the main log.

Complete logcats are available now. See http://gbrownmozilla.wordpress.com/2014/02/12/complete-logcats-for-android-tests/.
(Reporter)

Updated

3 years ago
Depends on: 977679
(Reporter)

Updated

3 years ago
Depends on: 974699
(Reporter)

Updated

3 years ago
No longer depends on: 682129
(Reporter)

Updated

3 years ago
Depends on: 982875
(Reporter)

Updated

3 years ago
Depends on: 1000995
(Reporter)

Updated

3 years ago
Depends on: 1008373
(Reporter)

Updated

3 years ago
Depends on: 1008423
(Reporter)

Updated

3 years ago
Depends on: 1008426
(Reporter)

Updated

3 years ago
Depends on: 1008433
(Reporter)

Comment 3

3 years ago
Android Debug test status:
 - mochitests (M1-M8) and js-reftests (J1-J3) are running on trunk
 - mochitest-gl has a consistent crash - bug 1008433
 - robocop has 2 consistent crashes - bug 1008423 and bug 1008426
 - crashtests have a few remaining assertion mismatches - bug 962676
 - we have not yet tried to run plain-reftests, xpcshell, or cppunit tests - bug 1008373
 - we would like to report assertions better - bug 1000995
(Reporter)

Updated

3 years ago
Depends on: 1019178
(Reporter)

Updated

3 years ago
Depends on: 1019192
(Reporter)

Updated

3 years ago
Depends on: 1019209
(Reporter)

Comment 4

2 years ago
Android 4.0 Debug xpcshell tests now run on trunk trees.
(Reporter)

Comment 5

2 years ago
We hope to start running Android Debug tests soon on the 4.3 emulator and retire the corresponding Android 4.0 Debug tests. Further efforts to resolve Android debug test failures might be better applied to Android 4.3, bug 1140454.
You need to log in before you can comment on or make changes to this bug.