Closed Bug 1425322 Opened 6 years ago Closed 5 years ago

[meta] Android emulator unit test modernization

Categories

(Firefox for Android Graveyard :: Testing, enhancement, P1)

Product:
Firefox for Android Graveyard
Component:
Testing
Platform:
x86
Android
Type:
enhancement

Tracking

(firefox59 affected)

Status:
RESOLVED WORKSFORME
Tracking Flags:
Tracking Status
firefox59 --- affected

People

(Reporter: gbrown, Assigned: gbrown)

References

(Blocks 1 open bug)

Details

(Keywords: meta) 

Our emulator unit tests currently run against Android 4.3 (or 4.2) using emulator binaries from the sdk circa api 18. There are various barriers to running tests in a modern environment, like Android 7.0. There are various  advantages to running tests in a modern environment (relevance, more features, potential performance improvements).
Depends on: 1425163
Depends on: 1410723
Depends on: 1424005
Depends on: 1285678
Depends on: 1415242
Depends on: 1425334
Depends on: 1425381
Depends on: 1425383
Depends on: 1425471
Priority: -- → P1
Blocks: 1428458
Depends on: 1370602, 1345972
Depends on: 1430176
Depends on: 1431433
Depends on: 1432848
Depends on: 1432598
Depends on: 1433308
Depends on: 1433279
Depends on: 1434411
Depends on: 1434423
Depends on: 1435031
Depends on: 1435058
Depends on: 1435079
Depends on: 1438351
Depends on: 1438665
Depends on: 1440098
See Also: → 1439570
Depends on: 1440714
Depends on: 1444246
Keywords: meta
OS: Unspecified → Android
Hardware: Unspecified → x86
Depends on: 1452652
Depends on: 1445716
Depends on: 1451930
Depends on: 1452694
Depends on: 1455485
Depends on: 1459351
Depends on: 1459732
Depends on: 1323620
Depends on: geckoview_mochitest
Depends on: 1460399
Depends on: 1462936
Depends on: 1463909
Depends on: 1462934
Depends on: 1465210
Depends on: 1479541
Depends on: 1498289
Depends on: 1495430
Depends on: 1498298
Depends on: 1489264
Depends on: 1498680
Depends on: 1498763
Depends on: 1500509
Depends on: 1473368
Depends on: 1509670
Depends on: 1509324

This bug has served its purpose, and tracked a lot of work in 2018. Today we have an android-em-7.0-x86 test platform with fast emulators on packet.net, and the android-hw-* test platforms for performance and special purpose testing on hardware. geckoview test apps are explicitly supported. We can even (finally!) run web-platform tests on android.

There's more to do -- greening more test suites, possibly reducing traditional aws emulator tests, etc. -- but we've done more than we set out to do - yeah!

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → WORKSFORME
Product: Firefox for Android → Firefox for Android Graveyard
You need to log in before you can comment on or make changes to this bug.