Investigate running packet.net-based Android emulator unit tests against x86-64 build
Categories
(Testing :: General, enhancement, P3)
Tracking
(firefox-esr60 wontfix, firefox65 wontfix, firefox66 wontfix, firefox67 fixed)
People
(Reporter: gbrown, Assigned: gbrown)
References
Details
(Whiteboard: [geckoview:p2])
Attachments
(2 files, 1 obsolete file)
5.20 KB,
patch
|
gbrown
:
review+
|
Details | Diff | Splinter Review |
6.32 KB,
patch
|
jmaher
:
review+
snorp
:
feedback+
cpeterson
:
feedback+
|
Details | Diff | Splinter Review |
Assignee | ||
Updated•6 years ago
|
Assignee | ||
Comment 1•6 years ago
|
||
Assignee | ||
Comment 2•6 years ago
|
||
Assignee | ||
Updated•6 years ago
|
Assignee | ||
Updated•6 years ago
|
Updated•6 years ago
|
Updated•6 years ago
|
Assignee | ||
Comment 3•6 years ago
|
||
Assignee | ||
Comment 4•6 years ago
|
||
Assignee | ||
Comment 5•6 years ago
|
||
Assignee | ||
Comment 7•6 years ago
|
||
Comment 8•6 years ago
|
||
bugherder |
Assignee | ||
Updated•6 years ago
|
Updated•6 years ago
|
Assignee | ||
Comment 9•6 years ago
|
||
Assignee | ||
Comment 10•6 years ago
|
||
Comment 9 is good news indeed: crashtests run green on opt and debug; jsreftests run green on opt.
Comment 11•6 years ago
|
||
(In reply to Geoff Brown [:gbrown] from comment #10)
Comment 9 is good news indeed: crashtests run green on opt and debug; jsreftests run green on opt.
If I'm reading Treeherder correctly, are the results reversed? It looks like the crashtests (C) are green on opt but orange on debug and the jsreftests (J1-J8) are green on both opt and debug.
I filed bug 1524493 for the debug crashtest failure.
Assignee | ||
Comment 12•6 years ago
|
||
(In reply to Chris Peterson [:cpeterson] from comment #11)
(In reply to Geoff Brown [:gbrown] from comment #10)
Comment 9 is good news indeed: crashtests run green on opt and debug; jsreftests run green on opt.
If I'm reading Treeherder correctly, are the results reversed? It looks like the crashtests (C) are green on opt but orange on debug and the jsreftests (J1-J8) are green on both opt and debug.
Yes, that's correct. Thanks!
Assignee | ||
Comment 13•6 years ago
|
||
Let's do this:
- stop running x86/opt mochitest-cl, mochitest-gpu, crashtest, jsreftest, geckoview-junit
- start running x86_64/opt mochitest-cl, mochitest-gpu, crashtest, jsreftest, geckoview-junit
- start running x86_64/debug mochitest-cl, mochitest-gpu, jsreftest
- no /debug crashtests until at least bug 1524493 is resolved
- no /debug geckoview-junit, and geckoview-junit runs tier 3, until at least bug 1521195 is resolved
- web-platform tests remain on x86 for now; perhaps move them to x86_64 when they can run on geckoview
- treeherder labels for x86_64 will be tidied up in bug 1524693
Comment 14•6 years ago
|
||
Comment 16•6 years ago
|
||
Assignee | ||
Comment 17•6 years ago
|
||
(In reply to Chris Peterson [:cpeterso
So the only tests that will still be running on Android x86 will be the
web-platform-tests?
Correct!
Comment 18•6 years ago
|
||
Comment 19•6 years ago
|
||
(In reply to Joel Maher ( :jmaher ) (UTC-4) from comment #18)
do we get any real value from jsreftests on android 4.3 arm? this seems
like a very expensive cost and I would question the use of it. but
unrelated to this bug!
@ Sean, how important are the jsreftests compared to the jit-tests?
On our Google Pixel 2 test devices, we currently run the jit-tests (for both ARMv7 and ARM64 Gecko builds) but not jsreftests.
On our Android ARMv7 emulator, we currently run jsreftests but not jit-tests.
Assignee | ||
Comment 20•6 years ago
|
||
(In reply to Joel Maher ( :jmaher ) (UTC-4) from comment #18)
do we get any real value from jsreftests on android 4.3 arm? this seems
like a very expensive cost and I would question the use of it. but
unrelated to this bug!
We're scheduled to consider turning off Android 4.3 jsreftests once this bug is resolved and we have seen a few days of x86_64 results; will pursue that in bug 1473368.
::: taskcluster/ci/test/test-sets.yml
@@ +389,3 @@# - mochitest-webgl1-core # - reftest # - test-verify
why are these commented out? waiting on greening up? I was under the
impression these would be running on opt/debug.
Yes, waiting on greening up. Most of that work is tracked in bug 1460411.
Comment 21•6 years ago
|
||
Comment 22•6 years ago
|
||
bugherder |
Updated•2 years ago
|
Description
•