Closed Bug 725544 (android_4.0_testing) Opened 9 years ago Closed 7 years ago

[tracking bug] Android 4.0 testing

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task, P4)

x86
Android

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: armenzg, Unassigned)

References

Details

We're looking on having panda boards to be doing Android 4.0 testing.

We will be having requirements gathered in this wiki page (wip):
https://wiki.mozilla.org/ReleaseEngineering/Projects/PandaBoards
We're not ready to be getting rid of the foppies setup but to be able to scale we will be switching to do them with Linux VMs - bug 725534.
We might have to live with both mini and Linux foopies for now.
Depends on: 725534
Alias: android_4.0_testing
Assignee: nobody → armenzg
Depends on: 725844
Depends on: 725845
Depends on: 725846
Depends on: 725859
Depends on: 726176
From https://wiki.mozilla.org/Mobile/Testing/02_15_12#Panda_Boards

ctalbert/jmaher/wlach - have had minimal luck getting pandaboards to boot and run tests (mochitest and reftest samples so far). ctalbert and jmaher can't even get an image to boot.
* require proper power supply
* requiring building from tip of ICS
* require panda video driver
* possibly require specific type(s) of sdcard 

concerns:
* the boards sometimes become unstable (much more than the tegras)
* armenzg: do we have an alternative to the panda boards?
** blassey: no fallback plan
Depends on: 731669
Depends on: 731670
Depends on: 731694
From: https://wiki.mozilla.org/Mobile/Testing/02_29_12#Panda_Boards
* [P1] [NEW]: bug 731669 (ctalbert) we can't reboot a panda board without using a PDU to reboot it
** hopefully the ES boards make things better 
** jmaher does not hit this issue
* [P1] [NEW]: bug 731670 (ctalbert) MAC address gets re-created on every reboot
*high enough screen resolution
** are there more details about this? 
* [P1] [DONE] bug 729323 - board racked on haxxor for releng to mess with
** armenzg to verify that I can reach the board 
* [P1] [DONE] bug 725846 - 8 boards have been received
* [P2] [DONE]: bug 725859 - document process for re-imaging and remote re-imaging

concerns:
* IT is concerned about not having remote re-imaging
* the boards sometimes become unstable (much more than the tegras)
** each a-team member has a different experience on how to make things work
** hopefully the ES boards make things better 
* armenzg: do we have an alternative to the panda boards?
** blassey: no fallback plan
changing priority just to make "my bugs" assigned easier to look at.
Priority: P3 → P4
Found a problem with installing stuff on Android ICS which will affect the pandaboards. Already fixed, but we'll need to be sure to use a new sutagent.
Depends on: 753484
No longer blocks: 759221
Depends on: 759221
No longer depends on: 759221
Depends on: 764534
(In reply to William Lachance (:wlach) from comment #6)
> Found a problem with installing stuff on Android ICS which will affect the
> pandaboards. Already fixed, but we'll need to be sure to use a new sutagent.

Is that change already on SUT agent 1.09?
yes, this change will be in 1.09
Depends on: 769429
We will need to fix bug 763497 (or come up with a workaround), otherwise the logcat code won't work with the Panda. My inclination is just to fix.
Depends on: 763497
Depends on: 772967
Depends on: 769428
Depends on: 777359
No longer depends on: 763497
No longer depends on: 772967
No longer depends on: 776728
Depends on: 777466
Watcher needs a new permission to work properly with ICS.
Depends on: 777891
Depends on: 778733
No longer depends on: 777359
No longer depends on: 764534
No longer depends on: 725845
No longer depends on: 769428
No longer depends on: 777466
Depends on: 767447
Depends on: 779949
No longer depends on: b2g-testing-track
Depends on: 799922
Depends on: 800047
Depends on: 811444
Depends on: 815726
Depends on: 815647
Depends on: 809367
Depends on: 786414
Depends on: 816675
Depends on: 820824
Depends on: 820825
Depends on: 820826
Depends on: 820827
Depends on: 820828
Depends on: 803685
Depends on: 816694
Depends on: 821370
Depends on: 819545
Depends on: 822248
Depends on: 822280
Depends on: 822321
Depends on: 822775
Depends on: 822782
Depends on: 822796
Depends on: 822802
Depends on: 823532
Depends on: 711725
Depends on: 824766
Depends on: 824767
Depends on: 824769
Depends on: 824770
Depends on: 824764
Assignee: armenzg → nobody
Depends on: 803248
Component: Release Engineering → Release Engineering: Platform Support
QA Contact: coop
I've just been reviewing what's hidden on TBPL for Android on Panda:

* mozilla-central:
mochitest-1
mochitest-2
plain-reftest-1
plain-reftest-2
plain-reftest-3
plain-reftest-4
robocop
trobocheck
trobocheck-2

* mozilla-inbound:
(same as mozill-central)

* try:
mochitest-1
mochitest-2
plain-reftest-1
plain-reftest-2
plain-reftest-3
plain-reftest-4
robocop

Look at the results for some of these hidden runs...

* mochitest-2 looks green to me:
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&noignore=1&jobname=Android%204.0%20Panda%20mozilla-inbound%20opt%20test%20mochitest-2

* trobocheck$ (not trobocheck2) also looking green:
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&noignore=1&jobname=Android%204.0%20Panda%20mozilla-inbound%20talos%20remote-trobocheck

* mochitest-1 is indeed orange (presume bug 781792):
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&noignore=1&jobname=Android%204.0%20Panda%20mozilla-inbound%20opt%20test%20mochitest-1

* robocop also orange (can't find a bug on this):
https://tbpl.mozilla.org/?tree=Mozilla-Inbound&noignore=1&jobname=Android%204.0%20Panda%20mozilla-inbound%20opt%20test%20robocop

* reftest1-4:
No longer being run.

As such, I have:
* Unhidden mochtitest-2 + trobocheck[^2] on m-c, inbound and try
* Hidden trobocheck2 on Try, to bring it in sync with the other trees
s/Look/Looking/
bug#860028 is expected to reduce intermittent errors.
Depends on: 860028
No longer depends on: 803685
Product: mozilla.org → Release Engineering
Panda's have been running Android 4.0 tests in production for months now, despite the few dependancies I think this has outlived its usefulness.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Component: Platform Support → Buildduty
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.