923881 - Shut off androidx86 tests until we have an emulator whose behavior we trust

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Phil Ringnalda (:philor)]

This bug is supposed to depend on a bug that nobody seems to be filing, about something something somehow get an androidx86 emulator whose behavior we trust because it has the QEMU patch mentioned in bug 917562 comment 24, but nobody seems to be filing that, and I'm sick of having to be the only one starring the results of testing on a broken emulator.

Please shut off all androidx86 tests on every tree except whichever one that was where they were in theory being greened up, until they run on something we can trust. The current results are completely useless, I just star everything as "bad emulator".

Comment 1

[Armen [:armenzg]]

Attachment: disable android x86 across the board except Cedar and Ash

I agree.

Comment 2

[Armen [:armenzg]]

gbrown: do you agree? I would like to spare sheriffs having to report any issues with Android x86 until we have things running reliably (in particular the QEMU issue).

Comment 3

[Phil Ringnalda (:philor)]

Comment on attachment 814151 [details] [diff] [review]
disable android x86 across the board except Cedar and Ash

Only Ash instead of Only Cedar and Ash is fine by me, but it looks like while Ash is setting enable_opt_unittests to true, Cedar is not. Unless, of course, it hides its magic somewhere other than project_branches.py.

Comment 4

[Armen [:armenzg]]

They're here:
http://hg.mozilla.org/build/buildbot-configs/file/default/mozilla-tests/mobile_config.py#l1085

I guess it should have been put in project_branches.py. *sigh* me

Comment 5

[Geoff Brown [:gbrown]]

(In reply to Armen Zambrano [:armenzg] (Release Engineering) (EDT/UTC-4) from comment #2)
> gbrown: do you agree? I would like to spare sheriffs having to report any
> issues with Android x86 until we have things running reliably (in particular
> the QEMU issue).

Yes -- fine with me. There's certainly more work to do before we get clean runs. As long as we can still see results on Cedar or Ash, I can work efficiently.

Comment 6

[Armen [:armenzg]]

Comment on attachment 814151 [details] [diff] [review]
disable android x86 across the board except Cedar and Ash

https://hg.mozilla.org/build/buildbot-configs/rev/b8b393cba54e

Comment 7

[John Hopkins (:jhopkins)]

in production

Comment 8

[Armen [:armenzg]]

Attachment: re-enable Android x86 on Cedar

philor had the right suspicion about this.
I have verified that this patch adds the Cedar builders back.

Sorry about this!

Comment 9

[John Hopkins (:jhopkins)]

Comment on attachment 816052 [details] [diff] [review]
re-enable Android x86 on Cedar

dump_masters output is the same with and without this patch.  Are you sure it does what you want?

Comment 10

[Armen [:armenzg]]

Comment on attachment 816052 [details] [diff] [review]
re-enable Android x86 on Cedar

I've mentioned on my previous comment that I had verified that the patch works.

~/repos/releng/braindump/buildbot-related/builder_list.py master.cfg > list_builders.new.txt
hg up -C
~/repos/releng/braindump/buildbot-related/builder_list.py master.cfg > list_builders.old.txt
diff -pU 2 list_builders.old.txt list_builders.new.txt 
--- list_builders.old.txt       2013-10-15 14:04:04.000000000 -0400
+++ list_builders.new.txt       2013-10-15 14:15:42.000000000 -0400
@@ -4103,4 +4103,12 @@ b2g_emulator mozilla-inbound opt test re
 b2g_emulator mozilla-inbound opt test reftest-10 ScriptFactory
 b2g_emulator mozilla-inbound opt test marionette-webapi ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-1 ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-2 ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-3 ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-4 ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-5 ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-6 ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-7 ScriptFactory
+Android 4.2 x86 Emulator cedar opt test androidx86-set-8 ScriptFactory
 Android 4.2 x86 Emulator ash opt test androidx86-set-1 ScriptFactory
 Android 4.2 x86 Emulator ash opt test androidx86-set-2 ScriptFactory

Comment 11

[John Hopkins (:jhopkins)]

Comment on attachment 816052 [details] [diff] [review]
re-enable Android x86 on Cedar

My mistake - I had run dump_masters on a build master instead of a test master.  This patch looks good.

Comment 12

[Armen [:armenzg]]

Comment on attachment 816052 [details] [diff] [review]
re-enable Android x86 on Cedar

https://hg.mozilla.org/build/buildbot-configs/rev/a938fc538eb9

This will be live once we have a reconfig.

Comment 13

[Armen [:armenzg]]

I assume this went live 3 hours ago with:
http://hg.mozilla.org/build/buildbot-configs/rev/c586441d439c