1008373 - Run more Android 4.0 Debug tests on Cedar

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Geoff Brown [:gbrown]]

Now that we are making some progress on Android 4.0 Debug tests, we should challenge ourselves and see how the remaining tests run, on Cedar only for now.

Let's add:

R1, R2 ... R8, Cpp, and X

to the Android 4.0 Debug tests run on Cedar -- that should give us the same set of tests run on Android 4.0 Debug as on Android 4.0 Opt.

Comment 1

[Geoff Brown [:gbrown]]

Attachment: sync up Panda Opt and Debug unittest suites

I'm not sure if I should attempt this, since I don't know of a way I can test it, but it looks like this might be simple...

Comment 2

[Kim Moir [:kmoir] ET]

Comment on attachment 8420377 [details] [diff] [review]
sync up Panda Opt and Debug unittest suites

You also need to removed this block which only enables certain tests on debug

http://mxr.mozilla.org/build/source/buildbot-configs/mozilla-tests/mobile_config.py#1617

I did this on my test master and diffed the builders and they looked good

Comment 3

[Geoff Brown [:gbrown]]

But...Isn't that block differentiating between tests run on Cedar and tests run on all trees? The list of tests @1617 is the list of Android Debug tests run on trunk. For instance, mochitest-1 is in that list, and mochitest-1 runs on Cedar and on mozilla-central, etc. I want Android Debug xpcshell to run only on Cedar (for now), like crashtests do currently.

Comment 4

[Kim Moir [:kmoir] ET]

Oh sorry I misread the bug that you needed to run them on more trees than cedar.  In that case, yes this is correct. Here's the diff on my master

(test2)[[e-mail] test2]$ diff old new
675a676,684
> Android 4.0 Panda cedar debug test plain-reftest-1 ScriptFactory
> Android 4.0 Panda cedar debug test plain-reftest-2 ScriptFactory
> Android 4.0 Panda cedar debug test plain-reftest-3 ScriptFactory
> Android 4.0 Panda cedar debug test plain-reftest-4 ScriptFactory
> Android 4.0 Panda cedar debug test plain-reftest-5 ScriptFactory
> Android 4.0 Panda cedar debug test plain-reftest-6 ScriptFactory
> Android 4.0 Panda cedar debug test plain-reftest-7 ScriptFactory
> Android 4.0 Panda cedar debug test plain-reftest-8 ScriptFactory
> Android 4.0 Panda cedar debug test xpcshell ScriptFactory
676a686
> Android 4.0 Panda cedar debug test cppunit ScriptFactory

Comment 5

[Geoff Brown [:gbrown]]

https://hg.mozilla.org/build/buildbot-configs/rev/7cb8460913f7

Comment 6

[Armen [:armenzg]]

Live in production.

Comment 7

[Geoff Brown [:gbrown]]

Verified on Cedar. 

There are some new failures -- I'll check into them when I return.