1148843 - Unhide b2g emulator opt M6 and debug M1 and M12 if they ever again come close to being vaguely green

Status: RESOLVED FIXED

(Tree Management Graveyard :: Visibility Requests, defect)

Description

[Phil Ringnalda (:philor)]

Debug M12? Last green on m-c was March 22nd.

Opt M6? 60% failure rate. Opt M9? 90%.

They do hit a smattering of other failures, but for the most part it's bug 1099195, currently #1 on the Orange Factor hit parade, just under 4 times the next ridiculous failure.

Hidden on m-c/m-i/b-i/f-t and try. Maybe TC will have mercy on their soul, if any.

Comment 1

[James Lal [:lightsofapollo]]

Okay these jobs are still run on bb we can see if this looks any different when we run these on TC ( they are still only on stage ). I see this often and it looks like the emulator simply fails to start.

Comment 2

[Bobby Holley (:bholley)]

CCing the b2g media folks so that they know that basically all media tests are hidden for b2g.

If, when digging out of this whole, somebody discovers failures in dom/media/test/test_loop.html, you might want to have a look at bug 1148571.

Comment 3

[JW Wang [:jwwang] [:jw_wang]]

By "hide" do you mean the chunk is not visible on treeherder but the tests are still run? Is there a way to see the hidden chunk?

Comment 4

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

(In reply to JW Wang [:jwwang] from comment #3)
> By "hide" do you mean the chunk is not visible on treeherder but the tests
> are still run? Is there a way to see the hidden chunk?

http://i.imgur.com/IaSlpPZ.png

If you click that square with rounded corners, the page will reload and show the hidden jobs.

Comment 5

[Bobby Holley (:bholley)]

(In reply to JW Wang [:jwwang] from comment #3)
> By "hide" do you mean the chunk is not visible on treeherder but the tests
> are still run? Is there a way to see the hidden chunk?

In other words, the sheriffs are not policing regressions in those tests. Thankfully, the dom/media/test/test_loop.html failure doesn't seem to be there anymore, but there are others (test_readyState.html). I'd suggest fixing the crashes and getting the tests unhidden ASAP to avoid a very difficult process of re-enabling them.

Comment 6

[Phil Ringnalda (:philor)]

Debug M20 prefers to fail as bug 906716, but otherwise it's the same (in that, the last time it was green on b2g-inbound was on Monday, permared timeout is permared timeout).

Comment 7

[Gregor Wagner [:gwagner]]

Steven, can you take care of this? We need to fix the media tests or disable them so we can uhide the chunks?

Comment 8

[StevenLee[:slee]]

Hi JW,

Please check the media tests and see whether we can do something.
Thanks.

Comment 9

[JW Wang [:jwwang] [:jw_wang]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=f8bb5dd93a9e&exclusion_profile=false

30 runs on B2G ICS Emulator opt M6, no failures on media tests.
30 runs on B2G ICS Emulator debug M12, only one failure in dom/media/test/test_playback.html.

The action items lie in Nuwa tests to unhide M6 and M12 again.

Comment 10

[StevenLee[:slee]]

Hi TingYu,

Per comment 9, can you help to figure out the failure of tests? Thanks.

Comment 11

[Ting-Yu Chou [:ting] (away)]

Seems Cervantes is working on it, see bug 1166923.

Comment 12

[Ting-Yu Chou [:ting] (away)]

(In reply to JW Wang [:jwwang] from comment #9)
> https://treeherder.mozilla.org/#/
> jobs?repo=try&revision=f8bb5dd93a9e&exclusion_profile=false
> 
> 30 runs on B2G ICS Emulator opt M6, no failures on media tests.
> 30 runs on B2G ICS Emulator debug M12, only one failure in
> dom/media/test/test_playback.html.
> 
> The action items lie in Nuwa tests to unhide M6 and M12 again.

Bug 1166923 skip Nuwa tests already, it shouldn't block unhiding M6 and M12?

Comment 13

[JW Wang [:jwwang] [:jw_wang]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=43b400c140bd&exclusion_profile=false

B2G ICS Emulator debug M12 is green. B2G ICS Emulator opt M6 failed on tests other than media tests. Please find the module owner to fix them.

Comment 14

[Phil Ringnalda (:philor)]

Opt M9 and debug M20 moved to bug 1168224, the rest unhidden.