1220631 - Enable media mochitest on emu-x86-kk, Treeherder Production

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Description

[Blake Wu [:bwu][:blakewu]]

We need this to enable media mochitest.

Comment 1

[Blake Wu [:bwu][:blakewu]]

Attachment: Bug-1220631-Enable-media-mochitest-on-emu-x86-kk-Tre.patch

grandt, 
I don't know automation any bit, but I really want to enable media mochitest on emulator kk. 
Could you help me check this patch if it is correct or not?
Thanks!

Comment 2

[Blake Wu [:bwu][:blakewu]]

Treeherder: 
https://treeherder.mozilla.org/#/jobs?repo=try&revision=b6a6509f5b7c
Don't know why it fails... :(

Comment 3

[Greg Arndt [:garndt]]

Comment on attachment 8682495 [details] [diff] [review]
Bug-1220631-Enable-media-mochitest-on-emu-x86-kk-Tre.patch

This patch does seem like it would add it to all branches that inherit from base_jobs (which I think is most of them at this point).  As far as reporting to production, I would just check with sheriffs because I'm not sure what set of things they are sheriffing that gets reported there but if this is added to TH prod, and sheriffs are managing it, it could get hidden pretty quick if it's orange.  I'm also unsure why we are using the group symbol of "tc-M".  As far as I understand it, x86 is only run on taskcluster, so there is no need to prefix this group with "tc" since there is not a buildbot job we're trying to separate it from (but that's an issue for a different bug)

Comment 4

[Blake Wu [:bwu][:blakewu]]

Attachment: Bug-1220631-Enable-mochitest-on-emu-x86-kk-Treeherde.patch

Currently B2G-KK-Emulator-x86-opt is more stable than B2G-KK-Emulator-x86-debug, so enable mochitests on the opt one.

Comment 5

[Blake Wu [:bwu][:blakewu]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=121ccbdd7754
Once the patch gets r+, I plan to ask sheriffs to hide those orange chunk.
Then we can continue to fix those failures and enable them in the future.

Comment 6

[Greg Arndt [:garndt]]

Comment on attachment 8687791 [details] [diff] [review]
Bug-1220631-Enable-mochitest-on-emu-x86-kk-Treeherde.patch

Review of attachment 8687791 [details] [diff] [review]:
-----------------------------------------------------------------

Looks good to me.

Comment 7

[Blake Wu [:bwu][:blakewu]]

(In reply to Greg Arndt [:garndt] from comment #6)
> Comment on attachment 8687791 [details] [diff] [review]
> Bug-1220631-Enable-mochitest-on-emu-x86-kk-Treeherde.patch
> 
> Review of attachment 8687791 [details] [diff] [review]:
> -----------------------------------------------------------------
> 
> Looks good to me.
Thanks for your review!

Comment 8

[Blake Wu [:bwu][:blakewu]]

Attachment: Enable-mochitest-on-emu-x86-kk-Treeherde.patch

Carry r+ from garndt.

Comment 9

[Blake Wu [:bwu][:blakewu]]

Sheriffs,
This patch (attachment 8688119 [details] [diff] [review]) is to enable mochitest on B2G-KK-Emulator-x86-opt. We know there are some failures, but we cannot wait all to be fixed and then enable it, so could you help hide those failures? We will try to fix those failures and enable them in the future.

Comment 10

[Blake Wu [:bwu][:blakewu]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=121ccbdd7754

Comment 11

[Blake Wu [:bwu][:blakewu]]

Tomcat, 
FYI. This is what was discussed in the mail "Enable Emulator KK" with Josh and Hsinyi.

Comment 12

[Blake Wu [:bwu][:blakewu]]

Ryan, 
Per comment 5 and comment 11, could you help it?

Comment 13

[Ryan VanderMeulen [:RyanVM]]

I have no context on this and I haven't been an active sheriff in over two months. I think Tomcat and/or KWierso need to own this.

Comment 14

[Carsten Book [:Tomcat]]

Hi Blake, btw which tests need to be hidden ?

Comment 15

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/16e98ad8c97b

Comment 16

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

I've hidden tc-m(14,29,30,31,34) on all trunk branches and try (so you'll need to show hidden jobs to see if you've fixed them).
It's possible some of these chunks are just intermittent instead of permafailing, but those can be re-shown later.

Comment 17

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Okay, hid a bunch more chunks that were frequently failing.

Comment 18

[Blake Wu [:bwu][:blakewu]]

(In reply to Carsten Book [:Tomcat] from comment #14)
> Hi Blake, btw which tests need to be hidden ?
All the failures :)
Thanks!

Comment 19

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/16e98ad8c97b

Comment 20

[Carsten Book [:Tomcat]]

(In reply to Blake Wu [:bwu][:blakewu] from comment #18)
> (In reply to Carsten Book [:Tomcat] from comment #14)
> > Hi Blake, btw which tests need to be hidden ?
> All the failures :)
> Thanks!

Hi Blake, since a lot of tests are hidden now, is there any progress on this ? since there is a effort to enable such tests too ?

Comment 21

[Blake Wu [:bwu][:blakewu]]

(In reply to Carsten Book [:Tomcat] from comment #20)
> (In reply to Blake Wu [:bwu][:blakewu] from comment #18)
> > (In reply to Carsten Book [:Tomcat] from comment #14)
> > > Hi Blake, btw which tests need to be hidden ?
> > All the failures :)
> > Thanks!
> 
> Hi Blake, since a lot of tests are hidden now, is there any progress on this
> ? since there is a effort to enable such tests too ?
Benjamin, 
Could you answer Tomcat's question?
Thanks!