1255533 - It takes ~24 hours to get reftest results on "Windows 8 x64 opt" on Try

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Mats Palmgren (inactive)]

It takes ~24 hours to get reftest results on "Windows 8 x64 opt" on Try.
That's way too long to be acceptable.

It appears that the delay is caused by waiting for the jobs to be scheduled:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=35578c84e646&selectedJob=17843541
Click on the orange "R" at the link:
Requested: Wed Mar 9, 21:45:04
Started: Thu Mar 10, 17:21:32
Ended: Thu Mar 10, 17:48:18

Comment 1

[Kim Moir [:kmoir] ET]

I wonder if we should turn off win8 but default on try until we address our capacity issues

Comment 2

[Ryan VanderMeulen [:RyanVM]]

Effectively, we're already not running tests on Win8 on Try in the sense that I'd be willing to bet that many/most of our developers aren't waiting for results on that platform before just pushing and hoping for the best. However, I'm not crazy about outright making that decision given Win8 is our only 64-bit Windows test coverage, but I'm also not sure what the actual effects would be of doing so.

Do we often see issues on Win8 that don't happen on Win7? I'd be curious to know how often we hit XP bustage these days that got missed because of lack of default Try coverage.

Comment 3

[Chris AtLee [:catlee]]

Another option is to move some XP capacity over to Win8.

Comment 4

[Mats Palmgren (inactive)]

If anyone have the powers to manually force the scheduling of the following reftest, 
that would be most appreciated:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=8a7b56c74f22

Comment 5

[Phil Ringnalda (:philor)]

Someone already did (or your 14 hour number came up), but you do yourself have the power: downarrow menu at the upper right of the push on treeherder, "BuildAPI", [run me sooner] button on any pending job.

Comment 6

[Vlad Ciobancai [:vladC] [:vciobancai]]

(In reply to Chris AtLee [:catlee] from comment #3)
> Another option is to move some XP capacity over to Win8.

There are 13 windows 8 servers used for windows 10 tests. I do not know if there are used, if not, we can add them in to the production

Comment 7

[Kim Moir [:kmoir] ET]

We have moved 10 XP machines over to the Windows 8 pool (bug 1255812), but still have high pending counts for windows 8.  Should we reconsider turning off Win8 by default on try?  

Currently
3025 pending jobs on win8, 2996 of those are on try

Comment 8

[Chris AtLee [:catlee]]

Attachment: MozReview Request: Bug 1255533 - Disable win8 by default on try r=rail

Review commit: https://reviewboard.mozilla.org/r/54278/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/54278/

Comment 9

[Rail Aliiev [:rail]]

Comment on attachment 8754855 [details]
MozReview Request: Bug 1255533 - Disable win8 by default on try r=rail

https://reviewboard.mozilla.org/r/54278/#review50950

Comment 10

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/5f7d99a176f1

Comment 15

[Phil Ringnalda (:philor)]

Don't forget the part about adding the "disabled when not explicitly checked" (or "explicity" if you like the 10.6 spelling better) to trychooser, to give us that warm feeling of being covered when people start yelling about being backed out for Win8-only failures.

Comment 16

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Attachment: Trychooser update to show disabled by default

Something like this?

Comment 17

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Attachment: Trychooser patch

Now with more 'l's!

Comment 18

[Phil Ringnalda (:philor)]

No l lovin' for 10.6?

Comment 19

[Daniel Holbert [:dholbert]]

[ni=kwierso to land that TryChooser "disabled when not explicitly checked" patch.]

Comment 20

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Whoops, forgot to do that. Fixed the other 'explicity's while I was at it.
https://hg.mozilla.org/build/tools/rev/154c6052d713

Comment 21

[Rail Aliiev [:rail]]

Loks like we are done here