829932 - Regularly notify the top users on https://secure.pub.build.mozilla.org/builddata/reports/reportor/daily/highscores/highscores.html of TryServer best practices

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[Ed Morley [:emorley]]

Having looked at http://people.mozilla.org/~catlee/highscores/highscores.html on and off for the last few months, it's clear that there is always a minority of people that use an order of magnitude more machine time than everyone else.

For example, in the last 7 days:

User	                                        Hours	Jobs
[e-mail]........................	1,562	3,365
[e-mail].......................	1,247	2,650
[e-mail].....................	1,078	2,352
[e-mail]....................	694	1,271
[e-mail]...................	661	1,393
[e-mail].........................	652	1,489
[e-mail]......................	648	1,299
[e-mail]....................	639	1,434
[e-mail]........................	555	1,281
[e-mail]..................	534	1,101
[e-mail].......................	435	880
[e-mail].......................	411	843
[e-mail]....................	399	947
[e-mail]......................	397	675
[e-mail].......................	395	910

From an education POV we should:

1) Make sure users are aware that a "-p all -u all -t none" uses a whopping 120 hours of machine time (and >double if they also "-t all").

2) Encourage them to use http://trychooser.pub.build.mozilla.org/ to narrow to one platform/subset of tests, at least until they are sure that their run isn't going to burn everything. In addition, I've seen many people that do a "-p all -u all" run, which is green apart from say an identical mochitest-4 orange on all platforms. Instead of then iterating using "-p <one_platform> -u mochitest-4", then continue to make multiple full platform/tests pushes.

3) Remind people to cancel unwanted runs, eg: https://groups.google.com/d/msg/mozilla.dev.platform/iengKcyD504/DPJeGxOpGw0J

From a technical POV, we've already done:

* Bug 823135 - Show build load in trychooser webpage
* Bug 823907 - Remove the "enabled everything (mozilla-central matching run)" option from TryChooser
* Bug 823711 - Have fewer platforms/unit tests selected by default on the TryChooser page

Other things we could do:

1) Rename the "-p all" and "-u all" options to break the habit of people who've saved mq commits with "-p all -u all" right from the start. Once bug 691177 sticks, perhaps we should use s/all/most/ ?

2) Bug 823713 - The TryChooser page should list the total number of jobs that will be run

3) Bug 674751 - Add Trychooser platform option to chose fastest build

Comment 1

[Ed Morley [:emorley]]

Notified Tanvi of high usage in bug 822367 comment 46.

Comment 2

[Ed Morley [:emorley]]

gps in bug 718066 comment 104 & emk (VYV03354) in bug 827032 comment 17.

Comment 3

[Gregory Szorc [:gps]]

Yup. I had to push a lot of Talos jobs to track down a Linux crasher and to examine regressions for bug 718066. Hopefully sanity is near :)

Comment 4

[Ed Morley [:emorley]]

Notified echen in bug 809725 comment 49.

Comment 5

[Ed Morley [:emorley]]

[e-mail]................	820	1,527
[e-mail]......................	809	1,721
[e-mail]....................	741	1,606
[e-mail].....................	718	1,553
[e-mail]...................	714	1,554
[e-mail]..................	560	1,160
[e-mail].................	535	1,045
[e-mail]...................	492	1,216
[e-mail]....................	476	974
[e-mail]....................	465	851
[e-mail]..............	464	921
[e-mail]................	423	847
[e-mail]....................	419	855
[e-mail].............	417	860
[e-mail]....................	372	683

Comment 6

[Ed Morley [:emorley]]

amarchesini-mozilla.com...............	1,824	3,745
raymond-raysquare.com.................	1,214	1,814
echen-mozilla.com.....................	718	1,570
mh-glandium.org.......................	697	1,508
spohl-mozilla.com.....................	666	1,268
Ms2ger-gmail.com......................	636	1,351
vyang-mozilla.com.....................	576	1,129
jdrew-mozilla.com.....................	551	1,104
alfredkayser-gmail.com................	550	1,135
jcoppeard-mozilla.com.................	532	1,136
masayuki-d-toybox.com.................	521	1,163
nmatsakis-mozilla.com.................	494	1,108
mozilladev-lindenbergsoftware.com.....	398	855
tcole-mozilla.com.....................	371	941
kgupta-mozilla.com....................	366	860

Comment 7

[Ed Morley [:emorley]]

There are several of us doing this, and it's ongoing, so unassigning.

Comment 8

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

Found in triage.