777333 - TryChooser output not resulting in the requested tests being run

Status: RESOLVED DUPLICATE of bug 791426

(Release Engineering :: General, defect)

Description

[Jonathan Watt [:jwatt]]

I pushed this to try: https://tbpl.mozilla.org/?tree=Try&rev=ad1e143e325a

That used:

try: -b o -p macosx64,macosx -u none -t chrome.2,chrome_mac.2,nochrome.2,dirty,tpr_responsiveness,tprow,tp4,svg,dromaeo,xperf

But https://secure.pub.build.mozilla.org/buildapi/self-serve/try/rev/ad1e143e325a doesn't show several of the requested talos tests, such as 'svg', even under the Pending section.

Somewhere along the line things are going wrong and the requested tests are not being run.

Comment 1

[Jonathan Watt [:jwatt]]

To be clear, the try line was generated by http://trychooser.pub.build.mozilla.org/

Comment 2

[Jonathan Watt [:jwatt]]

It also seems bad that https://tbpl.mozilla.org/?tree=Try&rev=ad1e143e325a isn't showing the failures that are shown on https://secure.pub.build.mozilla.org/buildapi/self-serve/try/rev/ad1e143e325a

Comment 3

[Phil Ringnalda (:philor)]

Probably would have been easier and more useful if someone had looked at this back then, before things like logs and even pushes to try had been disappeared.

Still, I think I can explain those two things.

The svg suite was renamed to svgr in June, and ran side-by-side for a little while before svg got shut off for trunk (and thus try) by http://hg.mozilla.org/build/buildbot-configs/rev/c99e0e7fd967. Nobody updated trychooser until bug 791426 in September, so between those dates, the only way to actually get most talos suites to run was with -t all.

Not showing the failures that self-serve shows? We intentionally broke 10.5 on the trunk what felt like ages before we stopped running it, but was actually only around six weeks, but that six weeks included the time of your push. Self-serve showed the 10.5 talos runs, because they happened and showing things that happened is its business, but tbpl did not show them, because not showing you things that you should not care in the least about because they are expected to be broken is tbpl's business.

Comment 4

[Jonathan Watt [:jwatt]]

Okay, thanks, Phil.