1035379 - Find a way to work around the infinite retries of mochitest-gl on Android 2.3 when an old parent is pushed to Try

Status: RESOLVED INCOMPLETE

(Release Engineering :: General, defect)

Description

[Chris Cooper [:coop] (he/him)]

We're burning a lot of machine time on Try running WebGL tests that retry indefinitely:

17:23 <philor> doing something about the ongoing eternal gl retriggers like https://tbpl.mozilla.org/?tree=Try&rev=c05b8bdceeca&showall=1 might help capacity a tiny bit

We should disable this test until bug 874291 is fixed on Cedar.

Comment 1

[Phil Ringnalda (:philor)]

Sorry, I wound up without any more time to expand on that - the infinite retry problem is a different thing.

On Android 2.3 with a cset from before a few hours after they were turned on (when something landed to stop the problem, I think disabling a few tests), we get infinite retries.

For every other tree, that was no huge problem, we just had to kill retries several times over, and eventually they died out.

For try, that is an infinite infinite problem, because "a cset from before a few hours after they were turned on" will be something frequently pushed to try until after the next esr dies, and even after that may still be infrequently pushed to try.

Other than building a whole huge wad of code to reject pushes which will trigger a particular suite when the qparent is not a descendent of a particular cset, there's only two levers we can move: tweak the retry regex (probably not workable, it looks like it's the generic "it died" retry that saves our bacon hundreds of times a day, unless we switch to one set for -gl and another for every other Android suite, and don't retry -gl), or tweak the out-of-tree bits of harness to swallow this failure rather than let the retry regex see it.

Though disabling the suite on 2.3 on try *would* put off the problem for a while :)

Comment 2

[Phil Ringnalda (:philor)]

And near as I can tell, the actual summary of bug 874291 should be something more like "For the first time ever, someone who knows something about WebGL should look at the WebGL tests that are disabled on Android."