1668325 - Experimenting with Talos tests and software fallback on Try

Status: RESOLVED INVALID

(Core :: Graphics: WebRender, task)

Description

[Jim Mathies [:jimm]]

Been trying to get talos results on all three platforms comparing basic layers with software fallback. Current results are here -

https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=62925da80975b1047325d6420407b415474928bb&newProject=try&newRevision=416d9c04ca93242fa5ea7cd37339e777fe377be9&framework=1

There's an open question about whether or not I'm actually getting the backend requested through prefs changes. The about:support text dumped to the logs indicates I am, but Matt and Jeff feel the results seem a little dubious.

It's also possible that lack of feature support and bugs might be interfering with results (like bug 1668302).

Comment 1

[Jim Mathies [:jimm]]

New compare, managed to get the odd mixed results sorted out between windows shipable and shipable-qr -

https://treeherder.mozilla.org/perf.html#/compare?originalProject=try&originalRevision=badb8852185b2b5e7f8667ee9a3b4c0f5186b8be&newProject=try&newRevision=18fd527099a89b5bd216f3f877056e074b54d06d&framework=1

Comment 2

[Jim Mathies [:jimm]]

Generally speaking, none of these runs seem to have worked. Despite what it says in the logs, we're not sure we're actually getting the backend we want. Planning to prioritize getting this set up better in automation for try runs in bug 1668288