1626045 - consider running some talos tests periodically as tier-2

Status: NEW

(Testing :: Talos, enhancement, P3)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

in bug 1591466 there is work to reduce the number of raptor jobs we run as tier-1 so we can prioritize our resources and sheriffing.

here is what we have identified as tier-1:
['tabswitch', 'tsvgx', 'displaylist_mutate', 'tscrollx', 'sessionrestore', 'tp5n', 'tart', 'perf_reftest_singletons', 'startup_about_home_paint_realworld_webextensions', 'tp5o', 'kraken', 'ts_paint_webext', 'tsvgr_opacity', 'startup_about_home_paint', 'tp5o_scroll']

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

revisiting this after double checking data, here is all the tests (17 total) we would need for tier-1 talos using 12 months of data:
['glterrain', 'sessionrestore', 'kraken', 'perf_reftest_singletons', 'tart', 'tsvgx', 'displaylist_mutate', 'startup_about_home_paint_realworld_webextensions', 'tp5o', 'ts_paint_webext', 'startup_about_home_paint', 'tp5n', 'about_newtab_with_snippets', 'tabswitch', 'tscrollx', 'tp5o_scroll', 'tsvgr_opacity']

and using 6 months of data (12 total):
['tscrollx', 'tsvg_static', 'displaylist_mutate', 'sessionrestore', 'perf_reftest_singletons', 'tart', 'startup_about_home_paint', 'tp5o', 'about_newtab_with_snippets', 'glterrain', 'kraken', 'tp5n']

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

if we want to do AWSY also, we have

12 months (5 tests):
['Base Content JS', 'Base Content Heap Unclassified', 'Heap Unclassified', 'Explicit Memory', 'JS']

6 months (3 tests):
['Heap Unclassified', 'Base Content JS', 'JS']

out of a total of 9 tests:
['Heap Unclassified', 'Base Content JS', 'JS', 'Base Content Heap Unclassified', 'Base Content Explicit', 'Images', 'Resident Memory', 'Base Content Resident Unique Memory', 'Explicit Memory']

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

in regards to AWSY, there is nothing to change, so this bug should remain focused on talos.