1744548 - Fix default manifest version for page load tests

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P1)

Description

[Kimberly Sereduck :kimberlythegeek]

When landing Bug 1740103 I failed to update the default filename for the manifest file to be mitm7: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.ini#20

This means that although the patch for amazon mitm7 test has landed (Bug 1739400), the test is downloading and running the mitm5 recording file.

Comment 1

[Kimberly Sereduck :kimberlythegeek]

Attachment: Bug 1744548: Fix default manifest version for page load tests

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7f2c94a782a4
Fix default manifest version for page load tests r=perftest-reviewers,sparky

Comment 3

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/7f2c94a782a4

Comment 4

[Alexandru Ionescu (needinfo me) [:alexandrui]]

== Change summary for alert #32662 (as of Thu, 09 Dec 2021 10:20:53 GMT) ==

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
18%	amazon FirstVisualChange	macosx1014-64-shippable-qr	warm webrender	298.33 -> 353.33

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
12%	amazon fcp	linux1804-64-shippable-qr	cold fission webrender	509.02 -> 450.12

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=32662