Re-record outlook.live.com desktop tp6 pages using mitmproxy 4
Categories
(Testing :: Raptor, defect, P1)
Tracking
(firefox70 fixed)
Tracking | Status | |
---|---|---|
firefox70 | --- | fixed |
People
(Reporter: Bebe, Assigned: alexandrui)
References
Details
Attachments
(1 file)
Re-record outlook.live.com test in raptor tp6 suite
URL: https://outlook.live.com/mail/inbox
Login: Yes
Suite: tp6-9
Assignee | ||
Updated•5 years ago
|
Assignee | ||
Comment 1•5 years ago
|
||
Updated•5 years ago
|
Reporter | ||
Comment 2•5 years ago
|
||
Alex can you try to re-record this and see if we can fix the intermittent.
Also run with upstream_certs=false
Assignee | ||
Comment 4•5 years ago
|
||
This is the latest push, all green (the failures are not related, i trigered an additional task by mistake):
Seems like the fIailing tasks from here https://treeherder.mozilla.org/#/jobs?repo=try&revision=c0926064a05102702ee8addee635d41f176eab52 were fixed, but I deactivated the measuring of FCP and the alert for it. So, if the current push turns out is all-green, is it ok to land the patch as this?
Comment 5•5 years ago
|
||
(In reply to Alexandru Ionescu :alexandrui from comment #4)
This is the latest push, all green (the failures are not related, i trigered an additional task by mistake):
Seems like the fIailing tasks from here https://treeherder.mozilla.org/#/jobs?repo=try&revision=c0926064a05102702ee8addee635d41f176eab52 were fixed, but I deactivated the measuring of FCP and the alert for it. So, if the current push turns out is all-green, is it ok to land the patch as this?
Yes but please file a follow-up bug to investigate why measuring fcp doesn't work with this particular test/site , and in that bug please NI acreskey (maybe he or someone else on the perf team would be able to check into that - we should ensure there's not a Firefox issue). Thanks!
Assignee | ||
Comment 6•5 years ago
|
||
Yes sir.
Pushed by aionescu@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/cf415d209e7e Re-record outlook.live.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,sparky
Comment 8•5 years ago
|
||
bugherder |
Reporter | ||
Comment 9•5 years ago
|
||
== Change summary for alert #22047 (as of Mon, 22 Jul 2019 13:01:54 GMT) ==
Improvements:
33% raptor-tp6-outlook-firefox windows10-64-shippable-qr opt 287.94 -> 193.21
32% raptor-tp6-outlook-firefox linux64-shippable-qr opt 265.16 -> 180.22
30% raptor-tp6-outlook-firefox windows10-64-shippable-qr opt 288.12 -> 201.23
28% raptor-tp6-outlook-firefox windows10-64-shippable opt 281.18 -> 201.28
18% raptor-tp6-outlook-firefox loadtime windows7-32-shippable opt 464.17 -> 378.96
16% raptor-tp6-outlook-firefox loadtime linux64-shippable-qr opt 451.35 -> 378.79
15% raptor-tp6-outlook-firefox loadtime windows10-64-shippable-qr opt 484.81 -> 412.54
13% raptor-tp6-outlook-firefox loadtime windows10-64-shippable opt 474.04 -> 412.25
For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=22047
Description
•