Closed Bug 1559951 Opened 5 years ago Closed 5 years ago

Re-record outlook.live.com desktop tp6 pages using mitmproxy 4

Categories

(Testing :: Raptor, defect, P1)

Version 3
defect

Tracking

(firefox70 fixed)

RESOLVED FIXED
mozilla70
Tracking Status
firefox70 --- fixed

People

(Reporter: Bebe, Assigned: alexandrui)

References

Details

Attachments

(1 file)

Re-record outlook.live.com test in raptor tp6 suite
URL: https://outlook.live.com/mail/inbox
Login: Yes
Suite: tp6-9

Assignee: nobody → alexandru.ionescu
Status: NEW → ASSIGNED
Priority: -- → P1

Alex can you try to re-record this and see if we can fix the intermittent.

Also run with upstream_certs=false

Flags: needinfo?(alexandru.ionescu)

on it

Flags: needinfo?(alexandru.ionescu)

This is the latest push, all green (the failures are not related, i trigered an additional task by mistake):
Seems like the fIailing tasks from here https://treeherder.mozilla.org/#/jobs?repo=try&revision=c0926064a05102702ee8addee635d41f176eab52 were fixed, but I deactivated the measuring of FCP and the alert for it. So, if the current push turns out is all-green, is it ok to land the patch as this?

Flags: needinfo?(rwood)

(In reply to Alexandru Ionescu :alexandrui from comment #4)

This is the latest push, all green (the failures are not related, i trigered an additional task by mistake):
Seems like the fIailing tasks from here https://treeherder.mozilla.org/#/jobs?repo=try&revision=c0926064a05102702ee8addee635d41f176eab52 were fixed, but I deactivated the measuring of FCP and the alert for it. So, if the current push turns out is all-green, is it ok to land the patch as this?

Yes but please file a follow-up bug to investigate why measuring fcp doesn't work with this particular test/site , and in that bug please NI acreskey (maybe he or someone else on the perf team would be able to check into that - we should ensure there's not a Firefox issue). Thanks!

Flags: needinfo?(rwood)
Pushed by aionescu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/cf415d209e7e
Re-record outlook.live.com desktop tp6 pages using mitmproxy 4 r=perftest-reviewers,sparky
Status: ASSIGNED → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla70

== Change summary for alert #22047 (as of Mon, 22 Jul 2019 13:01:54 GMT) ==

Improvements:

33% raptor-tp6-outlook-firefox windows10-64-shippable-qr opt 287.94 -> 193.21
32% raptor-tp6-outlook-firefox linux64-shippable-qr opt 265.16 -> 180.22
30% raptor-tp6-outlook-firefox windows10-64-shippable-qr opt 288.12 -> 201.23
28% raptor-tp6-outlook-firefox windows10-64-shippable opt 281.18 -> 201.28
18% raptor-tp6-outlook-firefox loadtime windows7-32-shippable opt 464.17 -> 378.96
16% raptor-tp6-outlook-firefox loadtime linux64-shippable-qr opt 451.35 -> 378.79
15% raptor-tp6-outlook-firefox loadtime windows10-64-shippable-qr opt 484.81 -> 412.54
13% raptor-tp6-outlook-firefox loadtime windows10-64-shippable opt 474.04 -> 412.25

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=22047

You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: