Closed Bug 1654204 Opened 4 years ago Closed 4 years ago

twitter confidence drop while rerecording on mitm5

Categories

(Testing :: Performance, defect, P1)

defect

Tracking

(firefox81 fixed)

RESOLVED FIXED
81 Branch
Tracking Status
firefox81 --- fixed

People

(Reporter: alexandrui, Assigned: alexandrui)

References

Details

(Keywords: perf-alert)

Attachments

(1 file)

While updating recording snapshots and mitm4 to mitm5 twitter had a confidence drop: 82-84% -> 76-78%

Priority: P1 → P2
Assignee: nobody → aionescu
Status: NEW → ASSIGNED
Priority: P2 → P1
Pushed by aionescu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/752addc1a2df
Record twitter with mitm5 r=Bebe,perftest-reviewers
Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → 81 Branch

== Change summary for alert #26668 (as of Thu, 06 Aug 2020 13:28:26 GMT) ==

Regressions:

29% raptor-tp6-twitter-firefox-cold loadtime windows7-32-shippable opt 1,369.83 -> 1,770.17
28% raptor-tp6-twitter-firefox-cold loadtime windows10-64-shippable opt 1,376.67 -> 1,768.25
28% raptor-tp6-twitter-firefox-cold loadtime linux64-shippable opt 1,454.50 -> 1,862.58
28% raptor-tp6-twitter-firefox-cold loadtime windows10-64-shippable-qr opt webrender 1,372.17 -> 1,753.42
27% raptor-tp6-twitter-firefox-cold loadtime linux64-shippable-qr opt webrender 1,497.67 -> 1,900.67
11% raptor-tp6-twitter-firefox-cold loadtime macosx1014-64-shippable opt 2,579.33 -> 2,871.67
3% raptor-tp6-twitter-firefox-cold loadtime linux64-shippable-qr opt webrender 1,890.53 -> 1,956.08
2% raptor-tp6-twitter-firefox-cold loadtime windows10-64-shippable opt 1,766.83 -> 1,809.25

Improvements:

67% raptor-tp6-twitter-firefox-cold fcp linux64-shippable opt 614.33 -> 201.58
66% raptor-tp6-twitter-firefox-cold fcp windows10-64-shippable opt 598.17 -> 204.42
66% raptor-tp6-twitter-firefox-cold fcp windows7-32-shippable opt 601.17 -> 205.92
65% raptor-tp6-twitter-firefox-cold fcp linux64-shippable-qr opt webrender 639.25 -> 223.08
65% raptor-tp6-twitter-firefox-cold fcp macosx1014-64-shippable opt 941.25 -> 329.75
64% raptor-tp6-twitter-firefox-cold fcp windows10-64-shippable-qr opt webrender 567.58 -> 206.58
38% raptor-tp6-twitter-firefox-cold macosx1014-64-shippable opt 1,148.30 -> 707.30
38% raptor-tp6-twitter-firefox-cold linux64-shippable opt 742.69 -> 458.96
38% raptor-tp6-twitter-firefox-cold linux64-shippable-qr opt webrender 760.55 -> 471.70
35% raptor-tp6-twitter-firefox-cold windows10-64-shippable opt 699.23 -> 454.15
35% raptor-tp6-twitter-firefox-cold windows7-32-shippable opt 700.58 -> 457.31
34% raptor-tp6-twitter-firefox-cold windows10-64-shippable-qr opt webrender 686.89 -> 452.80
3% raptor-tp6-twitter-firefox-cold confidence macosx1014-64-shippable opt 93.00 -> 96.25
3% raptor-tp6-twitter-firefox-cold confidence windows10-64-shippable opt 93.00 -> 96.00
3% raptor-tp6-twitter-firefox-cold confidence windows10-64-shippable-qr opt webrender 93.00 -> 96.00
3% raptor-tp6-twitter-firefox-cold confidence windows7-32-shippable opt 93.00 -> 96.00
3% raptor-tp6-twitter-firefox-cold confidence linux64-shippable-qr opt webrender 93.00 -> 95.83
3% raptor-tp6-twitter-firefox-cold confidence linux64-shippable opt 93.00 -> 95.58

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=26668

Keywords: perf-alert
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: