Update browsertime to version 17
Categories
(Testing :: Raptor, task, P1)
Tracking
(firefox112 fixed)
| Tracking | Status | |
|---|---|---|
| firefox112 | --- | fixed |
People
(Reporter: sparky, Assigned: sparky)
References
(Blocks 2 open bugs)
Details
(Whiteboard: [fxp])
Attachments
(1 file)
Browsertime will be updated soon to an ESM package and we'll need to convert out test scripts to it: https://gist.github.com/sindresorhus/a39789f98801d908bbc7ff3ecc99d99c
See here for more information on what needs to be changed, and how: https://github.com/sitespeedio/browsertime/blob/main/CHANGELOG.md#1700---unreleased
|
||
Updated•1 month ago
|
|
Assignee | |
Comment 1•1 month ago
|
||
This patch updates browsertime to version 17. Along with this, we're updating the visual-metrics processing script to fix a bug in the visual progress calculations.
Pushed by gmierz2@outlook.com: https://hg.mozilla.org/integration/autoland/rev/7770ed05a3a2 Update browsertime to version 17. r=perftest-reviewers,afinder
|
||
Comment 3•27 days ago
|
||
| bugherder | ||
|
||
Comment 4•25 days ago
|
||
(In reply to Pulsebot from comment #2)
Pushed by gmierz2@outlook.com:
https://hg.mozilla.org/integration/autoland/rev/7770ed05a3a2
Update browsertime to version 17. r=perftest-reviewers,afinder
== Change summary for alert #37288 (as of Wed, 22 Feb 2023 22:26:19 GMT) ==
Regressions:
| Ratio | Test | Platform | Options | Absolute values (old vs new) | Performance Profiles |
|---|---|---|---|---|---|
| 199% | reddit-billgates-post-1.comments SpeedIndex | windows10-64-shippable-qr | cold fission webrender | 118.75 -> 354.58 | |
| 145% | reddit-billgates-post-1.comments SpeedIndex | linux1804-64-shippable-qr | cold fission webrender | 104.56 -> 256.46 | |
| 72% | google-docs SpeedIndex | macosx1015-64-shippable-qr | fission warm webrender | 860.67 -> 1,480.75 | Before/After |
| 68% | reddit-billgates-ama.billg-ama SpeedIndex | windows10-64-shippable-qr | cold fission webrender | 910.24 -> 1,527.12 | |
| 62% | reddit-billgates-ama.billg-ama SpeedIndex | macosx1015-64-shippable-qr | cold fission webrender | 761.38 -> 1,236.00 | |
| 56% | google-docs SpeedIndex | macosx1015-64-shippable-qr | cold fission webrender | 1,071.08 -> 1,669.25 | Before/After |
| 53% | google-docs SpeedIndex | windows10-64-shippable-qr | fission warm webrender | 899.50 -> 1,373.33 | Before/After |
| 51% | google-docs SpeedIndex | linux1804-64-shippable-qr | fission warm webrender | 1,137.17 -> 1,722.75 | Before/After |
| 51% | reddit-billgates-post-1.posts SpeedIndex | windows10-64-shippable-qr | cold fission webrender | 77.73 -> 117.75 | |
| 51% | reddit-billgates-post-1.posts SpeedIndex | linux1804-64-shippable-qr | cold fission webrender | 97.15 -> 146.92 | |
| ... | ... | ... | ... | ... | ... |
| 5% | google-slides SpeedIndex | windows10-64-shippable-qr | fission warm webrender | 545.71 -> 570.25 | Before/After |
| 4% | imdb SpeedIndex | windows10-64-shippable-qr | fission warm webrender | 313.04 -> 325.83 | |
| 4% | paypal SpeedIndex | windows10-64-shippable-qr | fission warm webrender | 305.42 -> 317.33 | Before/After |
| 3% | office SpeedIndex | windows10-64-shippable-qr | fission warm webrender | 366.17 -> 378.58 | Before/After |
| 3% | facebook SpeedIndex | windows10-64-shippable-qr | cold fission webrender | 897.00 -> 922.00 |
For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37288
Description
•