Closed Bug 1731399 Opened 3 years ago Closed 3 years ago

Update imdb page load test to navigate to sub-page rather than about:blank

Categories

(Testing :: Performance, task, P2)

Product:
Testing
Component:
Performance
Version:
Default
Type:
task

Tracking

(firefox95 fixed)

Status:
RESOLVED FIXED
Milestone:
95 Branch
Tracking Flags:
Tracking Status
firefox95 --- fixed

People

(Reporter: kimberlythegeek, Assigned: kimberlythegeek)

References

Details

(Keywords: perf-alert)

Attachments

(1 file, 1 obsolete file)

Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bug 1736996)
48 bytes, text/x-phabricator-request
Details | Review

+++ This bug was initially created as a clone of Bug #1724261 +++

https://bugzilla.mozilla.org/show_bug.cgi?id=1716825 landed a patch to navigate to a sub-page instead of about:blank for warm page load tests.

in this bug we need to:
1 - determine what secondary URL should be used for each test
2 - implement a secondary URL and re-record page load

Attachment #9243078 - Attachment description: WIP: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank → Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank
Priority: P1 → P2
Attachment #9243078 - Attachment description: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank → WIP: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank
Attachment #9243078 - Attachment description: WIP: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank → Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank
Attachment #9243078 - Attachment description: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank → WIP: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank
Attachment #9243078 - Attachment description: WIP: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank → Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank
Pushed by ksereduck@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/3109d6d49091
Update imdb page load test to navigate to sub-page rather than about:blank r=perftest-reviewers,sparky

https://hg.mozilla.org/mozilla-central/rev/3109d6d49091

Status: NEW → RESOLVED
Closed: 3 years ago
status-firefox95: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 95 Branch

== Change summary for alert #31832 (as of Wed, 13 Oct 2021 04:35:18 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
109% imdb loadtime linux1804-64-shippable-qr cold webrender 1,697.92 -> 3,552.62
107% imdb loadtime linux1804-64-shippable-qr cold webrender 1,701.46 -> 3,524.46
42% imdb LastVisualChange linux1804-64-shippable-qr warm webrender 1,040.00 -> 1,480.00
34% imdb loadtime linux1804-64-shippable-qr warm webrender 1,007.42 -> 1,349.96

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
41% imdb fnbpaint linux1804-64-shippable-qr warm webrender 555.75 -> 329.50
40% imdb FirstVisualChange linux1804-64-shippable-qr warm webrender 565.00 -> 340.00
39% imdb fcp linux1804-64-shippable-qr warm webrender 526.73 -> 323.04
35% imdb ContentfulSpeedIndex linux1804-64-shippable-qr warm webrender 557.75 -> 360.33
31% imdb SpeedIndex linux1804-64-shippable-qr warm webrender 555.83 -> 385.67
... ... ... ... ...
7% imdb dcf linux1804-64-shippable-qr cold webrender 750.94 -> 696.00

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=31832

Regressions: 1736996
Attachment #9258502 - Attachment description: WIP: Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bu 1736996) → Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bu 1736996)
Attachment #9258502 - Attachment description: Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bu 1736996) → WIP: Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bu 1736996)
Attachment #9258502 - Attachment description: WIP: Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bu 1736996) → Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bu 1736996)
Attachment #9258502 - Attachment description: Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bu 1736996) → Backed out changeset 3109d6d49091 (Bug 1731399) for permanent non-live chrome/chromium failures (bug 1736996)
Backout by archaeopteryx@coole-files.de:
https://hg.mozilla.org/integration/autoland/rev/bb37e7d6382b
Backed out changeset 3109d6d49091 for permanent non-live chrome/chromium failures (bug 1736996)
Attachment #9243078 - Attachment description: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank → WIP: Bug 1731399: Update imdb page load test to navigate to sub-page rather than about:blank
Attachment #9243078 - Attachment is obsolete: true
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: