1655031 - Add a set of live site tests for HTTP/3

Status: RESOLVED FIXED

(Testing :: mozperftest, task, P1)

Description

[Greg Mierzwinski [:sparky]]

This bug is for adding a small set of live site tests to mozperftest (residing within testing/performance). This bug doesn't include setting them up in CI.

Comment 1

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Add a google search live site user-journey performance test. r?tarek,acreskey

This patch adds a test which performs the following:
(1): Navigates to google.com
(2): Measure metrics for searching the "Python"
(3): Wait for X (waitTime) seconds
(4): Measure metrics for clicking the "Next Page" button

Depends on D84822

Comment 2

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Add youtube video live site playback quality performance test. r?tarek,acreskey

This patch adds a youtube live site test which measures the playback quality of the video.

Depends on D84823

Comment 3

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Add youtube playback quality performance test with scrolling. r?tarek,acreskey

This patch adds a test for video playback quality on youtube that scrolls while the video is playing.

Depends on D84824

Comment 4

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Add facebook live site performance test. r?tarek,acreskey

Depends on D84825

Comment 5

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Add a cloudflare blog user-journey performance test. r?tarek,acreskey

Depends on D84852

Comment 6

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Add QUIC fetch page performance test. r?tarek,acreskey

This patch adds a performance test for the Lucas Cloudflare image fetch test for the combinations (requests, parallel requests): [100, 1], [100, 100], and [300, 300]. Resource load time as well as the number of images missed is measured.

Depends on D84864

Comment 7

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Add a google image search performance test. r?tarek,acreskey

This patch adds a test for scrolling on the google image search page for kittens. It measure the images loaded per second as well as the amount of time it takes for a clicked image to open and load.

Depends on D84923

Comment 8

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Enable HTTP/3 live site tests in CI. r?tarek

Depends on D84927

Comment 9

[Greg Mierzwinski [:sparky]]

Try run for these tests: https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=f3d1c91aff8b160c0697267deaa89a2234a9e810

The google-search one is a bit problematic since it seems to intermittently fail while trying to find the search button - not too sure how to fix this one yet.

Comment 10

[Greg Mierzwinski [:sparky]]

Newest try run: https://treeherder.mozilla.org/#/jobs?repo=try&revision=8dce01e2c2d662d405f397627d17e4ebc0749875

Comment 11

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1655031 - Fix how mozperftest metrics are parsed. r?tarek

Depends on D84927

Comment 12

[Greg Mierzwinski [:sparky]]

This should be the final try run: https://treeherder.mozilla.org/#/jobs?repo=try&revision=db2e4a23212c1b035a11c4db16eff1b9bd8a71cd

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/58df5566adf1
Add a google search live site user-journey performance test. r=acreskey
https://hg.mozilla.org/integration/autoland/rev/5c9024a5e135
Add youtube video live site playback quality performance test. r=acreskey
https://hg.mozilla.org/integration/autoland/rev/06302a603e01
Add youtube playback quality performance test with scrolling. r=acreskey
https://hg.mozilla.org/integration/autoland/rev/142c93403cb1
Add facebook live site performance test. r=acreskey
https://hg.mozilla.org/integration/autoland/rev/cb654047009d
Add a cloudflare blog user-journey performance test. r=acreskey
https://hg.mozilla.org/integration/autoland/rev/ca524d800373
Add QUIC fetch page performance test. r=acreskey
https://hg.mozilla.org/integration/autoland/rev/547f88256a8c
Add a google image search performance test. r=acreskey
https://hg.mozilla.org/integration/autoland/rev/61a1e8966a3e
Fix how mozperftest metrics are parsed. r=tarek
https://hg.mozilla.org/integration/autoland/rev/1a4f6037ad44
Enable HTTP/3 live site tests in CI. r=tarek

Comment 14

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/58df5566adf1
https://hg.mozilla.org/mozilla-central/rev/5c9024a5e135
https://hg.mozilla.org/mozilla-central/rev/06302a603e01
https://hg.mozilla.org/mozilla-central/rev/142c93403cb1
https://hg.mozilla.org/mozilla-central/rev/cb654047009d
https://hg.mozilla.org/mozilla-central/rev/ca524d800373
https://hg.mozilla.org/mozilla-central/rev/547f88256a8c
https://hg.mozilla.org/mozilla-central/rev/61a1e8966a3e
https://hg.mozilla.org/mozilla-central/rev/1a4f6037ad44