1868996 - Almost perma (tier2) raptor-browsertime Error: Browsertime failed to run | raptor-browsertime Critical: Failed waiting on page https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html to finished loading,

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=439359034&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/M7edAHtzQY-4VIUynsm-iA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-12-08T12:29:11.646Z] 12:29:11     INFO -  raptor-browsertime Info: Start firefox window recorder.
[task 2023-12-08T12:30:13.485Z] 12:30:13     INFO -  raptor-browsertime Info: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html has been tested before within the same run, it will get an extra query parameter named browsertime_run. Make sure to use alias to keep track of the URLs
[task 2023-12-08T12:30:13.486Z] 12:30:13     INFO -  raptor-browsertime Info: Stop firefox window recorder.
[taskcluster 2023-12-08T12:30:46.225Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/M7edAHtzQY-4VIUynsm-iA/0/on/mdc1/t-linux64-ms-011/until/1702039846.204
[task 2023-12-08T12:30:49.051Z] 12:30:49     INFO -  raptor-browsertime Info: CPU / Power usage: 138399
[task 2023-12-08T12:30:49.422Z] 12:30:49     INFO -  raptor-browsertime Info: Browsertime pageload ended.
[task 2023-12-08T12:30:52.307Z] 12:30:52     INFO -  raptor-browsertime Info: Use the visual metrics portable script
[task 2023-12-08T12:30:52.308Z] 12:30:52     INFO -  raptor-browsertime Info: Get visual metrics from the video
[task 2023-12-08T12:30:56.573Z] 12:30:56     INFO -  raptor-browsertime Info: Use the visual metrics portable script
[task 2023-12-08T12:30:56.573Z] 12:30:56     INFO -  raptor-browsertime Info: Get visual metrics from the video
[task 2023-12-08T12:31:05.069Z] 12:31:05     INFO -  raptor-browsertime Info: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html TTFB: 48ms DOMContentLoaded: 846ms firstPaint: 802ms FCP: 799ms LCP: 533ms Load: 2.26s
[task 2023-12-08T12:31:05.069Z] 12:31:05     INFO -  raptor-browsertime Info: VisualMetrics: FirstVisualChange: 840ms SpeedIndex: 2.28s PerceptualSpeedIndex: 2.03s ContentfulSpeedIndex: 2.06s VisualComplete85: 4.00s LastVisualChange: 5.72s
[task 2023-12-08T12:31:05.075Z] 12:31:05     INFO -  raptor-browsertime Info: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html?browsertime_run=2 TTFB: 59ms DOMContentLoaded: 760ms firstPaint: 721ms FCP: 715ms LCP: 725ms Load: 55.30s
[task 2023-12-08T12:31:05.075Z] 12:31:05     INFO -  raptor-browsertime Info: VisualMetrics: FirstVisualChange: 760ms SpeedIndex: 3.09s PerceptualSpeedIndex: 3.88s ContentfulSpeedIndex: 2.82s VisualComplete85: 6.20s LastVisualChange: 6.20s
[task 2023-12-08T12:31:05.092Z] 12:31:05     INFO -  raptor-browsertime Info: Skip setting default preferences for Firefox
[task 2023-12-08T12:31:07.677Z] 12:31:07     INFO -  raptor-browsertime Info: Starting a browsertime pageload
[task 2023-12-08T12:31:07.677Z] 12:31:07     INFO -  raptor-browsertime Info: Waiting for 1000 ms (post_startup_delay)
[task 2023-12-08T12:31:08.679Z] 12:31:08     INFO -  raptor-browsertime Info: Navigating to about:blank, count: 0
[task 2023-12-08T12:31:08.680Z] 12:31:08     INFO -  raptor-browsertime Info: Navigating to url about:blank iteration 4
[task 2023-12-08T12:31:13.726Z] 12:31:13     INFO -  raptor-browsertime Info: Navigating to primary url:https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
[task 2023-12-08T12:31:13.727Z] 12:31:13     INFO -  raptor-browsertime Info: Cycle 0, waiting for 5000 ms
[task 2023-12-08T12:31:18.731Z] 12:31:18     INFO -  raptor-browsertime Info: Cycle 0, starting the measure
[task 2023-12-08T12:31:18.732Z] 12:31:18     INFO -  raptor-browsertime Info: Testing url https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html iteration 4
[task 2023-12-08T12:31:18.734Z] 12:31:18     INFO -  raptor-browsertime Info: Start firefox window recorder.
[task 2023-12-08T12:31:33.661Z] 12:31:33     INFO -  raptor-browsertime Info: Stop firefox window recorder.
[task 2023-12-08T12:32:35.437Z] 12:32:35     INFO -  raptor-browsertime Info: CPU / Power usage: 145151
[task 2023-12-08T12:32:35.916Z] 12:32:35     INFO -  raptor-browsertime Info: Navigating to secondary url:https://www.cnn.com/weather
[task 2023-12-08T12:32:35.916Z] 12:32:35     INFO -  raptor-browsertime Info: Navigating to url https://www.cnn.com/weather iteration 4
[task 2023-12-08T12:32:47.162Z] 12:32:47     INFO -  raptor-browsertime Info: Navigating to primary url:https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
[task 2023-12-08T12:32:47.163Z] 12:32:47     INFO -  raptor-browsertime Info: Cycle 1, waiting for 5000 ms
[task 2023-12-08T12:32:52.168Z] 12:32:52     INFO -  raptor-browsertime Info: Cycle 1, starting the measure
[task 2023-12-08T12:32:52.169Z] 12:32:52     INFO -  raptor-browsertime Info: Testing url https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html iteration 4
[task 2023-12-08T12:32:52.170Z] 12:32:52     INFO -  raptor-browsertime Info: Start firefox window recorder.
[task 2023-12-08T12:33:05.561Z] 12:33:05     INFO -  raptor-browsertime Info: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html has been tested before within the same run, it will get an extra query parameter named browsertime_run. Make sure to use alias to keep track of the URLs
[task 2023-12-08T12:33:05.562Z] 12:33:05     INFO -  raptor-browsertime Info: Stop firefox window recorder.
[task 2023-12-08T12:33:39.437Z] 12:33:39     INFO -  raptor-browsertime Info: CPU / Power usage: 93892
[task 2023-12-08T12:33:39.895Z] 12:33:39     INFO -  raptor-browsertime Info: Browsertime pageload ended.
[task 2023-12-08T12:33:43.013Z] 12:33:43     INFO -  raptor-browsertime Info: Use the visual metrics portable script
[task 2023-12-08T12:33:43.017Z] 12:33:43     INFO -  raptor-browsertime Info: Get visual metrics from the video
[task 2023-12-08T12:33:50.602Z] 12:33:50     INFO -  raptor-browsertime Info: Use the visual metrics portable script
[task 2023-12-08T12:33:50.602Z] 12:33:50     INFO -  raptor-browsertime Info: Get visual metrics from the video
[task 2023-12-08T12:33:59.236Z] 12:33:59     INFO -  raptor-browsertime Info: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html TTFB: 46ms DOMContentLoaded: 882ms firstPaint: 774ms FCP: 766ms LCP: 563ms Load: 8.33s
[task 2023-12-08T12:33:59.236Z] 12:33:59     INFO -  raptor-browsertime Info: VisualMetrics: FirstVisualChange: 800ms SpeedIndex: 3.25s PerceptualSpeedIndex: 3.10s ContentfulSpeedIndex: 3.26s VisualComplete85: 6.08s LastVisualChange: 6.08s
[task 2023-12-08T12:33:59.243Z] 12:33:59     INFO -  raptor-browsertime Info: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html?browsertime_run=2 TTFB: 43ms DOMContentLoaded: 1.34s firstPaint: 131ms FCP: 732ms LCP: 1.38s Load: 7.22s
[task 2023-12-08T12:33:59.243Z] 12:33:59     INFO -  raptor-browsertime Info: VisualMetrics: FirstVisualChange: 760ms SpeedIndex: 4.26s PerceptualSpeedIndex: 4.47s ContentfulSpeedIndex: 4.20s VisualComplete85: 7.60s LastVisualChange: 11.48s
[task 2023-12-08T12:33:59.262Z] 12:33:59     INFO -  raptor-browsertime Info: Skip setting default preferences for Firefox
[task 2023-12-08T12:34:01.855Z] 12:34:01     INFO -  raptor-browsertime Info: Starting a browsertime pageload
[task 2023-12-08T12:34:01.855Z] 12:34:01     INFO -  raptor-browsertime Info: Waiting for 1000 ms (post_startup_delay)
[task 2023-12-08T12:34:02.857Z] 12:34:02     INFO -  raptor-browsertime Info: Navigating to about:blank, count: 0
[task 2023-12-08T12:34:02.858Z] 12:34:02     INFO -  raptor-browsertime Info: Navigating to url about:blank iteration 5
[task 2023-12-08T12:34:07.900Z] 12:34:07     INFO -  raptor-browsertime Info: Navigating to primary url:https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
[task 2023-12-08T12:34:07.901Z] 12:34:07     INFO -  raptor-browsertime Info: Cycle 0, waiting for 5000 ms
[task 2023-12-08T12:34:12.906Z] 12:34:12     INFO -  raptor-browsertime Info: Cycle 0, starting the measure
[task 2023-12-08T12:34:12.907Z] 12:34:12     INFO -  raptor-browsertime Info: Testing url https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html iteration 5
[task 2023-12-08T12:34:12.908Z] 12:34:12     INFO -  raptor-browsertime Info: Start firefox window recorder.
[task 2023-12-08T12:34:21.724Z] 12:34:21     INFO -  raptor-browsertime Info: Stop firefox window recorder.
[task 2023-12-08T12:34:36.948Z] 12:34:36     INFO -  raptor-browsertime Info: CPU / Power usage: 58951
[task 2023-12-08T12:34:37.142Z] 12:34:37     INFO -  raptor-browsertime Info: Navigating to secondary url:https://www.cnn.com/weather
[task 2023-12-08T12:34:37.142Z] 12:34:37     INFO -  raptor-browsertime Info: Navigating to url https://www.cnn.com/weather iteration 5
[task 2023-12-08T12:35:27.942Z] 12:35:27     INFO -  raptor-browsertime Info: Navigating to primary url:https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
[task 2023-12-08T12:35:27.943Z] 12:35:27     INFO -  raptor-browsertime Info: Cycle 1, waiting for 5000 ms
[task 2023-12-08T12:35:32.947Z] 12:35:32     INFO -  raptor-browsertime Info: Cycle 1, starting the measure
[task 2023-12-08T12:35:32.949Z] 12:35:32     INFO -  raptor-browsertime Info: Testing url https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html iteration 5
[task 2023-12-08T12:35:32.950Z] 12:35:32     INFO -  raptor-browsertime Info: Start firefox window recorder.
[task 2023-12-08T12:37:38.862Z] 12:37:38    ERROR -  raptor-browsertime Error: Browsertime failed to run
[task 2023-12-08T12:37:38.863Z] 12:37:38     INFO -  raptor-browsertime Info: return (function(waitTime) {
[task 2023-12-08T12:37:38.864Z] 12:37:38     INFO -  raptor-browsertime Info:     try {
[task 2023-12-08T12:37:38.865Z] 12:37:38     INFO -  raptor-browsertime Info:             var end = window.performance.timing.loadEventEnd;
[task 2023-12-08T12:37:38.867Z] 12:37:38     INFO -  raptor-browsertime Info:             var start= window.performance.timing.navigationStart;
[task 2023-12-08T12:37:38.868Z] 12:37:38     INFO -  raptor-browsertime Info:             return (end > 0) && (performance.now() > end - start + waitTime);
[task 2023-12-08T12:37:38.869Z] 12:37:38     INFO -  raptor-browsertime Info:     }
[task 2023-12-08T12:37:38.870Z] 12:37:38     INFO -  raptor-browsertime Info:     catch(e) {
[task 2023-12-08T12:37:38.871Z] 12:37:38     INFO -  raptor-browsertime Info:         return true;
[task 2023-12-08T12:37:38.872Z] 12:37:38     INFO -  raptor-browsertime Info:     }
[task 2023-12-08T12:37:38.873Z] 12:37:38     INFO -  raptor-browsertime Info: })(arguments[arguments.length - 1]);
[task 2023-12-08T12:37:38.874Z] 12:37:38     INFO -  raptor-browsertime Info:  took too long
[task 2023-12-08T12:37:38.875Z] 12:37:38     INFO -  raptor-browsertime Info: return (function(waitTime) {
[task 2023-12-08T12:37:38.875Z] 12:37:38     INFO -  raptor-browsertime Info:     try {
[task 2023-12-08T12:37:38.876Z] 12:37:38     INFO -  raptor-browsertime Info:             var end = window.performance.timing.loadEventEnd;
[task 2023-12-08T12:37:38.878Z] 12:37:38     INFO -  raptor-browsertime Info:             var start= window.performance.timing.navigationStart;
[task 2023-12-08T12:37:38.879Z] 12:37:38     INFO -  raptor-browsertime Info:             return (end > 0) && (performance.now() > end - start + waitTime);
[task 2023-12-08T12:37:38.880Z] 12:37:38     INFO -  raptor-browsertime Info:     }
[task 2023-12-08T12:37:38.881Z] 12:37:38     INFO -  raptor-browsertime Info:     catch(e) {
[task 2023-12-08T12:37:38.881Z] 12:37:38     INFO -  raptor-browsertime Info:         return true;
[task 2023-12-08T12:37:38.882Z] 12:37:38     INFO -  raptor-browsertime Info:     }
[task 2023-12-08T12:37:38.884Z] 12:37:38     INFO -  raptor-browsertime Info: })(arguments[arguments.length - 1]);
[task 2023-12-08T12:37:38.885Z] 12:37:38     INFO -  raptor-browsertime Info:  took too long
[task 2023-12-08T12:37:38.887Z] 12:37:38     INFO -  raptor-browsertime Info:     at Timeout.<anonymous> (file:///home/cltbld/tasks/task_170203762523130/fetches/browsertime/node_modules/browsertime/lib/core/seleniumRunner.js:45:16)
[task 2023-12-08T12:37:38.888Z] 12:37:38     INFO -  raptor-browsertime Info:     at listOnTimeout (node:internal/timers:559:17)
[task 2023-12-08T12:37:38.889Z] 12:37:38     INFO -  raptor-browsertime Info:     at processTimers (node:internal/timers:502:7)
[task 2023-12-08T12:37:38.892Z] 12:37:38     INFO -  raptor-browsertime Info: URL failed to load, trying 5 more time(s): Failed waiting on page https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html  to finished loading, timed out after 120000 ms
[task 2023-12-08T12:37:38.894Z] 12:37:38 CRITICAL -  raptor-browsertime Critical: Failed waiting on page https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html to finished loading, timed out after 120000 ms Error: Running page complete check
[task 2023-12-08T12:37:38.894Z] 12:37:38     INFO -  raptor-perftest Info: Removing temporary directory: /tmp/tmp7rskushf
[task 2023-12-08T12:37:38.961Z] 12:37:38    ERROR -  Traceback (most recent call last):
[task 2023-12-08T12:37:38.962Z] 12:37:38     INFO -    File "/home/cltbld/tasks/task_170203762523130/build/tests/raptor/raptor/raptor.py", line 186, in <module>
[task 2023-12-08T12:37:38.962Z] 12:37:38     INFO -      main()
[task 2023-12-08T12:37:38.962Z] 12:37:38     INFO -    File "/home/cltbld/tasks/task_170203762523130/build/tests/raptor/raptor/raptor.py", line 135, in main
[task 2023-12-08T12:37:38.963Z] 12:37:38     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2023-12-08T12:37:38.963Z] 12:37:38     INFO -    File "/home/cltbld/tasks/task_170203762523130/build/tests/raptor/raptor/perftest.py", line 484, in run_tests
[task 2023-12-08T12:37:38.964Z] 12:37:38     INFO -      self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2023-12-08T12:37:38.964Z] 12:37:38     INFO -    File "/home/cltbld/tasks/task_170203762523130/build/tests/raptor/raptor/browsertime/base.py", line 1005, in run_test
[task 2023-12-08T12:37:38.964Z] 12:37:38     INFO -      raise Exception(self.browsertime_failure)
[task 2023-12-08T12:37:38.965Z] 12:37:38     INFO -  Exception: Failed waiting on page https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html to finished loading, timed out after 120000 ms Error: Running page complete check
[task 2023-12-08T12:37:39.019Z] 12:37:39     INFO - Return code: 1
[task 2023-12-08T12:37:39.019Z] 12:37:39  WARNING - setting return code to 1
[task 2023-12-08T12:37:39.019Z] 12:37:39     INFO - Copying Raptor results to upload dir:
[task 2023-12-08T12:37:39.019Z] 12:37:39     INFO - /home/cltbld/tasks/task_170203762523130/build/blobber_upload_dir/perfherder-data.json
[task 2023-12-08T12:37:39.019Z] 12:37:39     INFO - Copying raptor results from /home/cltbld/tasks/task_170203762523130/build/raptor.json to /home/cltbld/tasks/task_170203762523130/build/blobber_upload_dir/perfherder-data.json
[task 2023-12-08T12:37:39.019Z] 12:37:39 CRITICAL - Error copying results /home/cltbld/tasks/task_170203762523130/build/raptor.json to upload dir /home/cltbld/tasks/task_170203762523130/build/blobber_upload_dir/perfherder-data.json
[task 2023-12-08T12:37:39.019Z] 12:37:39     INFO - [Errno 2] No such file or directory: '/home/cltbld/tasks/task_170203762523130/build/raptor.json'
[task 2023-12-08T12:37:39.020Z] 12:37:39     INFO - Running post-action listener: _package_coverage_data
[task 2023-12-08T12:37:39.020Z] 12:37:39     INFO - Running post-action listener: _resource_record_post_action
[task 2023-12-08T12:37:39.020Z] 12:37:39     INFO - Running post-action listener: process_java_coverage_data
[task 2023-12-08T12:37:39.020Z] 12:37:39     INFO - Running post-action listener: stop_device
[task 2023-12-08T12:37:39.020Z] 12:37:39     INFO - [mozharness: 2023-12-08 12:37:39.020746Z] Finished run-tests step (success)
[task 2023-12-08T12:37:39.020Z] 12:37:39     INFO - Running post-run listener: _resource_record_post_run
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - Total resource usage - Wall time: 1346s; CPU: 20%; Read bytes: 201007104; Write bytes: 7856111616; Read time: 3080; Write time: 912156
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: CPU usage<br/>20.4%
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: I/O read bytes / time<br/>201,007,104 / 3,080
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: I/O write bytes / time<br/>7,856,111,616 / 912,156
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: CPU idle<br/>8,487.4 (78.9%)
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: CPU nice<br/>121.2 (1.1%)
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: CPU system<br/>344.0 (3.2%)
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: CPU user<br/>1,721.4 (16.0%)
[task 2023-12-08T12:37:40.525Z] 12:37:40     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2023-12-08T12:37:40.531Z] 12:37:40     INFO - install-chromium-distribution - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2023-12-08T12:37:40.539Z] 12:37:40     INFO - install - Wall time: 10s; CPU: 13%; Read bytes: 49152; Write bytes: 19513344; Read time: 0; Write time: 180
[task 2023-12-08T12:37:40.906Z] 12:37:40     INFO - run-tests - Wall time: 1335s; CPU: 20%; Read bytes: 200957952; Write bytes: 7836598272; Read time: 3080; Write time: 911976
[task 2023-12-08T12:37:49.748Z] 12:37:49  WARNING - returning nonzero exit status 1
[taskcluster 2023-12-08T12:37:50.016Z]    Exit Code: 1
[taskcluster 2023-12-08T12:37:50.016Z]    User Time: 28m42.145354s
[taskcluster 2023-12-08T12:37:50.016Z]  Kernel Time: 4m57.18485s
[taskcluster 2023-12-08T12:37:50.016Z]    Wall Time: 24m3.178326941s
[taskcluster 2023-12-08T12:37:50.016Z]       Result: FAILED
[taskcluster 2023-12-08T12:37:50.016Z] === Task Finished ===

Comment 1

[Noemi Erli[:noemi_erli]]

This is almost permafailing since this merge.
Seems to be a fallout from Bug 1863130, Greg, could you please take a look at this?

Comment 2

[Intermittent Failures Robot]

6 failures in 3671 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6

Platform and build breakdown:

• linux1804-64-shippable-qr: 5
  • opt: 5
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2023-12-04&endday=2023-12-10&tree=all

Comment 3

[Greg Mierzwinski [:sparky]]

I'm not sure it's related to the changes from bug 1863130. It's a live site test as well, so it might be hard to pinpoint a specific commit that caused it.

I started looking into the failure though, and I'm seeing that the load time on this page is all over the place. In some cases it's 4 seconds, in others it's nearly 1 minute. In the failures, we seem to be hitting the 120s timeout within browsertime. I've triggered a try run here to see if increasing the max load time to 240s could help with this: https://treeherder.mozilla.org/jobs?repo=try&revision=a73c8afd38c31e3c530b92bdf589a19c730fdaed

Right now, I think the cnn page updated and caused these issues. I also see some failures like this on older commits now (thank you for triggering these :nataliacs!): https://treeherder.mozilla.org/jobs?repo=mozilla-central&selectedTaskRun=GzUaCzvhRVuJGtAsg_-OJQ.0&searchStr=linux%2C18.04%2Cx64%2Cwebrender%2Cshippable%2Copt%2Cbrowsertime%2Cperformance%2Ctests%2Con%2Cfirefox%2Ctest-linux1804-64-shippable-qr%2Fopt-browsertime-tp6-live-sheriffed-firefox-cnn%2Ccnn&revision=edf9292c0bc9c671afa4de12648c16622e9d418c

Something on this page is very bad with producing multiple spaced-out network requests (likely the ads), and seem to contribute to most of the issues with load time.

Comment 4

[Greg Mierzwinski [:sparky]]

It looks like my patch might have helped, but I'll wait until tomorrow to push a patch in case the cnn-live site was updated because that may have fixed the issue too. I say this because the runtime for the tasks in the try run is much lower than what it was on Monday.

Comment 5

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1868996 - Increase maxLoadTime for cnn live-site test. r?#perftest,aglavic

This patch increases the maxLoadTime for the cnn-live test to avoid Browsertime timeouts during the pageload. These tests can often take over the default 120s to finish loading.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/52110e043992
Increase maxLoadTime for cnn live-site test. r=aglavic,perftest-reviewers

Comment 7

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/52110e043992

Comment 8

[Intermittent Failures Robot]

4 failures in 4224 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-shippable-qr: 3
  • opt: 3
• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2023-12-11&endday=2023-12-17&tree=all

Comment 9

[Cosmin Sabou [:CosminS]]

This is still failing frequently: https://treeherder.mozilla.org/jobs?repo=mozilla-central&group_state=expanded&selectedTaskRun=XVsUjxfuTXG-FwEhkmn_DQ.0&searchStr=linux1804-64-clang-trunk-qr%2Copt%2Cbrowsertime%2Cperformance%2Ctests%2Con%2Cfirefox%2Ctest-linux1804-64-clang-trunk-qr%2Fopt-browsertime-tp6-live-sheriffed-firefox-cnn%2Ccnn

Comment 10

[Intermittent Failures Robot]

7 failures in 3349 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7

Platform and build breakdown:

• linux1804-64-shippable-qr: 3
  • opt: 3
• linux1804-64-clang-trunk-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2023-12-18&endday=2023-12-24&tree=all

Comment 11

[Greg Mierzwinski [:sparky]]

It looks like this issue has resolved itself. The problem must have been coming from the live website.

Comment 12

[Intermittent Failures Robot]

1 failures in 3217 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-01-08&endday=2024-01-14&tree=all

Comment 13

[Intermittent Failures Robot]

3 failures in 3599 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 2

Platform and build breakdown:

• android-hw-a51-11-0-aarch64-shippable-qr: 1
  • opt: 1
• windows10-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-01-15&endday=2024-01-21&tree=all

Comment 14

[Intermittent Failures Robot]

3 failures in 4034 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-01-22&endday=2024-01-28&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 4009 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-02-05&endday=2024-02-11&tree=all

Comment 16

[Intermittent Failures Robot]

2 failures in 3125 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-02-12&endday=2024-02-18&tree=all

Comment 17

[Intermittent Failures Robot]

2 failures in 4052 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-02-26&endday=2024-03-03&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 4198 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-03-04&endday=2024-03-10&tree=all

Comment 19

[Intermittent Failures Robot]

1 failures in 3849 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-03-11&endday=2024-03-17&tree=all

Comment 20

[Intermittent Failures Robot]

1 failures in 3791 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-03-18&endday=2024-03-24&tree=all

Comment 21

[Intermittent Failures Robot]

4 failures in 4252 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-clang-trunk-qr: 2
  • opt: 2
• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-04-15&endday=2024-04-21&tree=all

Comment 22

[Intermittent Failures Robot]

2 failures in 4336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• windows10-64-shippable-qr: 1
  • opt: 1
• android-hw-a51-11-0-aarch64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-04-22&endday=2024-04-28&tree=all

Comment 23

[Intermittent Failures Robot]

8 failures in 4059 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 8

Platform and build breakdown:

• linux1804-64-shippable-qr: 3
  • opt: 3
• linux1804-64-clang-trunk-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-04-29&endday=2024-05-05&tree=all

Comment 24

[Intermittent Failures Robot]

4 failures in 3649 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2
• linux1804-64-clang-trunk-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-05-06&endday=2024-05-12&tree=all

Comment 25

[Intermittent Failures Robot]

2 failures in 4547 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-05-13&endday=2024-05-19&tree=all

Comment 26

[Intermittent Failures Robot]

1 failures in 4202 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-05-27&endday=2024-06-02&tree=all

Comment 27

[Intermittent Failures Robot]

2 failures in 3649 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-06-03&endday=2024-06-09&tree=all

Comment 28

[Intermittent Failures Robot]

2 failures in 4625 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-06-10&endday=2024-06-16&tree=all

Comment 29

[Intermittent Failures Robot]

1 failures in 4577 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 3799 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-07-15&endday=2024-07-21&tree=all

Comment 31

[Intermittent Failures Robot]

1 failures in 2154 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-08-12&endday=2024-08-18&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 3879 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-08-26&endday=2024-09-01&tree=all

Comment 33

[Intermittent Failures Robot]

1 failures in 4860 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-a51-11-0-aarch64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-09-16&endday=2024-09-22&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 4889 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-09-23&endday=2024-09-29&tree=all

Comment 35

[Intermittent Failures Robot]

4 failures in 4679 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 2
  • opt: 2
• windows11-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1868996&startday=2024-10-07&endday=2024-10-13&tree=all

Comment 36

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.