1866626 - Intermittent raptor-browsertime Critical: Browsertime process timed out after X seconds

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=437668531&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IUNCbZO8SAe5unU5zVNbPg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-11-25T11:42:59.172Z] 11:42:59     INFO -  raptor-browsertime Info: test: {'here': '/opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/tests/benchmarks', 'alert_threshold': '2.0', 'apps': 'firefox, chrome, chromium, safari, custom-car', 'expose_browser_profiler': True, 'lower_is_better': False, 'owner': 'Performance Team', 'page_cycles': 1, 'page_timeout': 900000, 'subtest_lower_is_better': True, 'subtest_unit': 'ms', 'test_url': 'http://127.0.0.1:49338/index.html', 'type': 'benchmark', 'unit': 'score', 'browsertime_args': '--browsertime.speedometer_iterations=5', 'browser_cycles': '1', 'custom_data': 'true', 'cold': True, 'repository': 'https://github.com/WebKit/Speedometer', 'repository_revision': '36712deb57d45879f56dd2136f8a6ed8a22d964b', 'host_from_parent': False, 'submetric_summary_method': 'mean', 'subtest_name_filters': 'tests/,s3/', 'test_script': 'speedometer3.js', 'test_summary': 'flatten', 'name': 'speedometer3', 'manifest': '/opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/tests/benchmarks/speedometer-desktop.ini', 'manifest_relpath': 'tests/benchmarks/speedometer-desktop.ini', 'path': '/opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/tests/benchmarks/speedometer3', 'relpath': 'tests/benchmarks/speedometer3', 'ancestor_manifest': 'raptor.ini', 'expected': 'pass', 'extra_profiler_run': True, 'extra_profiler_run_browser_cycles': 1, 'extra_profiler_run_page_cycles': 1, 'expected_browser_cycles': 1, 'browser_cycle': 1}
[task 2023-11-25T11:42:59.172Z] 11:42:59     INFO -  raptor-browsertime-desktop Info: binary_path: /opt/worker/tasks/task_170091218023374/build/application/Firefox Nightly.app/Contents/MacOS/firefox
[task 2023-11-25T11:42:59.172Z] 11:42:59     INFO -  raptor-browsertime Info: timeout (s): 900000
[task 2023-11-25T11:42:59.172Z] 11:42:59     INFO -  raptor-browsertime Info: browsertime cwd: /opt/worker/tasks/task_170091218023374/build
[task 2023-11-25T11:42:59.173Z] 11:42:59     INFO -  raptor-browsertime Info: browsertime cmd: /opt/worker/tasks/task_170091218023374/fetches/node/bin/node /opt/worker/tasks/task_170091218023374/fetches/browsertime/node_modules/browsertime/bin/browsertime.js --firefox.geckodriverPath /opt/worker/tasks/task_170091218023374/fetches/geckodriver /opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/browsertime/../../browsertime/speedometer3.js --firefox.noDefaultPrefs --browsertime.page_cycle_delay 1000 --skipHar --pageLoadStrategy none --webdriverPageload true --firefox.disableBrowsertimeExtension true --pageCompleteCheckStartWait 5000 --pageCompleteCheckPollTimeout 1000 --beforePageCompleteWaitTime 2000 --timeouts.pageLoad 900000 --timeouts.script 900000 --browsertime.page_cycles 1 --pageCompleteWaitTime 5000 --browsertime.url http://127.0.0.1:49338/index.html --browsertime.post_startup_delay 30000 --iterations 1 --browsertime.chimera false --browsertime.test_bytecode_cache false --firefox.perfStats false --browsertime.moz_fetch_dir /opt/worker/tasks/task_170091218023374/fetches --browsertime.expose_profiler false --browsertime.speedometer_iterations 5 --browsertime.commands  --viewPort 1280x1024 --browser firefox --firefox.binaryPath /opt/worker/tasks/task_170091218023374/build/application/Firefox Nightly.app/Contents/MacOS/firefox --resultDir /opt/worker/tasks/task_170091218023374/build/blobber_upload_dir/browsertime-results/speedometer3 --firefox.profileTemplate /var/folders/0y/6n2zbgp170z40_jt3npp5zfh000013/T/tmpwpntf01h.mozrunner --video false --visualMetrics false
[task 2023-11-25T11:42:59.173Z] 11:42:59     INFO -  raptor-browsertime Info: PATH: /opt/worker/tasks/task_170091218023374/build/venv/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin
[task 2023-11-25T11:42:59.173Z] 11:42:59     INFO -  raptor-browsertime Info: Calling browsertime with proc_timeout=950, and output_timeout=None
[taskcluster 2023-11-25T11:58:12.093Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/IUNCbZO8SAe5unU5zVNbPg/0/on/macstadium-vegas/macmini-m2-1/until/1700914692.071
[task 2023-11-25T11:58:49.332Z] 11:58:49 CRITICAL -  raptor-browsertime Critical: Browsertime process timed out after 950 seconds
[task 2023-11-25T11:58:49.435Z] 11:58:49    ERROR -  Traceback (most recent call last):
[task 2023-11-25T11:58:49.435Z] 11:58:49     INFO -    File "/opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/raptor.py", line 186, in <module>
[task 2023-11-25T11:58:49.436Z] 11:58:49     INFO -      main()
[task 2023-11-25T11:58:49.436Z] 11:58:49     INFO -    File "/opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/raptor.py", line 135, in main
[task 2023-11-25T11:58:49.436Z] 11:58:49     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2023-11-25T11:58:49.437Z] 11:58:49     INFO -    File "/opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/perftest.py", line 479, in run_tests
[task 2023-11-25T11:58:49.437Z] 11:58:49     INFO -      self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2023-11-25T11:58:49.438Z] 11:58:49     INFO -    File "/opt/worker/tasks/task_170091218023374/build/tests/raptor/raptor/browsertime/base.py", line 1000, in run_test
[task 2023-11-25T11:58:49.438Z] 11:58:49     INFO -      raise Exception(
[task 2023-11-25T11:58:49.438Z] 11:58:49     INFO -  Exception: Browsertime process timed out after 950 seconds
[task 2023-11-25T11:58:49.487Z] 11:58:49     INFO - Return code: 1
[task 2023-11-25T11:58:49.487Z] 11:58:49  WARNING - setting return code to 1
[task 2023-11-25T11:58:49.487Z] 11:58:49     INFO - Copying Raptor results to upload dir:
[task 2023-11-25T11:58:49.487Z] 11:58:49     INFO - /opt/worker/tasks/task_170091218023374/build/blobber_upload_dir/perfherder-data.json
[task 2023-11-25T11:58:49.487Z] 11:58:49     INFO - Copying raptor results from /opt/worker/tasks/task_170091218023374/build/raptor.json to /opt/worker/tasks/task_170091218023374/build/blobber_upload_dir/perfherder-data.json
[task 2023-11-25T11:58:49.487Z] 11:58:49 CRITICAL - Error copying results /opt/worker/tasks/task_170091218023374/build/raptor.json to upload dir /opt/worker/tasks/task_170091218023374/build/blobber_upload_dir/perfherder-data.json
[task 2023-11-25T11:58:49.487Z] 11:58:49     INFO - [Errno 2] No such file or directory: '/opt/worker/tasks/task_170091218023374/build/raptor.json'
[task 2023-11-25T11:58:49.488Z] 11:58:49     INFO - Running post-action listener: _package_coverage_data

Comment 1

[Intermittent Failures Robot]

2 failures in 3623 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• macosx1300-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2023-11-20&endday=2023-11-26&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 4224 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2023-12-11&endday=2023-12-17&tree=all

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 4

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=450619184&repo=autoland

Comment 5

[Intermittent Failures Robot]

1 failures in 3849 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2024-03-11&endday=2024-03-17&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 3590 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2024-03-25&endday=2024-03-31&tree=all

Comment 7

[Intermittent Failures Robot]

1 failures in 3805 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2024-04-01&endday=2024-04-07&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 4336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2024-04-22&endday=2024-04-28&tree=all

Comment 9

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 10

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=463656639&repo=autoland

Comment 11

[Intermittent Failures Robot]

1 failures in 4577 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 12

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 13

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=473489214&repo=mozilla-central

Comment 14

[Intermittent Failures Robot]

1 failures in 4448 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866626&startday=2024-09-09&endday=2024-09-15&tree=all

Comment 15

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.