1884516 - Intermittent [tier 2] raptor-browsertime Critical: [custom-car] Could not run JavaScript

Status: RESOLVED INCOMPLETE

(Testing :: Performance, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=450179086&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OevwN3AWToa1_UD-JqNsSA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-03-09T11:56:46.839Z] 11:56:46     INFO -  raptor-browsertime Info: Waiting 3000 ms for data from HTML suite...
[task 2024-03-09T11:56:49.854Z] 11:56:49    ERROR -  raptor-browsertime Error: [custom-car] Browsertime failed to run
[task 2024-03-09T11:56:49.854Z] 11:56:49     INFO -  raptor-browsertime Info:   (Session info: chrome=124.0.6347.0)
[task 2024-03-09T11:56:49.854Z] 11:56:49    ERROR -  raptor-browsertime Error: [custom-car] Browsertime failed to run
[task 2024-03-09T11:56:49.855Z] 11:56:49     INFO -  raptor-browsertime Info:       const score = window.benchmarkRunnerClient.results.score;
[task 2024-03-09T11:56:49.855Z] 11:56:49     INFO -  raptor-browsertime Info:       const results = window.benchmarkRunnerClient.results.results[0].testsResults;
[task 2024-03-09T11:56:49.855Z] 11:56:49     INFO -  raptor-browsertime Info:       return {
[task 2024-03-09T11:56:49.855Z] 11:56:49     INFO -  raptor-browsertime Info:         score,
[task 2024-03-09T11:56:49.856Z] 11:56:49     INFO -  raptor-browsertime Info:         results,
[task 2024-03-09T11:56:49.856Z] 11:56:49     INFO -  raptor-browsertime Info:       };
[task 2024-03-09T11:56:49.856Z] 11:56:49     INFO -  raptor-browsertime Info:
[task 2024-03-09T11:56:49.862Z] 11:56:49 CRITICAL -  raptor-browsertime Critical: [custom-car] Could not run JavaScript
[task 2024-03-09T11:56:50.126Z] 11:56:50    ERROR -  Traceback (most recent call last):
[task 2024-03-09T11:56:50.126Z] 11:56:50     INFO -    File "/opt/worker/tasks/task_170998440996960/build/tests/raptor/raptor/raptor.py", line 188, in <module>
[task 2024-03-09T11:56:50.127Z] 11:56:50     INFO -      main()
[task 2024-03-09T11:56:50.127Z] 11:56:50     INFO -    File "/opt/worker/tasks/task_170998440996960/build/tests/raptor/raptor/raptor.py", line 137, in main
[task 2024-03-09T11:56:50.128Z] 11:56:50     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2024-03-09T11:56:50.128Z] 11:56:50     INFO -    File "/opt/worker/tasks/task_170998440996960/build/tests/raptor/raptor/perftest.py", line 500, in run_tests
[task 2024-03-09T11:56:50.128Z] 11:56:50     INFO -      self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2024-03-09T11:56:50.128Z] 11:56:50     INFO -    File "/opt/worker/tasks/task_170998440996960/build/tests/raptor/raptor/browsertime/base.py", line 1047, in run_test
[task 2024-03-09T11:56:50.129Z] 11:56:50     INFO -      raise Exception(self.browsertime_failure)
[task 2024-03-09T11:56:50.129Z] 11:56:50     INFO -  Exception: Could not run JavaScript
[task 2024-03-09T11:56:50.162Z] 11:56:50     INFO - Return code: 1
[task 2024-03-09T11:56:50.162Z] 11:56:50  WARNING - setting return code to 1
[task 2024-03-09T11:56:50.162Z] 11:56:50     INFO - Copying Raptor results to upload dir:
[task 2024-03-09T11:56:50.162Z] 11:56:50     INFO - /opt/worker/tasks/task_170998440996960/build/blobber_upload_dir/perfherder-data.json
[task 2024-03-09T11:56:50.162Z] 11:56:50     INFO - Copying raptor results from /opt/worker/tasks/task_170998440996960/build/raptor.json to /opt/worker/tasks/task_170998440996960/build/blobber_upload_dir/perfherder-data.json
[task 2024-03-09T11:56:50.162Z] 11:56:50 CRITICAL - Error copying results /opt/worker/tasks/task_170998440996960/build/raptor.json to upload dir /opt/worker/tasks/task_170998440996960/build/blobber_upload_dir/perfherder-data.json

Comment 1

[Intermittent Failures Robot]

2 failures in 4198 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• macosx1400-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-03-04&endday=2024-03-10&tree=all

Comment 2

[Intermittent Failures Robot]

3 failures in 3849 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• macosx1400-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-03-11&endday=2024-03-17&tree=all

Comment 3

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 4

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=463294776&repo=mozilla-central

Comment 5

[Intermittent Failures Robot]

3 failures in 4577 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• macosx1400-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 6

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 7

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=473761264&repo=mozilla-central

Comment 8

[Intermittent Failures Robot]

2 failures in 4448 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• macosx1400-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-09-09&endday=2024-09-15&tree=all

Comment 9

[Intermittent Failures Robot]

1 failures in 3574 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-09-30&endday=2024-10-06&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 4579 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-10-14&endday=2024-10-20&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 4456 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-10-21&endday=2024-10-27&tree=all

Comment 12

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 13

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=485275248&repo=mozilla-central

Comment 14

[Intermittent Failures Robot]

1 failures in 4722 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1400-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-12-02&endday=2024-12-08&tree=all

Comment 15

[Intermittent Failures Robot]

Summary

2 failures in 3774 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• macosx1400-64-shippable-qr: 2
  • opt: 2

Table

	1proc	1proc-s	1proc-swr	a11y-checks	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	condprof-s	fis	fis-hv	fis-hv-s	fis-s	headless	headless-s	http2	http3	mda-gpu	mda-gpu-s	msix	msix-s	no_variant	nofis	nofis-aab	nofis-s	nofis-ship	nofis-ship-s	nofis-spi	nofis-swr	nofis-swr-s	nogpu	nogpu-s	s	spi	spi-nw	spi-nw-1proc	spi-nw-nofis	spi-nw-nofis-s	spi-nw-s	spi-s	swr	swr-s	vt	vt-s	wmfme	wr-dc1-p	wr-dc2-o	wr-dc3-c	wr-dc3-c-s	xorig	xorig-s
macosx1400-64-shippable-qr/opt																																2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-12-16&endday=2024-12-22&tree=all

Comment 16

[Intermittent Failures Robot]

Summary

2 failures in 900 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• macosx1400-64-shippable-qr: 2
  • opt: 2

Table

	1proc	1proc-s	1proc-swr	a11y-checks	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	cf	condprof-s	fis	fis-hv	fis-hv-s	fis-s	headless	headless-s	http2	http3	mda-gpu	mda-gpu-s	msix	msix-s	no_variant	nofis	nofis-aab	nofis-s	nofis-ship	nofis-ship-s	nofis-spi	nofis-swr	nogpu	nogpu-s	s	spi	spi-nw	spi-nw-1proc	spi-nw-cf	spi-nw-nofis	spi-nw-s	spi-s	swr	swr-s	vt	vt-s	wmfme	wmfme-s	xorig	xorig-s
macosx1400-64-shippable-qr/opt																																2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2024-12-23&endday=2024-12-29&tree=all

Comment 17

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 18

[Intermittent Failures Robot]

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
macosx1470-64--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2025-03-24&endday=2025-03-30&tree=all

Comment 19

[Intermittent Failures Robot]

2 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Table

	no_variant
macosx1500-aarch64--/opt	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2025-04-21&endday=2025-04-27&tree=all

Comment 20

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=505677527&repo=mozilla-central

Comment 21

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
macosx1470-64--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2025-04-28&endday=2025-05-04&tree=all

Comment 22

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 23

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
macosx1470-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2025-06-16&endday=2025-06-22&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
macosx1470-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2025-06-23&endday=2025-06-29&tree=all

Comment 25

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
macosx1470-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2025-10-13&endday=2025-10-19&tree=all

Comment 26

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
macosx1470-x86_64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2025-12-15&endday=2025-12-21&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Table

	nofis
android-aarch64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1884516&startday=2026-03-09&endday=2026-03-15&tree=all