1946935 - Intermittent xpcshell Automation Error: mozharness timed out after 1000 seconds running ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/xpcshell/runxpcshelltests.py', '--disable-fission', 'browser/components

Status: NEW

(Testing :: XPCShell Harness, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: amarc [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=493981500&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RKh1_iLjSDCUchoCLVV8OA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2025-02-08T10:36:27.191Z] 10:36:27     INFO -  TEST-START | devtools/client/shared/remote-debugging/adb/xpcshell/test_adb.js
[task 2025-02-08T10:41:27.193Z] 10:41:27     INFO -  TEST-TIMEOUT | devtools/client/shared/remote-debugging/adb/xpcshell/test_adb.js | took 300002ms
[task 2025-02-08T10:41:27.193Z] 10:41:27     INFO -  xpcshell return code: None
[task 2025-02-08T10:41:27.194Z] 10:41:27     INFO -  devtools/client/shared/remote-debugging/adb/xpcshell/test_adb.js | Process still running after test!
[task 2025-02-08T10:58:07.194Z] 10:58:07     INFO - Automation Error: mozharness timed out after 1000 seconds running ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/xpcshell/runxpcshelltests.py', '--disable-fission', 'browser/components/aboutwelcome/tests/xpcshell/xpcshell.toml', 'browser/components/attribution/test/xpcshell/xpcshell.toml', 'browser/components/genai/tests/xpcshell/xpcshell.toml', 'browser/components/installerprefs/test/unit/xpcshell.toml', 'browser/components/shell/test/unit/xpcshell.toml', 'browser/components/sidebar/tests/unit/xpcshell.toml', 'browser/extensions/formautofill/test/unit/xpcshell.toml', 'browser/tools/mozscreenshots/tests/xpcshell/xpcshell.toml', 'devtools/client/inspector/changes/test/xpcshell/xpcshell.toml', 'devtools/client/shared/remote-debugging/adb/xpcshell/xpcshell.toml', 'devtools/shared/discovery/tests/xpcshell/xpcshell.toml', 'devtools/shared/transport/tests/xpcshell/xpcshell.toml', 'docshell/test/unit_ipc/xpcshell.toml', 'dom/console/tests/xpcshell/xpcshell.toml', 'dom/fs/test/common/xpcshell.toml', 'dom/media/webvtt/test/xpcshell/xpcshell.toml', 'dom/quota/test/xpcshell/upgrades/xpcshell.toml', 'extensions/permissions/test/unit/xpcshell.toml', 'intl/benchmarks/test/xpcshell/xpcshell.toml', 'intl/uconv/tests/unit/xpcshell.toml', 'mobile/shared/components/extensions/test/xpcshell/xpcshell.toml', 'mobile/shared/modules/geckoview/test/xpcshell/xpcshell.toml', 'modules/libpref/test/unit/xpcshell.toml', 'netwerk/test/unit/node_execute/xpcshell.toml', 'remote/cdp/test/xpcshell/xpcshell.toml', 'services/common/tests/unit/xpcshell.toml', 'testing/xpcshell/test/unit/xpcshell-with-prefs.toml', 'toolkit/components/aboutmemory/tests/xpcshell/xpcshell.toml', 'toolkit/components/backgroundtasks/tests/xpcshell/xpcshell.toml', 'toolkit/components/contentrelevancy/tests/xpcshell/xpcshell.toml', 'toolkit/components/enterprisepolicies/tests/xpcshell/xpcshell.toml', 'toolkit/components/featuregates/test/unit/xpcshell.toml', 'toolkit/components/normandy/test/unit/xpcshell.toml', 'toolkit/components/places/tests/migration/xpcshell.toml', 'toolkit/components/satchel/test/unit/xpcshell.toml', 'toolkit/components/terminator/tests/xpcshell/xpcshell.toml', 'toolkit/components/thumbnails/test/xpcshell.toml', 'toolkit/components/xulstore/tests/xpcshell/xpcshell.toml', 'toolkit/mozapps/defaultagent/tests/xpcshell/xpcshell.toml', 'toolkit/mozapps/downloads/tests/unit/xpcshell.toml', 'toolkit/profile/test/xpcshell/xpcshell.toml', 'widget/tests/unit/xpcshell.toml', '--setpref=layout.css.stylo-threads=4', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=layers.d3d11.enable-blacklist=false', '--self-test', '--symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Yd27q2ujQqeL2BrgW6x36g/artifacts/public/build/target.crashreporter-symbols.zip', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/xpcshell_errorsummary.log', '--utility-path=tests/bin', '--xpcshell=/builds/worker/workspace/build/application/firefox/xpcshell', '--http3server=/builds/worker/workspace/build/application/firefox/http3server', '--manifest=tests/xpcshell/tests/xpcshell.toml']
[task 2025-02-08T10:58:07.196Z] 10:58:07     INFO - Return code: -9
[task 2025-02-08T10:58:07.196Z] 10:58:07    ERROR - No tests run or test summary not found
[task 2025-02-08T10:58:07.197Z] 10:58:07     INFO - TinderboxPrint: xpcshell-xpcshell<br/><em class="testfail">T-FAIL</em>
[task 2025-02-08T10:58:07.197Z] 10:58:07  WARNING - setting return code to 2
[task 2025-02-08T10:58:07.197Z] 10:58:07     INFO - The xpcshell suite: xpcshell ran with return status: FAILURE
[task 2025-02-08T10:58:07.197Z] 10:58:07     INFO - Running post-action listener: _package_coverage_data
[task 2025-02-08T10:58:07.270Z] Error: No objdir path for resource://testing-common/PromiseTestUtils.sys.mjs.
[task 2025-02-08T10:58:07.270Z] Couldn't find source info for resource://testing-common/PromiseTestUtils.sys.mjs, removing record
[task 2025-02-08T10:58:07.270Z] Error: No objdir path for resource://testing-common/Assert.sys.mjs.
[task 2025-02-08T10:58:07.270Z] Couldn't find source info for resource://testing-common/Assert.sys.mjs, removing record
[task 2025-02-08T10:58:07.270Z] Error: No objdir path for resource://testing-common/StructuredLog.sys.mjs.
[task 2025-02-08T10:58:07.270Z] Couldn't find source info for resource://testing-common/StructuredLog.sys.mjs, removing record
[task 2025-02-08T10:58:07.270Z] Error: No objdir path for self-hosted.
[task 2025-02-08T10:58:07.270Z] Couldn't find source info for self-hosted, removing record
[task 2025-02-08T10:58:07.270Z] Error: No objdir path for resource://testing-common/BackgroundTasksTestUtils.sys.mjs.
[task 2025-02-08T10:58:07.270Z] Couldn't find source info for resource://testing-common/BackgroundTasksTestUtils.sys.mjs, removing record
[task 2025-02-08T10:58:07.270Z] Error: No objdir path for resource://testing-common/PerTestCoverageUtils.sys.mjs.
[task 2025-02-08T10:58:07.270Z] Couldn't find source info for resource://testing-common/PerTestCoverageUtils.sys.mjs, removing record
[task 2025-02-08T10:58:07.270Z] Error: No objdir path for -e.
<...>
[task 2025-02-08T10:58:08.811Z] 10:58:08     INFO - Getting output from command: ['/builds/worker/fetches/grcov/grcov', '-t', 'lcov', '-p', '/builds/worker/checkouts/gecko', '--ignore', '**/fetches/*', '/builds/worker/fetches/grcov/target.code-coverage-gcno.zip', '/tmp/tmpmxn23cqr']
[task 2025-02-08T10:58:08.812Z] 10:58:08     INFO - Copy/paste: /builds/worker/fetches/grcov/grcov -t lcov -p /builds/worker/checkouts/gecko --ignore **/fetches/* /builds/worker/fetches/grcov/target.code-coverage-gcno.zip /tmp/tmpmxn23cqr
[task 2025-02-08T10:58:30.986Z] 10:58:30     INFO - Reading from file tmpfile_stderr
[task 2025-02-08T10:58:30.986Z] 10:58:30     INFO - Return code: 0
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - Running post-action listener: _resource_record_post_action
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - Running post-action listener: process_java_coverage_data
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - [mozharness: 2025-02-08 10:58:40.104063Z] Finished run-tests step (success)
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - [mozharness: 2025-02-08 10:58:40.104099Z] Running uninstall step.
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - Running pre-action listener: _resource_record_pre_action
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - Running main action method: uninstall
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - Skipping uninstall for non-MSIX test
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - Running post-action listener: _resource_record_post_action
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - [mozharness: 2025-02-08 10:58:40.104342Z] Finished uninstall step (success)
[task 2025-02-08T10:58:40.104Z] 10:58:40     INFO - Running post-run listener: _resource_record_post_run
[task 2025-02-08T10:58:40.613Z] 10:58:40     INFO - Validating Perfherder data against /builds/worker/workspace/mozharness/external_tools/performance-artifact-schema.json
[task 2025-02-08T10:58:40.615Z] 10:58:40     INFO - PERFHERDER_DATA: {"framework": {"name": "job_resource_usage"}, "suites": [{"name": "xpcshell.xpcshell.1.overall", "extraOptions": ["e10s", "taskcluster-projects/887720501152/machineTypes/n2-standard-4"], "subtests": [{"name": "cpu_percent", "value": 8.555758473182077}, {"name": "io_write_bytes", "value": 5812137984}, {"name": "io.read_bytes", "value": 16384}, {"name": "io_write_time", "value": 6601848}, {"name": "io_read_time", "value": 812}]}, {"name": "xpcshell.xpcshell.1.start-pulseaudio", "subtests": [{"name": "time", "value": 0.014145605999999589}, {"name": "cpu_percent", "value": 0}]}, {"name": "xpcshell.xpcshell.1.install", "subtests": [{"name": "time", "value": 22.90900454199999}, {"name": "cpu_percent", "value": 25.210087719298244}]}, {"name": "xpcshell.xpcshell.1.stage-files", "subtests": [{"name": "time", "value": 0.017169570000021395}, {"name": "cpu_percent", "value": 0}]}, {"name": "xpcshell.xpcshell.1.run-tests", "subtests": [{"name": "time", "value": 1800.250219196}, {"name": "cpu_percent", "value": 8.341922628304934}]}, {"name": "xpcshell.xpcshell.1.uninstall", "subtests": [{"name": "time", "value": 0.00018798899964167504}, {"name": "cpu_percent", "value": 0}]}]}
[task 2025-02-08T10:58:40.615Z] 10:58:40     INFO - Total resource usage - Wall time: 1824s; CPU: Can't collect data; Read bytes: 16384; Write bytes: 5812137984; Read time: 812; Write time: 6601848
[task 2025-02-08T10:58:40.615Z] 10:58:40     INFO - TinderboxPrint: I/O read bytes / time<br/>16,384 / 812
[task 2025-02-08T10:58:40.615Z] 10:58:40     INFO - TinderboxPrint: I/O write bytes / time<br/>5,812,137,984 / 6,601,848
[task 2025-02-08T10:58:40.615Z] 10:58:40     INFO - TinderboxPrint: CPU idle<br/>6,594.7 (90.5%)
[task 2025-02-08T10:58:40.615Z] 10:58:40     INFO - TinderboxPrint: CPU system<br/>109.5 (1.5%)
[task 2025-02-08T10:58:40.615Z] 10:58:40     INFO - TinderboxPrint: CPU user<br/>515.3 (7.1%)
[task 2025-02-08T10:58:40.616Z] 10:58:40     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2025-02-08T10:58:40.618Z] 10:58:40     INFO - start-pulseaudio - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2025-02-08T10:58:40.621Z] 10:58:40     INFO - install - Wall time: 23s; CPU: 25%; Read bytes: 0; Write bytes: 99467264; Read time: 0; Write time: 54260
[task 2025-02-08T10:58:40.623Z] 10:58:40     INFO - stage-files - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2025-02-08T10:58:40.712Z] 10:58:40     INFO - run-tests - Wall time: 1800s; CPU: 8%; Read bytes: 16384; Write bytes: 5712670720; Read time: 812; Write time: 6547588
[task 2025-02-08T10:58:40.718Z] 10:58:40     INFO - uninstall - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2025-02-08T10:58:43.573Z] 10:58:43  WARNING - returning nonzero exit status 2
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/profile/test/xpcshell/test_snap.js.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/profile/test/xpcshell/test_snap.js, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/intl/uconv/tests/unit/test_encode_8859-2.js.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/intl/uconv/tests/unit/test_encode_8859-2.js, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/profile/test/xpcshell/test_single_profile_unselected.js.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/profile/test/xpcshell/test_single_profile_unselected.js, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/extensions/permissions/test/unit/test_permmanager_migrate_5-7b.js.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/extensions/permissions/test/unit/test_permmanager_migrate_5-7b.js, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/intl/uconv/tests/unit/test_decode_macintosh.js.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/intl/uconv/tests/unit/test_decode_macintosh.js, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for resource://testing-common/backgroundtasks/BackgroundTask_minruntime.sys.mjs.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for resource://testing-common/backgroundtasks/BackgroundTask_minruntime.sys.mjs, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/extensions/permissions/test/unit/test_permmanager_removepermission.js.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/extensions/permissions/test/unit/test_permmanager_removepermission.js, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/xulstore/tests/xpcshell/test_XULStore.js.
[task 2025-02-08T10:58:43.573Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/xulstore/tests/xpcshell/test_XULStore.js, removing record
[task 2025-02-08T10:58:43.573Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/backgroundtasks/tests/xpcshell/test_backgroundtask_shouldprocessupdates.js.
[task 2025-02-08T10:58:43.574Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/backgroundtasks/tests/xpcshell/test_backgroundtask_shouldprocessupdates.js, removing record
[task 2025-02-08T10:58:43.574Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/intl/uconv/tests/unit/test_decode_CP1250.js.
[task 2025-02-08T10:58:43.574Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/intl/uconv/tests/unit/test_decode_CP1250.js, removing record
[task 2025-02-08T10:58:43.574Z] Error: No objdir path for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/profile/test/xpcshell/test_select_missing.js.
[task 2025-02-08T10:58:43.574Z] Couldn't find source info for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/profile/test/xpcshell/test_select_missing.js, removing record
[task 2025-02-08T10:58:43.751Z] cleanup
[task 2025-02-08T10:58:43.751Z] + cleanup
[task 2025-02-08T10:58:43.751Z] + local rv=2
[task 2025-02-08T10:58:43.751Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2025-02-08T10:58:43.751Z] + cp /builds/worker/.xsession-errors /builds/worker/artifacts/public/xsession-errors.log
[task 2025-02-08T10:58:43.753Z] + false
[task 2025-02-08T10:58:43.753Z] + '[' ']'
[task 2025-02-08T10:58:43.753Z] + true
[task 2025-02-08T10:58:43.753Z] + cleanup_xvfb
[task 2025-02-08T10:58:43.753Z] ++ pidof Xvfb
[task 2025-02-08T10:58:43.766Z] + local xvfb_pid=51
[task 2025-02-08T10:58:43.766Z] + local vnc=false
[task 2025-02-08T10:58:43.766Z] + local interactive=false
[task 2025-02-08T10:58:43.766Z] + '[' -n 51 ']'
[task 2025-02-08T10:58:43.766Z] + [[ false == false ]]
[task 2025-02-08T10:58:43.766Z] + [[ false == false ]]
[task 2025-02-08T10:58:43.766Z] + kill 51
[task 2025-02-08T10:58:43.766Z] + exit 2
[taskcluster 2025-02-08 10:58:44.485Z] === Task Finished ===
[taskcluster 2025-02-08 10:58:47.784Z] Unsuccessful task run with exit code: 2 completed in 2097.962 seconds

Comment 1

[amarc]

Hi Joel, could you also take a look at this one? Thanks.

Comment 2

[Intermittent Failures Robot]

Summary

4 failures in 4309 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-ccov-qr: 4
  • opt: 4

Table

	no_variant	nofis	spi-nw-nofis
linux1804-64-ccov-qr--/opt	1	2	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1946935&startday=2025-02-03&endday=2025-02-09&tree=all

Comment 3

[Intermittent Failures Robot]

Summary

15 failures in 5022 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 13
• comm-central: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 14
  • opt: 14
• windows11-64-24h2: 1
  • opt: 1

Table

	no_variant	nofis	spi-nw-nofis
linux1804-64-ccov-qr--/opt	3	8	3
windows11-64-24h2--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1946935&startday=2025-02-10&endday=2025-02-16&tree=all

Comment 4

[Intermittent Failures Robot]

Summary

12 failures in 4340 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 12

Platform and build breakdown:

• linux1804-64-ccov-qr: 12
  • opt: 12

Table

	no_variant	nofis	spi-nw-nofis
linux1804-64-ccov-qr--/opt	8	2	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1946935&startday=2025-02-17&endday=2025-02-23&tree=all

Comment 5

[Intermittent Failures Robot]

Summary

3 failures in 4564 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-ccov-qr: 3
  • opt: 3

Table

	nofis
linux1804-64-ccov-qr--/opt	3

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1946935&startday=2025-02-24&endday=2025-03-02&tree=all

Comment 6

[Intermittent Failures Robot]

Summary

17 failures in 4009 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 17

Platform and build breakdown:

• linux1804-64-ccov-qr: 16
  • opt: 16
• macosx1015-64-qr: 1
  • debug: 1

Table

	no_variant	nofis	spi-nw	spi-nw-nofis
linux1804-64-ccov-qr--/opt	8	5		3
macosx1015-64-qr--/debug			1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1946935&startday=2025-03-03&endday=2025-03-09&tree=all

Comment 7

[Intermittent Failures Robot]

Summary

11 failures in 4826 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-ccov-qr: 10
  • opt: 10
• windows11-32-24h2: 1
  • debug: 1

Table

	no_variant	nofis	spi-nw-nofis
linux1804-64-ccov-qr--/opt	6	3	1
windows11-32-24h2--/debug	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1946935&startday=2025-03-10&endday=2025-03-16&tree=all