1971518 - Perma xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js | xpcshell return code: 0 - when release merges to esr140 on 2025-06-16

Status: RESOLVED FIXED

(Firefox :: Search, defect, P1)

Description

[amarc]

Esr140 simulation
Failure Log

[task 2025-06-11T11:45:35.313Z] 11:45:35     INFO -  TEST-START | devtools/server/tests/xpcshell/test_extension_storage_actor.js
[task 2025-06-11T11:45:41.896Z] 11:45:41     INFO -  TEST-PASS | devtools/server/tests/xpcshell/test_extension_storage_actor.js | took 6582ms
[task 2025-06-11T11:45:41.902Z] 11:45:41     INFO -  TEST-START | xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js
[task 2025-06-11T11:46:21.918Z] 11:46:21  WARNING -  TEST-UNEXPECTED-FAIL | xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js | xpcshell return code: 0
[task 2025-06-11T11:46:21.919Z] 11:46:21     INFO -  TEST-INFO took 40016ms
[task 2025-06-11T11:46:21.920Z] 11:46:21     INFO -  >>>>>>>
[task 2025-06-11T11:46:21.920Z] 11:46:21     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2025-06-11T11:46:21.920Z] 11:46:21     INFO -  (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2025-06-11T11:46:21.920Z] 11:46:21     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2025-06-11T11:46:21.921Z] 11:46:21     INFO -  running event loop
[task 2025-06-11T11:46:21.921Z] 11:46:21     INFO -  xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js | Starting setup
[task 2025-06-11T11:46:21.922Z] 11:46:21     INFO -  (xpcshell/head.js) | test pending (2)
[task 2025-06-11T11:46:21.923Z] 11:46:21     INFO -  (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2025-06-11T11:46:21.923Z] 11:46:21     INFO -  (xpcshell/head.js) | test run_next_test 1 pending (2)
[task 2025-06-11T11:46:21.923Z] 11:46:21     INFO -  (xpcshell/head.js) | test finished (2)
[task 2025-06-11T11:46:21.923Z] 11:46:21     INFO -  xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js | Starting test_searchConfig_google
[task 2025-06-11T11:46:21.923Z] 11:46:21     INFO -  (xpcshell/head.js) | test test_searchConfig_google pending (2)
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  (xpcshell/head.js) | test run_next_test 1 finished (2)
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  (xpcshell/head.js) | test run_next_test 2 pending (2)
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  (xpcshell/head.js) | test test_searchConfig_google finished (2)
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js | Starting test_searchConfig_google_with_pref_param
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  (xpcshell/head.js) | test test_searchConfig_google_with_pref_param pending (2)
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  "Checking region US, locale en-US"
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  (xpcshell/head.js) | test run_next_test 2 finished (2)
[task 2025-06-11T11:46:21.924Z] 11:46:21     INFO -  TEST-PASS | xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js | test_searchConfig_google_with_pref_param - [test_searchConfig_google_with_pref_param : 113] Should have the correct engine - true == true
[task 2025-06-11T11:46:21.925Z] 11:46:21     INFO -  PID 90950 | console.log: ({QueryInterface:{}, _metaData:{}, _loadPath:"[app]google", _name:"Google", _queryCharset:"UTF-8", _orderHint:null, _telemetryId:"google-b-1-e", _engineAddedToStore:false, _definedAliases:["@google"], _urls:[{params:[{name:"client", _value:"firefox-b-1-e"}, {name:"channel", _value:"entpr"}, {name:"q", _value:"{searchTerms}"}], rels:[], template:"https://www.google.com/search", type:"text/html", method:"GET", templateHost:"www.google.com"}, {params:[{name:"client", _value:"firefox"}, {name:"channel", _value:"search_rich_suggestions"}, {name:"q", _value:"{searchTerms}"}], rels:[], template:"https://www.google.com/complete/search", type:"application/x-suggestions+json", method:"GET", templateHost:"www.google.com"}, {params:[{name:"client", _value:"firefox"}, {name:"channel", _value:"ftr"}, {name:"q", _value:"{searchTerms}"}], rels:[], template:"https://www.google.com/complete/search", type:"application/x-trending+json", method:"GET", templateHost:"www.google.com"}], _searchUrlPublicSuffix:null, clickUrl:null})
[task 2025-06-11T11:46:21.926Z] 11:46:21  WARNING -  TEST-UNEXPECTED-FAIL | xpcshell.toml:toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js | test_searchConfig_google_with_pref_param - [test_searchConfig_google_with_pref_param : 120] Should be including the correct preference parameter for the engine - false == true
[task 2025-06-11T11:46:21.926Z] 11:46:21     INFO -  /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js:test_searchConfig_google_with_pref_param:120
[task 2025-06-11T11:46:21.926Z] 11:46:21     INFO -  exiting test
[task 2025-06-11T11:46:21.926Z] 11:46:21     INFO -  Unexpected exception NS_ERROR_ABORT:
[task 2025-06-11T11:46:21.926Z] 11:46:21     INFO -  _abort_failed_test@/builds/worker/workspace/build/tests/xpcshell/head.js:869:20
[task 2025-06-11T11:46:21.927Z] 11:46:21     INFO -  do_report_result@/builds/worker/workspace/build/tests/xpcshell/head.js:981:5
[task 2025-06-11T11:46:21.927Z] 11:46:21     INFO -  Assert<@/builds/worker/workspace/build/tests/xpcshell/head.js:70:21
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  Assert.prototype.report@resource://testing-common/Assert.sys.mjs:251:10
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  Assert.prototype.ok@resource://testing-common/Assert.sys.mjs:277:10
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  test_searchConfig_google_with_pref_param@/builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/search/tests/xpcshell/searchconfigs/test_google.js:120:12
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  async*_run_next_test/<@/builds/worker/workspace/build/tests/xpcshell/head.js:1759:22
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  _run_next_test@/builds/worker/workspace/build/tests/xpcshell/head.js:1759:38
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  run@/builds/worker/workspace/build/tests/xpcshell/head.js:808:9
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  _do_main@/builds/worker/workspace/build/tests/xpcshell/head.js:245:6
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  _execute_test@/builds/worker/workspace/build/tests/xpcshell/head.js:596:5
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  @-e:1:1
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  exiting test
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  <<<<<<<
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  INFO | Result summary:
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  INFO | Passed: 1458
[task 2025-06-11T11:46:21.928Z] 11:46:21  WARNING -  INFO | Failed: 1
[task 2025-06-11T11:46:21.928Z] 11:46:21  WARNING -  One or more unittests failed.
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  INFO | Todo: 0
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  INFO | Retried: 3
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  SUITE-END | took 638s
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  Node moz-http2 server shutting down ...
[task 2025-06-11T11:46:21.928Z] 11:46:21     INFO -  http3Server server shutting down ...
[task 2025-06-11T11:46:22.091Z] 11:46:22     INFO - Return code: 1
[task 2025-06-11T11:46:22.091Z] 11:46:22     INFO - TinderboxPrint: xpcshell-xpcshell<br/>1458/<em class="testfail">1</em>/0
[task 2025-06-11T11:46:22.091Z] 11:46:22  WARNING - setting return code to 2
[task 2025-06-11T11:46:22.091Z] 11:46:22     INFO - The xpcshell suite: xpcshell ran with return status: FAILURE
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Running post-action listener: _package_coverage_data
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Running post-action listener: _resource_record_post_action
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Running post-action listener: process_java_coverage_data
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - [mozharness: 2025-06-11 11:46:22.092221Z] Finished run-tests step (success)
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - [mozharness: 2025-06-11 11:46:22.092281Z] Running uninstall step.
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Running pre-action listener: _resource_record_pre_action
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Running main action method: uninstall
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Skipping uninstall for non-MSIX test
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Running post-action listener: _resource_record_post_action
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - [mozharness: 2025-06-11 11:46:22.092524Z] Finished uninstall step (success)
[task 2025-06-11T11:46:22.092Z] 11:46:22     INFO - Running post-run listener: _resource_record_post_run
[task 2025-06-11T11:46:22.370Z] 11:46:22     INFO - Validating Perfherder data against /builds/worker/workspace/mozharness/external_tools/performance-artifact-schema.json
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - PERFHERDER_DATA: {"framework": {"name": "job_resource_usage"}, "suites": [{"name": "xpcshell.xpcshell.1.overall", "extraOptions": ["e10s", "taskcluster-projects/887720501152/machineTypes/c2-standard-4"], "subtests": [{"name": "cpu_percent", "value": 73.74830416546126}, {"name": "io_write_bytes", "value": 10905944064}, {"name": "io.read_bytes", "value": 8282112}, {"name": "io_write_time", "value": 1575440}, {"name": "io_read_time", "value": 1149}]}, {"name": "xpcshell.xpcshell.1.start-pulseaudio", "subtests": [{"name": "time", "value": 0.019007908999810752}, {"name": "cpu_percent", "value": 0}]}, {"name": "xpcshell.xpcshell.1.install", "subtests": [{"name": "time", "value": 5.575350469000114}, {"name": "cpu_percent", "value": 25.39814814814815}]}, {"name": "xpcshell.xpcshell.1.stage-files", "subtests": [{"name": "time", "value": 0.023647819999496278}, {"name": "cpu_percent", "value": 0}]}, {"name": "xpcshell.xpcshell.1.run-tests", "subtests": [{"name": "time", "value": 685.5805463340002}, {"name": "cpu_percent", "value": 74.1489609158523}]}, {"name": "xpcshell.xpcshell.1.uninstall", "subtests": [{"name": "time", "value": 0.0001497289995313622}, {"name": "cpu_percent", "value": 0}]}]}
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - Total resource usage - Wall time: 691s; CPU: Can't collect data; Read bytes: 8282112; Write bytes: 10905944064; Read time: 1149; Write time: 1575440
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - TinderboxPrint: I/O read bytes / time<br/>8,282,112 / 1,149
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - TinderboxPrint: I/O write bytes / time<br/>10,905,944,064 / 1,575,440
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - TinderboxPrint: CPU idle<br/>580.5 (21.0%)
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - TinderboxPrint: CPU iowait<br/>140.3 (5.1%)
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - TinderboxPrint: CPU system<br/>265.7 (9.6%)
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - TinderboxPrint: CPU user<br/>1,767.2 (64.1%)
[task 2025-06-11T11:46:22.372Z] 11:46:22     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2025-06-11T11:46:22.374Z] 11:46:22     INFO - start-pulseaudio - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2025-06-11T11:46:22.375Z] 11:46:22     INFO - install - Wall time: 6s; CPU: 25%; Read bytes: 0; Write bytes: 10969088; Read time: 0; Write time: 576
[task 2025-06-11T11:46:22.376Z] 11:46:22     INFO - stage-files - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2025-06-11T11:46:22.418Z] 11:46:22     INFO - run-tests - Wall time: 686s; CPU: 74%; Read bytes: 8282112; Write bytes: 10894974976; Read time: 1149; Write time: 1574864
[task 2025-06-11T11:46:22.422Z] 11:46:22     INFO - uninstall - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2025-06-11T11:46:23.676Z] 11:46:23  WARNING - returning nonzero exit status 2
[task 2025-06-11T11:46:23.757Z] cleanup
[task 2025-06-11T11:46:23.757Z] + cleanup
[task 2025-06-11T11:46:23.757Z] + local rv=2
[task 2025-06-11T11:46:23.757Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2025-06-11T11:46:23.757Z] + cp /builds/worker/.xsession-errors /builds/worker/artifacts/public/xsession-errors.log
[task 2025-06-11T11:46:23.759Z] + false
[task 2025-06-11T11:46:23.759Z] + '[' ']'
[task 2025-06-11T11:46:23.759Z] + true
[task 2025-06-11T11:46:23.759Z] + cleanup_xvfb
[task 2025-06-11T11:46:23.760Z] ++ pidof Xvfb
[task 2025-06-11T11:46:23.830Z] + local xvfb_pid=49
[task 2025-06-11T11:46:23.830Z] + local vnc=false
[task 2025-06-11T11:46:23.830Z] + local interactive=false
[task 2025-06-11T11:46:23.830Z] + '[' -n 49 ']'
[task 2025-06-11T11:46:23.830Z] + [[ false == false ]]
[task 2025-06-11T11:46:23.830Z] + [[ false == false ]]
[task 2025-06-11T11:46:23.830Z] + kill 49
[task 2025-06-11T11:46:23.830Z] + exit 2
[taskcluster 2025-06-11T11:46:24.088Z]                   Exit Code: 2
[taskcluster 2025-06-11T11:46:24.088Z]                   User Time: 215.17ms
[taskcluster 2025-06-11T11:46:24.088Z]                 Kernel Time: 196.759ms
[taskcluster 2025-06-11T11:46:24.088Z]                   Wall Time: 12m37.811224884s
[taskcluster 2025-06-11T11:46:24.088Z]  Average System Memory Used: 2.26 GiB
[taskcluster 2025-06-11T11:46:24.088Z]     Peak System Memory Used: 5.82 GiB
[taskcluster 2025-06-11T11:46:24.088Z]         Total System Memory: 15.62 GiB
[taskcluster 2025-06-11T11:46:24.088Z]                      Result: FAILED
[taskcluster 2025-06-11T11:46:24.088Z] === Task Finished ===
[taskcluster 2025-06-11T11:46:24.088Z] Task Duration: 12m37.811904202s
[taskcluster 2025-06-11T11:46:24.860Z] Uploading artifact public/test_info/xpcshell_errorsummary.log from file /home/task_174964142579171/artifact2/xpcshell_errorsummary.log with content encoding "gzip", mime type "text/plain" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.862Z] Uploading artifact public/test_info/6f06f035-bae0-81b5-45b0-db1e294e1071.extra from file /home/task_174964142579171/artifact2/6f06f035-bae0-81b5-45b0-db1e294e1071.extra with content encoding "gzip", mime type "application/octet-stream" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.863Z] Uploading artifact public/test_info/profile_resource-usage.json from file /home/task_174964142579171/artifact2/profile_resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.868Z] Uploading artifact public/test_info/6f06f035-bae0-81b5-45b0-db1e294e1071.dmp from file /home/task_174964142579171/artifact2/6f06f035-bae0-81b5-45b0-db1e294e1071.dmp with content encoding "gzip", mime type "application/vnd.tcpdump.pcap" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.881Z] Uploading artifact public/test_info/resource-usage.json from file /home/task_174964142579171/artifact2/resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.886Z] Uploading artifact public/test/public/xsession-errors.log from file /home/task_174964142579171/artifact1/public/xsession-errors.log with content encoding "gzip", mime type "text/plain" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.897Z] Uploading artifact public/logs/localconfig.json from file /home/task_174964142579171/artifact0/localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.956Z] Uploading artifact public/test/xvfb/xvfb.log from file /home/task_174964142579171/artifact1/xvfb/xvfb.log with content encoding "gzip", mime type "text/plain" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:24.976Z] Uploading artifact public/test_info/system-info.log from file /home/task_174964142579171/artifact2/system-info.log with content encoding "gzip", mime type "text/plain" and expiry 2025-07-09T10:13:40.599Z
[taskcluster 2025-06-11T11:46:25.203Z] [mounts] Preserving cache: Moving "/home/task_174964142579171/cache0" to "/home/generic-worker/caches/X_vnaEZ7TAGYfL1tYNB_-w"
[taskcluster 2025-06-11T11:46:25.203Z] [mounts] Preserving cache: Moving "/home/task_174964142579171/cache1" to "/home/generic-worker/caches/VWHmQlJcQPqn_tYbmdVcLg"
[taskcluster 2025-06-11T11:46:25.203Z] [mounts] Preserving cache: Moving "/home/task_174964142579171/cache2" to "/home/generic-worker/caches/C-pvbuRYRWm3Cq_3HezCLw"
[taskcluster 2025-06-11T11:46:25.510Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-07-09T10:13:40.599Z
[taskcluster:error] exit status 2

Comment 1

[Julien Cristau [:jcristau] (back on 2026-01-06)]

[Tracking Requested - why for this release]: permanent failure on esr140

Comment 2

[Mark Banner (:standard8)]

It looks like we didn't backport the test fixes from bug 1932923 onto main (central at the time). I believe this is test-only, I will get these ported across.

Comment 3

[Mark Banner (:standard8)]

Attachment: Bug 1971518 - Fix test failures for search tests when run on esr140. r?mbeier!

Comment 6

[Donal Meehan [:dmeehan]]

Next week is RC week for Fx140, the ESR140 will be updated with Beta before we build esr.
:standard8, any concerns with landing this and adding a beta uplift request?

Comment 7

[Mark Banner (:standard8)]

Attachment: Bug 1971518 - Fix test failures for search tests when run on esr140.

Original Revision: https://phabricator.services.mozilla.com/D253336

Comment 8

[Phabricator Automation]

firefox-beta Uplift Approval Request

• User impact if declined: N/A - test-only change for fixing tests when run on the ESR140 branch
• Code covered by automated testing: yes
• Fix verified in Nightly: no
• Needs manual QE test: no
• Steps to reproduce for manual QE testing: N/A
• Risk associated with taking this patch: None
• Explanation of risk level: Test-only
• String changes made/needed: None
• Is Android affected?: no

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/923a9ddf906d
https://hg.mozilla.org/integration/autoland/rev/fef0a9d149db
Fix test failures for search tests when run on esr140. r=mbeier

Comment 10

[amarc]

https://hg.mozilla.org/mozilla-central/rev/fef0a9d149db

Comment 11

[Pulsebot]

https://github.com/mozilla-firefox/firefox/commit/710e13478888
https://hg.mozilla.org/releases/mozilla-beta/rev/37d63cd8d81c