1893058 - Perma condprof toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteByPrincipal - [test_deleteByPrincipal : 280] Should have deleted only 'common-bounce-tracker.com' for default OA.

Status: RESOLVED INCOMPLETE

(Toolkit :: Data Sanitization, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=455568369&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bX-REAh0RdqDX1A9ZeQOxQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-04-23T19:01:40.777Z] 19:01:40     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_quota.js | took 20917ms
[task 2024-04-23T19:01:42.477Z] 19:01:42     INFO -  Retrying tests that failed when run in parallel.
[task 2024-04-23T19:01:52.746Z] 19:01:52     INFO -  Created a conditioned-profile copy: /tmp/tmp7n6dfm27/profile
[task 2024-04-23T19:01:52.749Z] 19:01:52     INFO -  TEST-START | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js
[task 2024-04-23T19:01:52.935Z] 19:01:52  WARNING -  TEST-UNEXPECTED-FAIL | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | xpcshell return code: 0
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  TEST-INFO took 180ms
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  >>>>>>>
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  running event loop
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | Starting test_deleteAll
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  (xpcshell/head.js) | test test_deleteAll pending (2)
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  "Adding test data."
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  "Deleting all data."
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteAll - [test_deleteAll : 213] Clearing should have succeeded - 0 == 0
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteAll - [test_deleteAll : 219] All bounce tracker candidates for default OA should be deleted. - 0 == 0
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteAll - [test_deleteAll : 225] All user activations for default OA should be deleted. - 0 == 0
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteAll - [test_deleteAll : 231] All bounce tracker candidates for private browsing should be deleted. - 0 == 0
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteAll - [test_deleteAll : 238] All user activations for private browsing should be deleted. - 0 == 0
[task 2024-04-23T19:01:52.935Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteAll - [test_deleteAll : 245] All bounce tracker candidates for container 1 should be deleted. - 0 == 0
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteAll - [test_deleteAll : 251] All user activations for container 1 should be deleted. - 0 == 0
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  (xpcshell/head.js) | test run_next_test 1 pending (2)
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  (xpcshell/head.js) | test test_deleteAll finished (2)
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | Starting test_deleteByPrincipal
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  (xpcshell/head.js) | test test_deleteByPrincipal pending (2)
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  "Adding test data."
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  PID 1469 | console.debug: "principal" "https://common-bounce-tracker.com"
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  "Deleting by principal https://common-bounce-tracker.com"
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  (xpcshell/head.js) | test run_next_test 1 finished (2)
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  TEST-PASS | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteByPrincipal - [test_deleteByPrincipal : 274] Clearing should have succeeded - 0 == 0
[task 2024-04-23T19:01:52.936Z] 19:01:52  WARNING -  TEST-UNEXPECTED-FAIL | toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js | test_deleteByPrincipal - [test_deleteByPrincipal : 280] Should have deleted only 'common-bounce-tracker.com' for default OA. - ["bounce-tracker-normal-browsing.com","bounce-tracker-normal-browsing2.com","youtube.com"] deepEqual ["bounce-tracker-normal-browsing.com","bounce-tracker-normal-browsing2.com"]
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js:test_deleteByPrincipal:280
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  /builds/worker/workspace/build/tests/xpcshell/head.js:_do_main:245
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  /builds/worker/workspace/build/tests/xpcshell/head.js:_execute_test:596
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  -e:null:1
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  exiting test
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  Unexpected exception NS_ERROR_ABORT:
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  _abort_failed_test@/builds/worker/workspace/build/tests/xpcshell/head.js:869:20
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  do_report_result@/builds/worker/workspace/build/tests/xpcshell/head.js:981:5
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  Assert<@/builds/worker/workspace/build/tests/xpcshell/head.js:70:21
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  Assert.prototype.report@resource://testing-common/Assert.sys.mjs:251:10
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  deepEqual@resource://testing-common/Assert.sys.mjs:331:8
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  test_deleteByPrincipal@/builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js:280:10
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  _do_main@/builds/worker/workspace/build/tests/xpcshell/head.js:245:6
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  _execute_test@/builds/worker/workspace/build/tests/xpcshell/head.js:596:5
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  @-e:1:1
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  exiting test
[task 2024-04-23T19:01:52.936Z] 19:01:52     INFO -  <<<<<<<
[task 2024-04-23T19:01:55.306Z] 19:01:55     INFO -  INFO | Result summary:
[task 2024-04-23T19:01:55.306Z] 19:01:55     INFO -  INFO | Passed: 13
[task 2024-04-23T19:01:55.306Z] 19:01:55  WARNING -  INFO | Failed: 1
[task 2024-04-23T19:01:55.306Z] 19:01:55  WARNING -  One or more unittests failed.
[task 2024-04-23T19:01:55.306Z] 19:01:55     INFO -  INFO | Todo: 0
[task 2024-04-23T19:01:55.306Z] 19:01:55     INFO -  INFO | Retried: 1
[task 2024-04-23T19:01:55.306Z] 19:01:55     INFO -  SUITE-END | took 242s
[task 2024-04-23T19:01:55.306Z] 19:01:55     INFO -  Node moz-http2 server shutting down ...
[task 2024-04-23T19:01:55.306Z] 19:01:55     INFO -  http3Server server shutting down ...
[task 2024-04-23T19:01:55.500Z] 19:01:55     INFO - Return code: 1
[task 2024-04-23T19:01:55.501Z] 19:01:55     INFO - TinderboxPrint: xpcshell-xpcshell<br/>13/<em class="testfail">1</em>/0
[task 2024-04-23T19:01:55.501Z] 19:01:55  WARNING - setting return code to 2
[task 2024-04-23T19:01:55.501Z] 19:01:55     INFO - The xpcshell suite: xpcshell ran with return status: FAILURE
[task 2024-04-23T19:01:55.502Z] 19:01:55     INFO - Running post-action listener: _package_coverage_data
[task 2024-04-23T19:01:55.502Z] 19:01:55     INFO - Running post-action listener: _resource_record_post_action
[task 2024-04-23T19:01:55.502Z] 19:01:55     INFO - Running post-action listener: process_java_coverage_data
[task 2024-04-23T19:01:55.503Z] 19:01:55     INFO - [mozharness: 2024-04-23 19:01:55.502842Z] Finished run-tests step (success)
[task 2024-04-23T19:01:55.503Z] 19:01:55     INFO - [mozharness: 2024-04-23 19:01:55.503133Z] Running uninstall step.
[task 2024-04-23T19:01:55.503Z] 19:01:55     INFO - Running pre-action listener: _resource_record_pre_action
[task 2024-04-23T19:01:55.503Z] 19:01:55     INFO - Running main action method: uninstall
[task 2024-04-23T19:01:55.503Z] 19:01:55     INFO - Skipping uninstall for non-MSIX test
[task 2024-04-23T19:01:55.504Z] 19:01:55     INFO - Running post-action listener: _resource_record_post_action
[task 2024-04-23T19:01:55.504Z] 19:01:55     INFO - [mozharness: 2024-04-23 19:01:55.504030Z] Finished uninstall step (success)
[task 2024-04-23T19:01:55.504Z] 19:01:55     INFO - Running post-run listener: _resource_record_post_run
[task 2024-04-23T19:01:55.652Z] 19:01:55     INFO - Validating Perfherder data against /builds/worker/workspace/mozharness/external_tools/performance-artifact-schema.json
[task 2024-04-23T19:01:55.655Z] 19:01:55     INFO - PERFHERDER_DATA: {"framework": {"name": "job_resource_usage"}, "suites": [{"name": "xpcshell.xpcshell.overall", "extraOptions": ["e10s", "taskcluster-projects/887720501152/machineTypes/n2-standard-2"], "subtests": [{"name": "cpu_percent", "value": 64.94778397898854}, {"name": "io_write_bytes", "value": 76864348160}, {"name": "io.read_bytes", "value": 9120370688}, {"name": "io_write_time", "value": 142963288}, {"name": "io_read_time", "value": 202904}]}, {"name": "xpcshell.xpcshell.start-pulseaudio", "subtests": [{"name": "time", "value": 0.02695713300002467}, {"name": "cpu_percent", "value": 0}]}, {"name": "xpcshell.xpcshell.install", "subtests": [{"name": "time", "value": 11.981147883000006}, {"name": "cpu_percent", "value": 50.44033613445379}]}, {"name": "xpcshell.xpcshell.stage-files", "subtests": [{"name": "time", "value": 0.055547415000006595}, {"name": "cpu_percent", "value": 0}]}, {"name": "xpcshell.xpcshell.run-tests", "subtests": [{"name": "time", "value": 292.550461298}, {"name": "cpu_percent", "value": 65.5396752136749}]}, {"name": "xpcshell.xpcshell.uninstall", "subtests": [{"name": "time", "value": 0.0005084919999944759}, {"name": "cpu_percent", "value": 0}]}]}
[task 2024-04-23T19:01:55.656Z] 19:01:55     INFO - Total resource usage - Wall time: 305s; CPU: Can't collect data; Read bytes: 9120370688; Write bytes: 76864348160; Read time: 202904; Write time: 142963288
[task 2024-04-23T19:01:55.656Z] 19:01:55     INFO - TinderboxPrint: I/O read bytes / time<br/>9,120,370,688 / 202,904
[task 2024-04-23T19:01:55.657Z] 19:01:55     INFO - TinderboxPrint: I/O write bytes / time<br/>76,864,348,160 / 142,963,288
[task 2024-04-23T19:01:55.657Z] 19:01:55     INFO - TinderboxPrint: CPU idle<br/>111.3 (18.6%)
[task 2024-04-23T19:01:55.658Z] 19:01:55     INFO - TinderboxPrint: CPU iowait<br/>96.1 (16.1%)
[task 2024-04-23T19:01:55.658Z] 19:01:55     INFO - TinderboxPrint: CPU system<br/>220.7 (37.0%)
[task 2024-04-23T19:01:55.658Z] 19:01:55     INFO - TinderboxPrint: CPU user<br/>168.3 (28.2%)
[task 2024-04-23T19:01:55.659Z] 19:01:55     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2024-04-23T19:01:55.659Z] 19:01:55     INFO - start-pulseaudio - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T19:01:55.660Z] 19:01:55     INFO - install - Wall time: 12s; CPU: 50%; Read bytes: 40960; Write bytes: 14729216; Read time: 0; Write time: 1160
[task 2024-04-23T19:01:55.660Z] 19:01:55     INFO - stage-files - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T19:01:55.668Z] 19:01:55     INFO - run-tests - Wall time: 293s; CPU: 66%; Read bytes: 9120329728; Write bytes: 76849618944; Read time: 202904; Write time: 142962128
[task 2024-04-23T19:01:55.669Z] 19:01:55     INFO - uninstall - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T19:01:56.050Z] 19:01:56  WARNING - returning nonzero exit status 2
[task 2024-04-23T19:01:56.078Z] cleanup
[task 2024-04-23T19:01:56.078Z] + cleanup
[task 2024-04-23T19:01:56.078Z] + local rv=2
[task 2024-04-23T19:01:56.078Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2024-04-23T19:01:56.078Z] + cp /builds/worker/.xsession-errors /builds/worker/artifacts/public/xsession-errors.log
[task 2024-04-23T19:01:56.083Z] + '[' ']'
[task 2024-04-23T19:01:56.083Z] + true
[task 2024-04-23T19:01:56.083Z] + cleanup_xvfb
[task 2024-04-23T19:01:56.083Z] ++ pidof Xvfb
[task 2024-04-23T19:01:56.087Z] + local xvfb_pid=50
[task 2024-04-23T19:01:56.087Z] + local vnc=false
[task 2024-04-23T19:01:56.087Z] + local interactive=false
[task 2024-04-23T19:01:56.087Z] + '[' -n 50 ']'
[task 2024-04-23T19:01:56.087Z] + [[ false == false ]]
[task 2024-04-23T19:01:56.087Z] + [[ false == false ]]
[task 2024-04-23T19:01:56.087Z] + kill 50
[task 2024-04-23T19:01:56.087Z] + screen -XS xvfb quit
[task 2024-04-23T19:01:56.132Z] + exit 2
[taskcluster 2024-04-23 19:01:59.557Z] === Task Finished ===
[taskcluster 2024-04-23 19:02:00.831Z] Unsuccessful task run with exit code: 2 completed in 475.448 seconds

Comment 1

[Serban Stanca [:SerbanS]]

This is permafailing on X-condprof jobs and after backfill and retriggers it fails even before, where it was green.

Hi Joel! Could you please take a look at this?

Thank you!

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

this appears to be a case when the profile from m-c got updated it has data which is causing toolkit/components/cleardata/tests/unit/test_bounce_tracking_protection.js to fail. I believe we have a reference to youtube.com which wasn't expected.

maybe we can fix the test to not be so sensitive? if not, it seems like we should disable this test for condprof.

for mochitest and service workers, we do some stuff to ignore certain values:
https://searchfox.org/mozilla-central/source/testing/mochitest/tests/SimpleTest/SimpleTest.js#1504

this is a new test as of 2 months ago, let me redirect to the original test author to see if there is something to do in order to make this less sensitive.

Comment 3

[Cosmin Sabou [:CosminS]]

Attachment: Bug 1893058 - Disable test_bounce_tracking_protection on condprof for permafailing. r=#intermittent-reviewers

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/97543cbcce3f
Disable test_bounce_tracking_protection on condprof for permafailing. r=intermittent-reviewers,jmaher DONTBUILD

Comment 5

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/97543cbcce3f

Comment 6

[Intermittent Failures Robot]

30 failures in 873 pushes (0.034 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 24
• mozilla-central: 6

Platform and build breakdown:

• linux1804-64-qr: 6
  • opt: 6
• windows11-64-2009-qr: 6
  • opt: 6
• linux1804-64-shippable-qr: 9
  • opt: 9
• windows11-64-2009-shippable-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1893058&startday=2024-04-25&endday=2024-04-25&tree=all

Comment 7

[Emma Zühlcke [:emz]]

The test is currently setup as a "clean room" test. It could be refactored to take snapshots of the pre and post clearing states and only assert that the test site hosts have been cleared. This could be helpful for better test coverage, but I don't think it's particularly high priority for us.

Comment 8

[Intermittent Failures Robot]

48 failures in 4336 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #29 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 40
• mozilla-central: 8

Platform and build breakdown:

• linux1804-64-qr: 16
  • opt: 16
• linux1804-64-shippable-qr: 17
  • opt: 17
• windows11-64-2009-qr: 6
  • opt: 6
• windows11-64-2009-shippable-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1893058&startday=2024-04-22&endday=2024-04-28&tree=all

Comment 9

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.