1840546 - Intermittent toolkit/components/places/tests/unit/test_frecency_origins_recalc.js | single tracking bug

Status: RESOLVED INCOMPLETE

(Toolkit :: Places, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=420748498&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IlkcggqCQJCgjL8gJ4nq4A/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-06-27T06:27:32.875Z] 06:27:32     INFO -  TEST-START | toolkit/components/places/tests/unit/test_frecency_origins_recalc.js
[task 2023-06-27T06:27:33.153Z] 06:27:33  WARNING -  TEST-UNEXPECTED-FAIL | toolkit/components/places/tests/unit/test_frecency_origins_recalc.js | xpcshell return code: 0
[task 2023-06-27T06:27:33.153Z] 06:27:33     INFO -  TEST-INFO took 269ms
[task 2023-06-27T06:27:33.154Z] 06:27:33     INFO -  >>>>>>>
[task 2023-06-27T06:27:33.155Z] 06:27:33     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2023-06-27T06:27:33.156Z] 06:27:33     INFO -  (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2023-06-27T06:27:33.158Z] 06:27:33     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2023-06-27T06:27:33.159Z] 06:27:33     INFO -  running event loop
[task 2023-06-27T06:27:33.160Z] 06:27:33     INFO -  toolkit/components/places/tests/unit/test_frecency_origins_recalc.js | Starting setup
[task 2023-06-27T06:27:33.160Z] 06:27:33     INFO -  (xpcshell/head.js) | test setup pending (2)
[task 2023-06-27T06:27:33.161Z] 06:27:33     INFO -  (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2023-06-27T06:27:33.162Z] 06:27:33     INFO -  (xpcshell/head.js) | test run_next_test 1 pending (2)
[task 2023-06-27T06:27:33.163Z] 06:27:33     INFO -  (xpcshell/head.js) | test setup finished (2)
[task 2023-06-27T06:27:33.164Z] 06:27:33     INFO -  toolkit/components/places/tests/unit/test_frecency_origins_recalc.js | Starting test
[task 2023-06-27T06:27:33.165Z] 06:27:33     INFO -  (xpcshell/head.js) | test test pending (2)
[task 2023-06-27T06:27:33.166Z] 06:27:33     INFO -  (xpcshell/head.js) | test run_next_test 1 finished (2)
[task 2023-06-27T06:27:33.167Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253077	places	TRACE	FrecencyRecalculator :: Initializing Frecency Recalculator"
[task 2023-06-27T06:27:33.168Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253078	places	TRACE	FrecencyRecalculator :: Arm frecency recalculation"
[task 2023-06-27T06:27:33.168Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253079	places	TRACE	FrecencyRecalculator :: Got places-init-complete topic"
[task 2023-06-27T06:27:33.168Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253081	places	TRACE	FrecencyRecalculator :: Got frecency-recalculation-needed topic"
[task 2023-06-27T06:27:33.169Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253081	places	TRACE	FrecencyRecalculator :: Frecency recalculation requested"
[task 2023-06-27T06:27:33.169Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253081	places	TRACE	FrecencyRecalculator :: Arm frecency recalculation"
[task 2023-06-27T06:27:33.169Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253083	places	TRACE	FrecencyRecalculator :: Clean up alternative frecency of pages"
[task 2023-06-27T06:27:33.169Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253088	places	TRACE	FrecencyRecalculator :: Alternative frecency of origins must be recalculated"
[task 2023-06-27T06:27:33.169Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253090	places	TRACE	FrecencyRecalculator :: Recalculate 50 alternative origins frecency values"
[task 2023-06-27T06:27:33.169Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253093	places	TRACE	FrecencyRecalculator :: Arm frecency recalculation"
[task 2023-06-27T06:27:33.169Z] 06:27:33     INFO -  TEST-PASS | toolkit/components/places/tests/unit/test_frecency_origins_recalc.js | test - [test : 26] Should have been calculated already - 0 == 0
[task 2023-06-27T06:27:33.171Z] 06:27:33  WARNING -  TEST-UNEXPECTED-FAIL | toolkit/components/places/tests/unit/test_frecency_origins_recalc.js | test - [test : 33] Should have been calculated already - 0 == 1
[task 2023-06-27T06:27:33.172Z] 06:27:33     INFO -  /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/places/tests/unit/test_frecency_origins_recalc.js:test:33
[task 2023-06-27T06:27:33.172Z] 06:27:33     INFO -  /builds/worker/workspace/build/tests/xpcshell/head.js:_do_main:237
[task 2023-06-27T06:27:33.172Z] 06:27:33     INFO -  /builds/worker/workspace/build/tests/xpcshell/head.js:_execute_test:584
[task 2023-06-27T06:27:33.173Z] 06:27:33     INFO -  -e:null:1
[task 2023-06-27T06:27:33.173Z] 06:27:33     INFO -  exiting test
[task 2023-06-27T06:27:33.174Z] 06:27:33     INFO -  Unexpected exception NS_ERROR_ABORT:
[task 2023-06-27T06:27:33.174Z] 06:27:33     INFO -  _abort_failed_test@/builds/worker/workspace/build/tests/xpcshell/head.js:857:20
[task 2023-06-27T06:27:33.175Z] 06:27:33     INFO -  do_report_result@/builds/worker/workspace/build/tests/xpcshell/head.js:966:5
[task 2023-06-27T06:27:33.175Z] 06:27:33     INFO -  Assert<@/builds/worker/workspace/build/tests/xpcshell/head.js:70:21
[task 2023-06-27T06:27:33.176Z] 06:27:33     INFO -  Assert.prototype.report@resource://testing-common/Assert.sys.mjs:240:10
[task 2023-06-27T06:27:33.176Z] 06:27:33     INFO -  equal@resource://testing-common/Assert.sys.mjs:282:8
[task 2023-06-27T06:27:33.176Z] 06:27:33     INFO -  test@/builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/places/tests/unit/test_frecency_origins_recalc.js:33:10
[task 2023-06-27T06:27:33.177Z] 06:27:33     INFO -  _do_main@/builds/worker/workspace/build/tests/xpcshell/head.js:237:6
[task 2023-06-27T06:27:33.177Z] 06:27:33     INFO -  _execute_test@/builds/worker/workspace/build/tests/xpcshell/head.js:584:5
[task 2023-06-27T06:27:33.177Z] 06:27:33     INFO -  @-e:1:1
[task 2023-06-27T06:27:33.178Z] 06:27:33     INFO -  exiting test
[task 2023-06-27T06:27:33.178Z] 06:27:33     INFO -  "Force a GC"
[task 2023-06-27T06:27:33.179Z] 06:27:33     INFO -  "CONSOLE_MESSAGE: (info) 1687847253124	places	TRACE	FrecencyRecalculator :: Finalizing frecency recalculator"
[task 2023-06-27T06:27:33.179Z] 06:27:33     INFO -  <<<<<<<
[task 2023-06-27T06:27:33.179Z] 06:27:33     INFO -  TEST-START | security/manager/ssl/tests/unit/test_ct.js

Comment 1

[Intermittent Failures Robot]

1 failures in 3594 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2023-06-26&endday=2023-07-02&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 3

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=442936128&repo=autoland

Comment 4

[Intermittent Failures Robot]

1 failures in 3217 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-01-08&endday=2024-01-14&tree=all

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 6

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=447469944&repo=mozilla-central

Comment 7

[Intermittent Failures Robot]

1 failures in 3125 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-02-12&endday=2024-02-18&tree=all

Comment 8

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 9

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=450575504&repo=autoland

Comment 10

[Intermittent Failures Robot]

1 failures in 3849 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-03-11&endday=2024-03-17&tree=all

Comment 11

[Intermittent Failures Robot]

14 failures in 3791 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• comm-central: 1
• mozilla-central: 8
• try: 4
• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 2
  • opt: 2
• linux1804-64-shippable-qr: 9
  • opt: 9
• linux1804-64-devedition-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-03-18&endday=2024-03-24&tree=all

Comment 12

[Intermittent Failures Robot]

25 failures in 3590 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 12
• try: 6

Platform and build breakdown:

• linux1804-64-qr: 10
  • opt: 10
• linux1804-64-shippable-qr: 14
  • opt: 14
• linux1804-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-03-25&endday=2024-03-31&tree=all

Comment 13

[Intermittent Failures Robot]

2 failures in 3235 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• try: 1

Platform and build breakdown:

• linux1804-64-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-04-08&endday=2024-04-14&tree=all

Comment 14

[Intermittent Failures Robot]

2 failures in 4252 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-devedition-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-04-15&endday=2024-04-21&tree=all

Comment 15

[Intermittent Failures Robot]

3 failures in 4336 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• comm-central: 1
• try: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-04-22&endday=2024-04-28&tree=all

Comment 16

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 17

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=463209267&repo=mozilla-central

Comment 18

[Intermittent Failures Robot]

2 failures in 4577 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• try: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 19

[Intermittent Failures Robot]

1 failures in 3199 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-07-01&endday=2024-07-07&tree=all

Comment 20

[Intermittent Failures Robot]

1 failures in 3799 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-07-15&endday=2024-07-21&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 4124 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-07-22&endday=2024-07-28&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 3839 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-07-29&endday=2024-08-04&tree=all

Comment 23

[Intermittent Failures Robot]

8 failures in 3459 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 5

Platform and build breakdown:

• linux1804-64-qr: 3
  • opt: 3
• linux1804-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-08-05&endday=2024-08-11&tree=all

Comment 24

[Intermittent Failures Robot]

29 failures in 2154 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 14
• autoland: 5
• try: 7
• comm-central: 3

Platform and build breakdown:

• linux1804-64-shippable-qr: 16
  • opt: 16
• linux1804-64-qr: 9
  • opt: 9
• linux1804-64-devedition-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-08-12&endday=2024-08-18&tree=all

Comment 25

[Intermittent Failures Robot]

39 failures in 3218 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 19
• autoland: 6
• try: 11
• comm-central: 2
• mozilla-esr128: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 25
  • opt: 25
• linux1804-64-qr: 9
  • opt: 9
• linux1804-64-devedition-qr: 4
  • opt: 4
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-08-19&endday=2024-08-25&tree=all

Comment 26

[Marco Bonardo [:mak]]

Attachment: Bug 1840546 - Intermittent test_frecency_origins_recalc.js. r=daisuke

As multiple async queries must run, we may end up checking too early for the
expected value.

Comment 27

[Intermittent Failures Robot]

26 failures in 3879 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 13
• try: 5
• comm-central: 2
• autoland: 6

Platform and build breakdown:

• linux1804-64-shippable-qr: 16
  • opt: 16
• linux1804-64-devedition-qr: 2
  • opt: 2
• linux1804-64-qr: 8
  • opt: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-08-26&endday=2024-09-01&tree=all

Comment 28

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6716d002798d
Intermittent test_frecency_origins_recalc.js. r=daisuke,places-reviewers

Comment 29

[tszentpeteri]

https://hg.mozilla.org/mozilla-central/rev/6716d002798d

Comment 30

[tszentpeteri]

The issue still persists as it can be seen here

Comment 31

[Marco Bonardo [:mak]]

Hm, I wonder if it's set to 1 but then recalculated before the check.

Comment 32

[Marco Bonardo [:mak]]

Attachment: Bug 1840546 - Intermittent failure in test_frecency_origins_recalc.js. r=daisuke

Second try. Restore the test as it was before, but try to disable the
recalculation task until database values are checked.
If this won't be sufficient, we may have to introduce a test-only method to
temporarily pause background updates.

Comment 33

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e3b4ac029935
Intermittent failure in test_frecency_origins_recalc.js. r=daisuke,places-reviewers

Comment 34

[pstanciu]

https://hg.mozilla.org/mozilla-central/rev/e3b4ac029935

Comment 35

[Intermittent Failures Robot]

21 failures in 781 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-beta: 2
• mozilla-central: 6
• try: 4

Platform and build breakdown:

• linux1804-64-qr: 11
  • opt: 11
• linux1804-64-devedition-qr: 3
  • opt: 3
• linux1804-64-shippable-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-09-05&endday=2024-09-05&tree=all

Comment 36

[Iulian Moraru]

This is still happening. The new failure line looks like this: TEST-UNEXPECTED-FAIL | toolkit/components/places/tests/unit/test_frecency_origins_recalc.js | test - [test : 32] Alt frecency should be calculated - 0 == 1

Hi Marco! Can you please take another look at this?
Thank you!

Comment 37

[Intermittent Failures Robot]

64 failures in 3668 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #28 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 21
• mozilla-central: 20
• mozilla-beta: 11
• try: 8
• comm-central: 4

Platform and build breakdown:

• linux1804-64-qr: 28
  • opt: 28
• linux1804-64-shippable-qr: 25
  • opt: 25
• linux1804-64-devedition-qr: 11
  • opt: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-09-02&endday=2024-09-08&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 4448 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1840546&startday=2024-09-09&endday=2024-09-15&tree=all

Comment 39

[Marco Bonardo [:mak]]

This became extremely infrequent, and that's likely why I had difficulties reproducing on Try. So this is a low priority if it remains at this frequency.
It looks like what we need here is a way to completely disable background recalculation for some time, so there's more time to check status of the database before it changes.

Comment 40

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.