1829478 - Frequent browser/modules/test/browser/browser_UsageTelemetry_private_and_restore.js | single tracking bug

Status: RESOLVED FIXED

(Toolkit :: Telemetry, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=413386389&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/E0LgWqJkQgGM8OmERJVN-w/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - TEST-PASS | browser/modules/test/browser/browser_UsageTelemetry_private_and_restore.js | The number of open tab event count must match the expected value. - 
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - Buffered messages finished
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - TEST-UNEXPECTED-FAIL | browser/modules/test/browser/browser_UsageTelemetry_private_and_restore.js | The maximum tab count must match the expected value. - Got undefined, expected 2
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - Stack trace:
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - chrome://mochikit/content/browser-test.js:test_is:1606
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - chrome://mochitests/content/browser/browser/modules/test/browser/browser_UsageTelemetry_private_and_restore.js:test_privateMode:62
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - chrome://mochikit/content/browser-test.js:handleTask:1127
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1199
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1341
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1116
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1056
[task 2023-04-22T11:21:24.486Z] 11:21:24     INFO - TEST-PASS | browser/modules/test/browser/browser_UsageTelemetry_private_and_restore.js | The number of window open event count must match the expected value. - 

Comment 1

[Noemi Erli[:noemi_erli]]

Retrigger and backfill range
This started to fail since Bug 1810739 was landed.
Barret, could you please take a look at this?
Thanks,

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1810739

Comment 3

[Intermittent Failures Robot]

12 failures in 4004 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 8

Platform and build breakdown:

• linux1804-64-qr: 7
  • debug: 6
  • opt: 1
• linux1804-64-asan-qr: 2
  • opt: 2
• macosx1015-64-qr: 3
  • debug: 2
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-04-17&endday=2023-04-23&tree=all

Comment 4

[Intermittent Failures Robot]

20 failures in 706 pushes (0.028 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 13
  • opt: 4
  • debug: 9
• macosx1015-64-qr: 4
  • opt: 3
  • debug: 1
• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-04-24&endday=2023-04-24&tree=all

Comment 5

[Intermittent Failures Robot]

19 failures in 695 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• try: 1
• mozilla-central: 3

Platform and build breakdown:

• macosx1015-64-qr: 1
  • opt: 1
• linux1804-64-qr: 16
  • opt: 2
  • debug: 14
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-04-25&endday=2023-04-25&tree=all

Comment 6

[Intermittent Failures Robot]

24 failures in 690 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 1
• try: 3
• autoland: 20

Platform and build breakdown:

• windows11-64-2009-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 11
  • debug: 9
  • opt: 2
• linux1804-64-asan-qr: 4
  • opt: 4
• windows11-64-2009-qr: 1
  • debug: 1
• macosx1015-64-qr: 5
  • debug: 3
  • opt: 2
• macosx1015-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-04-26&endday=2023-04-26&tree=all

Comment 7

[Intermittent Failures Robot]

24 failures in 673 pushes (0.036 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 24

Platform and build breakdown:

• linux1804-64-qr: 21
  • debug: 15
  • opt: 6
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-04-27&endday=2023-04-27&tree=all

Comment 8

[Noemi Erli[:noemi_erli]]

Update: There have been 97 occurrences of this failure in the past 7 days on:

• windows11-64-2009-shippable-qr opt
• windows11-64-2009-qr debug
• macosx1015-64-qr opt, debug
• linux1804-64-shippable-qr opt
• linux1804-64-qr opt and debug
• linux1804-64-asan-qr opt
  Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=414082119&repo=autoland&lineNumber=18552

[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - TEST-UNEXPECTED-FAIL | browser/modules/test/browser/browser_UsageTelemetry_private_and_restore.js | The maximum tab count must match the expected value. - Got undefined, expected 2
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - Stack trace:
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - chrome://mochikit/content/browser-test.js:test_is:1612
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - chrome://mochitests/content/browser/browser/modules/test/browser/browser_UsageTelemetry_private_and_restore.js:test_privateMode:62
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - chrome://mochikit/content/browser-test.js:handleTask:1133
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1205
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1347
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1122
[task 2023-04-28T04:41:11.255Z] 04:41:11     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1056```

Comment 9

[Intermittent Failures Robot]

99 failures in 3177 pushes (0.031 failures/push) were associated with this bug in the last 7 days.

This is the #4 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 85
• try: 8
• mozilla-central: 6

Platform and build breakdown:

• linux1804-64-qr: 68
  • opt: 14
  • debug: 54
• macosx1015-64-qr: 12
  • opt: 7
  • debug: 5
• linux1804-64-asan-qr: 9
  • opt: 9
• linux1804-64-shippable-qr: 3
  • opt: 3
• windows11-64-2009-shippable-qr: 1
  • opt: 1
• windows11-64-2009-qr: 2
  • debug: 2
• macosx1015-64-shippable-qr: 3
  • opt: 3
• macosx1015-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-04-24&endday=2023-04-30&tree=all

Comment 10

[Intermittent Failures Robot]

31 failures in 957 pushes (0.032 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 25
• try: 3
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-qr: 22
  • debug: 21
  • opt: 1
• linux1804-64-asan-qr: 4
  • opt: 4
• macosx1015-64-shippable-qr: 1
  • opt: 1
• windows7-32-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1
• macosx1100-64-shippable-qr: 1
  • opt: 1
• windows11-64-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-05-03&endday=2023-05-03&tree=all

Comment 11

[Beth Rennie [:beth] (she/her)]

Attachment: Bug 1829478 - Fix intermittent in browser_UsageTelemetry_private_and_restore.js r?chutten

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d88ac6fff1a6
Fix intermittent in browser_UsageTelemetry_private_and_restore.js r=chutten

Comment 13

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/d88ac6fff1a6

Comment 14

[Intermittent Failures Robot]

70 failures in 3411 pushes (0.021 failures/push) were associated with this bug in the last 7 days.

This is the #3 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 61
• try: 6
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-qr: 48
  • debug: 43
  • opt: 5
• linux1804-64-asan-qr: 11
  • opt: 11
• linux1804-64-shippable-qr: 2
  • opt: 2
• windows11-64-2009-qr: 2
  • debug: 2
• macosx1100-64-shippable-qr: 2
  • opt: 2
• macosx1015-64-qr: 3
  • debug: 2
  • opt: 1
• windows7-32-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1829478&startday=2023-05-01&endday=2023-05-07&tree=all

Comment 15

[Alex Finder]

Hello! It seems there was a regression generated in the following alert: https://treeherder.mozilla.org/perfherder/alerts?id=38296&hideDwnToInv=0. The revision which caused the regression seems to be either d88ac6fff1a6, associated with this patch, or the one following it 7bdbd5815ea7. There's also the high number of intermittents posted by the Intermittent Failure bot in the comment above. Could you please let me know if the changes in this patch could have caused this regression ? Thank you!

Comment 16

[Beth Rennie [:beth] (she/her)]

This is a test-only patch, so it is unlikely that it caused a regression in another test.