1727097 - Intermittent Windows 10 2004 toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | expected counts should match for STORAGE_ACCESS_REMAINING_DAYS at index 29 - 0 == 1 - JS frame :: resource://testing-common/

Status: NEW

(Core :: Privacy: Anti-Tracking, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=349258802&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JLrbtOIpQKiAq6n7byc5-Q/runs/0/artifacts/public/logs/live_backing.log

---

INFO - TEST-PASS | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | There should be one reason count in telemetry. - 
[task 2021-08-23T14:37:56.370Z] 14:37:56     INFO - Buffered messages finished
[task 2021-08-23T14:37:56.371Z] 14:37:56     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | expected counts should match for STORAGE_ACCESS_REMAINING_DAYS at index 29 - 0 == 1 - JS frame :: resource://testing-common/TelemetryTestUtils.jsm :: assertHistogram :: line 296
[task 2021-08-23T14:37:56.371Z] 14:37:56     INFO - Stack trace:
[task 2021-08-23T14:37:56.371Z] 14:37:56     INFO - resource://testing-common/TelemetryTestUtils.jsm:assertHistogram:296
[task 2021-08-23T14:37:56.371Z] 14:37:56     INFO - chrome://mochitests/content/browser/toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js:testTelemetry:78
[task 2021-08-23T14:37:56.371Z] 14:37:56     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-08-23T14:37:56.372Z] 14:37:56     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | unexpected counts should be zero for STORAGE_ACCESS_REMAINING_DAYS at index 30 - 1 == 0 - JS frame :: resource://testing-common/TelemetryTestUtils.jsm :: assertHistogram :: line 302
[task 2021-08-23T14:37:56.373Z] 14:37:56     INFO - Stack trace:
[task 2021-08-23T14:37:56.373Z] 14:37:56     INFO - resource://testing-common/TelemetryTestUtils.jsm:assertHistogram:302
[task 2021-08-23T14:37:56.373Z] 14:37:56     INFO - chrome://mochitests/content/browser/toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js:testTelemetry:78
[task 2021-08-23T14:37:56.373Z] 14:37:56     INFO - TEST-PASS | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | unexpected counts should be zero for STORAGE_ACCESS_REMAINING_DAYS at index 31 - 0 == 0 - 

Comment 1

[Michelle Goossens [:masterwayz]]

Attachment: Bug 1727097 - Disable browser_contentBlockingTelemetry.js for intermittent failures on Windows 10 x64 2004 r=jmaher

Comment 2

[Michelle Goossens [:masterwayz]]

Hi :timhuang, who are the developer(s) who work on these tests?
We should investigate why suddenly on Windows 10 2004 on Azure this test became an intermittent failure.

Comment 3

[Cristina Cozmuta (:CrissCozmuta)]

https://hg.mozilla.org/mozilla-central/rev/e075b0d2a2b0

Comment 4

[Tim Huang[:timhuang]]

I am the one who implemented this test. I can take a look.

Comment 5

[Intermittent Failures Robot]

11 failures in 2580 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 4

Platform and build breakdown:

• windows10-64-2004-qr: 6
  • opt: 6
• windows10-64-2004-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727097&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 6

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-esr91/rev/be180f491b3c

Comment 7

[Marco Castelluccio [:marco]]

Set release status flags based on info from the regressing bug 1723574

Comment 8

[Michelle Goossens [:masterwayz]]

Removing me as the assignee, as I only disabled the test.

Comment 9

[Iulian Moraru]

This started to fail on tier 1: https://treeherder.mozilla.org/logviewer?job_id=364965813&repo=mozilla-central&lineNumber=5731

Comment 10

[Intermittent Failures Robot]

24 failures in 678 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 7
• try: 3

Platform and build breakdown:

• windows10-64-2004-qr: 7
  • opt: 7
• windows10-64-2004-shippable-qr: 16
  • opt: 16
• windows10-64-2004-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727097&startday=2022-01-21&endday=2022-01-21&tree=all

Comment 11

[Iulian Moraru]

Update:
There have been 39 failures within the last 7 days:
• 14 failures on Windows 10 x64 2004 WebRender opt
• 25 failures on Windows 10 x64 2004 WebRender Shippable opt
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=365169961&repo=autoland&lineNumber=7286

[task 2022-01-23T23:17:44.157Z] 23:17:44     INFO - TEST-PASS | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | There should be one reason count in telemetry. - 
[task 2022-01-23T23:17:44.157Z] 23:17:44     INFO - Buffered messages finished
[task 2022-01-23T23:17:44.158Z] 23:17:44     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | expected counts should match for STORAGE_ACCESS_REMAINING_DAYS at index 29 - 0 == 1 - JS frame :: resource://testing-common/TelemetryTestUtils.jsm :: assertHistogram :: line 296
[task 2022-01-23T23:17:44.158Z] 23:17:44     INFO - Stack trace:
[task 2022-01-23T23:17:44.158Z] 23:17:44     INFO - resource://testing-common/TelemetryTestUtils.jsm:assertHistogram:296
[task 2022-01-23T23:17:44.158Z] 23:17:44     INFO - chrome://mochitests/content/browser/toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js:testTelemetry:78
[task 2022-01-23T23:17:44.158Z] 23:17:44     INFO - Not taking screenshot here: see the one that was previously logged
[task 2022-01-23T23:17:44.159Z] 23:17:44     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | unexpected counts should be zero for STORAGE_ACCESS_REMAINING_DAYS at index 30 - 1 == 0 - JS frame :: resource://testing-common/TelemetryTestUtils.jsm :: assertHistogram :: line 302
[task 2022-01-23T23:17:44.159Z] 23:17:44     INFO - Stack trace:
[task 2022-01-23T23:17:44.159Z] 23:17:44     INFO - resource://testing-common/TelemetryTestUtils.jsm:assertHistogram:302
[task 2022-01-23T23:17:44.159Z] 23:17:44     INFO - chrome://mochitests/content/browser/toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js:testTelemetry:78
[task 2022-01-23T23:17:44.160Z] 23:17:44     INFO - TEST-PASS | toolkit/components/antitracking/test/browser/browser_contentBlockingTelemetry.js | unexpected counts should be zero for STORAGE_ACCESS_REMAINING_DAYS at index 31 - 0 == 0 - 

Comment 12

[Iulian Moraru]

Hello Tim! Can you please take a look at this? Maybe you can help us assign it to someone.
Thank you!

Comment 13

[Intermittent Failures Robot]

44 failures in 3444 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #28 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 28
• mozilla-central: 11
• try: 5

Platform and build breakdown:

• windows10-64-2004-qr: 14
  • opt: 14
• windows10-64-2004-shippable-qr: 28
  • opt: 28
• windows10-64-2004-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727097&startday=2022-01-17&endday=2022-01-23&tree=all

Comment 14

[Intermittent Failures Robot]

15 failures in 679 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 5
• autoland: 10

Platform and build breakdown:

• windows10-64-2004-shippable-qr: 12
  • opt: 12
• windows10-64-2004-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727097&startday=2022-01-28&endday=2022-01-28&tree=all

Comment 15

[Intermittent Failures Robot]

69 failures in 3445 pushes (0.02 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 44
• mozilla-central: 20
• try: 5

Platform and build breakdown:

• windows10-64-2004-shippable-qr: 52
  • opt: 52
• windows10-64-2004-devedition-qr: 2
  • opt: 2
• windows10-64-2004-qr: 15
  • opt: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727097&startday=2022-01-24&endday=2022-01-30&tree=all

Comment 16

[Intermittent Failures Robot]

21 failures in 574 pushes (0.037 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-central: 6
• try: 4

Platform and build breakdown:

• windows10-64-2004-qr: 8
  • opt: 8
• windows10-64-2004-shippable-qr: 11
  • opt: 11
• windows10-64-2004-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727097&startday=2022-02-01&endday=2022-02-01&tree=all

Comment 17

[Intermittent Failures Robot]

52 failures in 3165 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #13 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 27
• try: 11
• mozilla-central: 14

Platform and build breakdown:

• windows10-64-2004-qr: 23
  • opt: 23
• windows10-64-2004-shippable-qr: 25
  • opt: 25
• windows10-64-2004-devedition-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1727097&startday=2022-01-31&endday=2022-02-06&tree=all