1809932 - Frequent toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js | single tracking bug

Status: RESOLVED FIXED

(Core :: Privacy: Anti-Tracking, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: mlaza [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=402195424&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MQ8pp3cqRhW0xcaOVZnSHQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-01-12T15:42:12.139Z] 15:42:12     INFO - TEST-START | toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js
[task 2023-01-12T15:42:12.176Z] 15:42:12     INFO - TEST-INFO | started process screentopng
[task 2023-01-12T15:42:12.382Z] 15:42:12     INFO - TEST-INFO | screentopng: exit 0
[task 2023-01-12T15:42:12.383Z] 15:42:12     INFO - Buffered messages logged at 15:42:12
[task 2023-01-12T15:42:12.384Z] 15:42:12     INFO - Entering setup bound 
[task 2023-01-12T15:42:12.384Z] 15:42:12     INFO - Leaving setup bound 
[task 2023-01-12T15:42:12.385Z] 15:42:12     INFO - Entering test bound test_rules_getter_no_duplicates
[task 2023-01-12T15:42:12.386Z] 15:42:12     INFO - Buffered messages finished
[task 2023-01-12T15:42:12.386Z] 15:42:12     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js | Rules getter should only return the two test rules. - Got 371, expected 2
[task 2023-01-12T15:42:12.387Z] 15:42:12     INFO - Stack trace:
[task 2023-01-12T15:42:12.387Z] 15:42:12     INFO - chrome://mochikit/content/browser-test.js:test_is:1477
[task 2023-01-12T15:42:12.388Z] 15:42:12     INFO - chrome://mochitests/content/browser/toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js:test_rules_getter_no_duplicates:66
[task 2023-01-12T15:42:12.390Z] 15:42:12     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-01-12T15:42:12.390Z] 15:42:12     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js | There should only be one rule with TEST_DOMAIN_A. - Got +0, expected 1
[task 2023-01-12T15:42:12.391Z] 15:42:12     INFO - Stack trace:
[task 2023-01-12T15:42:12.391Z] 15:42:12     INFO - chrome://mochikit/content/browser-test.js:test_is:1477
[task 2023-01-12T15:42:12.392Z] 15:42:12     INFO - chrome://mochitests/content/browser/toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js:test_rules_getter_no_duplicates:71
[task 2023-01-12T15:42:12.392Z] 15:42:12     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-01-12T15:42:12.393Z] 15:42:12     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js | There should only be one rule with TEST_DOMAIN_B. - Got +0, expected 1
[task 2023-01-12T15:42:12.394Z] 15:42:12     INFO - Stack trace:
[task 2023-01-12T15:42:12.394Z] 15:42:12     INFO - chrome://mochikit/content/browser-test.js:test_is:1477
[task 2023-01-12T15:42:12.395Z] 15:42:12     INFO - chrome://mochitests/content/browser/toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js:test_rules_getter_no_duplicates:76
[task 2023-01-12T15:42:12.395Z] 15:42:12     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-01-12T15:42:12.395Z] 15:42:12     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js | There should only be one rule with TEST_DOMAIN_C. - Got +0, expected 1
[task 2023-01-12T15:42:12.395Z] 15:42:12     INFO - Stack trace:
[task 2023-01-12T15:42:12.395Z] 15:42:12     INFO - chrome://mochikit/content/browser-test.js:test_is:1477
[task 2023-01-12T15:42:12.395Z] 15:42:12     INFO - chrome://mochitests/content/browser/toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js:test_rules_getter_no_duplicates:81
[task 2023-01-12T15:42:12.396Z] 15:42:12     INFO - Leaving test bound test_rules_getter_no_duplicates
[task 2023-01-12T15:42:12.396Z] 15:42:12     INFO - GECKO(7426) | console.debug: CookieBannerListService: "init"
[task 2023-01-12T15:42:12.396Z] 15:42:12     INFO - GECKO(7426) | console.debug: CookieBannerListService: "importAllRules"
[task 2023-01-12T15:42:12.396Z] 15:42:12     INFO - GECKO(7426) | console.debug: CookieBannerListService: "importTestRules"
[task 2023-01-12T15:42:12.396Z] 15:42:12     INFO - GECKO(7426) | console.debug: CookieBannerListService: "importRules" [{id:"0e4cdbb8-b688-47e0-9c8b-4db620398dbd", click:{}, cookies:{optIn:[{name:"foo", value:"bar"}]}, domains:["example.com", "example.org"]}, {id:"0560e02c-a50f-4e7b-86e0-d6b7d258eb5f", click:{optOut:"#optOutBtn", presence:"#cookieBanner"}, cookies:{}, domains:["example.net"]}]
[task 2023-01-12T15:42:12.404Z] 15:42:12     INFO - GECKO(7426) | console.debug: CookieBannerListService: "importAllRules"
[task 2023-01-12T15:42:12.405Z] 15:42:12     INFO - GECKO(7426) | MEMORY STAT | vsize 11286MB | residentFast 394MB | heapAllocated 225MB
[task 2023-01-12T15:42:12.406Z] 15:42:12     INFO - TEST-OK | toolkit/components/cookiebanners/test/browser/browser_cookiebannerservice_getRules.js | took 265ms

Comment 1

[Norisz Fay [:noriszfay]]

Hello, could you take a look at this failure? Could it be caused by Bug 1804654 as there is a recent spike of failures after it landed? Thank you!

Comment 2

[Iulian Moraru]

The test was added in Bug 1804654.

Comment 3

[Intermittent Failures Robot]

24 failures in 3530 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 19
• mozilla-central: 5

Platform and build breakdown:

• linux1804-64-qr: 14
  • opt: 13
  • debug: 1
• macosx1015-64-qr: 5
  • debug: 4
  • opt: 1
• linux1804-64-shippable-qr: 3
  • opt: 3
• linux1804-64-asan-qr: 1
  • opt: 1
• windows10-64-2004-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1809932&startday=2023-01-09&endday=2023-01-15&tree=all

Comment 4

[Intermittent Failures Robot]

34 failures in 601 pushes (0.057 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 29
• mozilla-central: 4
• try: 1

Platform and build breakdown:

• linux1804-64-qr: 22
  • debug: 7
  • opt: 15
• macosx1015-64-qr: 7
  • opt: 1
  • debug: 6
• macosx1015-64-shippable-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1809932&startday=2023-01-16&endday=2023-01-16&tree=all

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1804654

Comment 6

[Paul Zühlcke [:pbz]]

Attachment: Bug 1809932 - Add call to resetRules to flush any non-test rules. r=timhuang!

Comment 7

[Intermittent Failures Robot]

33 failures in 820 pushes (0.04 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 29
• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-qr: 22
  • opt: 15
  • debug: 7
• macosx1015-64-qr: 4
  • debug: 4
• linux1804-64-shippable-qr: 5
  • opt: 5
• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1809932&startday=2023-01-17&endday=2023-01-17&tree=all

Comment 8

[Intermittent Failures Robot]

18 failures in 618 pushes (0.029 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 17
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 12
  • opt: 8
  • debug: 4
• linux1804-64-asan-qr: 1
  • opt: 1
• macosx1015-64-qr: 4
  • debug: 4
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1809932&startday=2023-01-18&endday=2023-01-18&tree=all

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/eced9962d19d
Add call to resetRules to flush any non-test rules. r=timhuang

Comment 10

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/eced9962d19d

Comment 11

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:pbz, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
• If no, please set status-firefox110 to wontfix.

For more information, please visit auto_nag documentation.

Comment 12

[Paul Zühlcke [:pbz]]

Let's let this bake for another day to make sure it fixes the intermittent failure before uplifting.

Comment 13

[Intermittent Failures Robot]

95 failures in 3717 pushes (0.026 failures/push) were associated with this bug in the last 7 days.

This is the #5 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 81
• mozilla-central: 11
• try: 3

Platform and build breakdown:

• linux1804-64-qr: 64
  • debug: 21
  • opt: 43
• macosx1015-64-qr: 16
  • opt: 1
  • debug: 15
• macosx1015-64-shippable-qr: 2
  • opt: 2
• linux1804-64-asan-qr: 3
  • opt: 3
• linux1804-64-shippable-qr: 9
  • opt: 9
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1809932&startday=2023-01-16&endday=2023-01-22&tree=all

Comment 14

[Paul Zühlcke [:pbz]]

Comment on attachment 9312631 [details]
Bug 1809932 - Add call to resetRules to flush any non-test rules. r=timhuang!

Beta/Release Uplift Approval Request

• User impact if declined: No user impact, intermittent test failure in automation.
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: No
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): Small test only change.
• String changes made/needed:
• Is Android affected?: Yes

Comment 15

[Pascal Chevrel:pascalc (PTO until April 26)]

Comment on attachment 9312631 [details]
Bug 1809932 - Add call to resetRules to flush any non-test rules. r=timhuang!

Approved for 110 beta 5, thanks.

Comment 16

[Pascal Chevrel:pascalc (PTO until April 26)]

https://hg.mozilla.org/releases/mozilla-beta/rev/1713dea08eed