1571134 - Intermittent testing\firefox-ui\tests\functional\safebrowsing\test_initial_download.py TestSafeBrowsingInitialDownload.test_safe_browsing_initial_download | AssertionError: 'base-track-digest256.vlpset' not found in [u'google4']

Status: RESOLVED DUPLICATE of bug 1775718

(Toolkit :: Safe Browsing, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: cbrindusan [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=259710145&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/b2GxlnirQEqsU1PNqSs5gA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-08-02T23:03:29.564Z] 23:03:29 INFO - 1564787009560 Marionette DEBUG 3 <- [1,12415,null,{"value":"chrome"}]
[task 2019-08-02T23:03:29.565Z] 23:03:29 INFO - 1564787009561 Marionette DEBUG 3 -> [0,12416,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.565Z] 23:03:29 INFO - 1564787009561 Marionette DEBUG 3 <- [1,12416,null,{"value":null}]
[task 2019-08-02T23:03:29.568Z] 23:03:29 INFO - 1564787009562 Marionette DEBUG 3 -> [0,12417,"WebDriver:ExecuteScript",{"script":"Components.utils.import("resource://gre/modules/Preferences.jsm");\n\n ... me":"Z:\task_1564780916\build\venv\lib\site-packages\marionette_driver\marionette.py","sandbox":"default","line":732}]
[task 2019-08-02T23:03:29.568Z] 23:03:29 INFO - 1564787009564 Marionette DEBUG 3 <- [1,12417,null,{"value":"1"}]
[task 2019-08-02T23:03:29.568Z] 23:03:29 INFO - 1564787009565 Marionette DEBUG 3 -> [0,12418,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.568Z] 23:03:29 INFO - 1564787009565 Marionette DEBUG 3 <- [1,12418,null,{"value":null}]
[task 2019-08-02T23:03:29.667Z] 23:03:29 INFO - 1564787009652 Marionette DEBUG 3 -> [0,12419,"Marionette:GetContext",{}]
[task 2019-08-02T23:03:29.667Z] 23:03:29 INFO - 1564787009653 Marionette DEBUG 3 <- [1,12419,null,{"value":"chrome"}]
[task 2019-08-02T23:03:29.667Z] 23:03:29 INFO - 1564787009653 Marionette DEBUG 3 -> [0,12420,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.667Z] 23:03:29 INFO - 1564787009654 Marionette DEBUG 3 <- [1,12420,null,{"value":null}]
[task 2019-08-02T23:03:29.667Z] 23:03:29 INFO - 1564787009655 Marionette DEBUG 3 -> [0,12421,"WebDriver:ExecuteScript",{"script":"Components.utils.import("resource://gre/modules/Preferences.jsm");\n\n ... me":"Z:\task_1564780916\build\venv\lib\site-packages\marionette_driver\marionette.py","sandbox":"default","line":732}]
[task 2019-08-02T23:03:29.667Z] 23:03:29 INFO - 1564787009656 Marionette DEBUG 3 <- [1,12421,null,{"value":"1564788675936"}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009657 Marionette DEBUG 3 -> [0,12422,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009657 Marionette DEBUG 3 <- [1,12422,null,{"value":null}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009658 Marionette DEBUG 3 -> [0,12423,"Marionette:GetContext",{}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009658 Marionette DEBUG 3 <- [1,12423,null,{"value":"chrome"}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009659 Marionette DEBUG 3 -> [0,12424,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009659 Marionette DEBUG 3 <- [1,12424,null,{"value":null}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009660 Marionette DEBUG 3 -> [0,12425,"WebDriver:ExecuteScript",{"script":"Components.utils.import("resource://gre/modules/Preferences.jsm");\n\n ... me":"Z:\task_1564780916\build\venv\lib\site-packages\marionette_driver\marionette.py","sandbox":"default","line":732}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009662 Marionette DEBUG 3 <- [1,12425,null,{"value":"1"}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009663 Marionette DEBUG 3 -> [0,12426,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.668Z] 23:03:29 INFO - 1564787009663 Marionette DEBUG 3 <- [1,12426,null,{"value":null}]
[task 2019-08-02T23:03:29.763Z] 23:03:29 INFO - 1564787009752 Marionette DEBUG 3 -> [0,12427,"Marionette:GetContext",{}]
[task 2019-08-02T23:03:29.763Z] 23:03:29 INFO - 1564787009752 Marionette DEBUG 3 <- [1,12427,null,{"value":"chrome"}]
[task 2019-08-02T23:03:29.763Z] 23:03:29 INFO - 1564787009752 Marionette DEBUG 3 -> [0,12428,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.763Z] 23:03:29 INFO - 1564787009753 Marionette DEBUG 3 <- [1,12428,null,{"value":null}]
[task 2019-08-02T23:03:29.763Z] 23:03:29 INFO - 1564787009754 Marionette DEBUG 3 -> [0,12429,"WebDriver:ExecuteScript",{"script":"Components.utils.import("resource://gre/modules/Preferences.jsm");\n\n ... me":"Z:\task_1564780916\build\venv\lib\site-packages\marionette_driver\marionette.py","sandbox":"default","line":732}]
[task 2019-08-02T23:03:29.763Z] 23:03:29 INFO - 1564787009755 Marionette DEBUG 3 <- [1,12429,null,{"value":"1564788675936"}]
[task 2019-08-02T23:03:29.763Z] 23:03:29 INFO - 1564787009756 Marionette DEBUG 3 -> [0,12430,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.764Z] 23:03:29 INFO - 1564787009756 Marionette DEBUG 3 <- [1,12430,null,{"value":null}]
[task 2019-08-02T23:03:29.764Z] 23:03:29 INFO - 1564787009757 Marionette DEBUG 3 -> [0,12431,"Marionette:GetContext",{}][task 2019-08-02T23:03:29.764Z] 23:03:29 INFO - 1564787009757 Marionette DEBUG 3 <- [1,12431,null,{"value":"chrome"}]
[task 2019-08-02T23:03:29.764Z] 23:03:29 INFO - 1564787009758 Marionette DEBUG 3 -> [0,12432,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.764Z] 23:03:29 INFO - 1564787009758 Marionette DEBUG 3 <- [1,12432,null,{"value":null}]
[task 2019-08-02T23:03:29.764Z] 23:03:29 INFO - 1564787009759 Marionette DEBUG 3 -> [0,12433,"WebDriver:ExecuteScript",{"script":"Components.utils.import("resource://gre/modules/Preferences.jsm");\n\n ... me":"Z:\task_1564780916\build\venv\lib\site-packages\marionette_driver\marionette.py","sandbox":"default","line":732}]
[task 2019-08-02T23:03:29.767Z] 23:03:29 INFO - 1564787009761 Marionette DEBUG 3 <- [1,12433,null,{"value":"1"}]
[task 2019-08-02T23:03:29.767Z] 23:03:29 INFO - 1564787009762 Marionette DEBUG 3 -> [0,12434,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.767Z] 23:03:29 INFO - 1564787009762 Marionette DEBUG 3 <- [1,12434,null,{"value":null}]
[task 2019-08-02T23:03:29.862Z] 23:03:29 INFO - 1564787009851 Marionette DEBUG 3 -> [0,12435,"Marionette:GetContext",{}]
[task 2019-08-02T23:03:29.862Z] 23:03:29 INFO - 1564787009851 Marionette DEBUG 3 <- [1,12435,null,{"value":"chrome"}]
[task 2019-08-02T23:03:29.862Z] 23:03:29 INFO - 1564787009852 Marionette DEBUG 3 -> [0,12436,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.862Z] 23:03:29 INFO - 1564787009852 Marionette DEBUG 3 <- [1,12436,null,{"value":null}]
[task 2019-08-02T23:03:29.862Z] 23:03:29 INFO - 1564787009853 Marionette DEBUG 3 -> [0,12437,"WebDriver:TakeScreenshot",{"highlights":null,"full":true,"hash":false,"id":null,"scroll":true}]
[task 2019-08-02T23:03:29.901Z] 23:03:29 INFO - 1564787009897 Marionette DEBUG 3 <- [1,12437,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAQuCAYAAACDNZAFAAAgAElEQVR4nOzdW5CcdZ3w8bl+r1P1erFXubDKqvfCKjS1e6F7kVJqQ ... AAAABjAhAAAAAAxgQgAAAAAIwJQAAAAAAYE4AAAAAAMCYAAQAAAGBMAAIAAADAmAAEAAAAgDEBCAAAAABjAhAAAAAAxgKWxkLOoxlhagAAAABJRU5ErkJggg=="}]
[task 2019-08-02T23:03:29.908Z] 23:03:29 INFO - 1564787009899 Marionette DEBUG 3 -> [0,12438,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.908Z] 23:03:29 INFO - 1564787009899 Marionette DEBUG 3 <- [1,12438,null,{"value":null}]
[task 2019-08-02T23:03:29.908Z] 23:03:29 INFO - 1564787009900 Marionette DEBUG 3 -> [0,12439,"Marionette:GetContext",{}]
[task 2019-08-02T23:03:29.908Z] 23:03:29 INFO - 1564787009900 Marionette DEBUG 3 <- [1,12439,null,{"value":"chrome"}]
[task 2019-08-02T23:03:29.908Z] 23:03:29 INFO - 1564787009901 Marionette DEBUG 3 -> [0,12440,"Marionette:SetContext",{"value":"content"}]
[task 2019-08-02T23:03:29.908Z] 23:03:29 INFO - 1564787009901 Marionette DEBUG 3 <- [1,12440,null,{"value":null}]
[task 2019-08-02T23:03:29.908Z] 23:03:29 INFO - 1564787009902 Marionette DEBUG 3 -> [0,12441,"WebDriver:GetPageSource",{}]
[task 2019-08-02T23:03:29.911Z] 23:03:29 INFO - 1564787009905 Marionette DEBUG 3 <- [1,12441,null,{"value":"<html><head></head><body></body></html>"}]
[task 2019-08-02T23:03:29.911Z] 23:03:29 INFO - 1564787009906 Marionette DEBUG 3 -> [0,12442,"Marionette:SetContext",{"value":"chrome"}]
[task 2019-08-02T23:03:29.927Z] 23:03:29 INFO - TEST-UNEXPECTED-FAIL | testing\firefox-ui\tests\functional\safebrowsing\test_initial_download.py TestSafeBrowsingInitialDownload.test_safe_browsing_initial_download | AssertionError: 'base-track-digest256.vlpset' not found in [u'google4']

Comment 1

[Intermittent Failures Robot]

1 failures in 4439 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2019-07-29&endday=2019-08-04&tree=all

Comment 2

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 3

[Andreea Pavel [:apavel]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=273298622&repo=mozilla-central&lineNumber=24319

Comment 4

[Cosmin Sabou [:CosminS]]

This is now permafailing on backfills and retriggers: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&searchStr=linux%2Cx64%2Cshippable%2Copt%2Cfirefox%2Cfunctional%2Ctests%2C%28remote%29%2Ctest-linux64-shippable%2Fopt-firefox-ui-functional-remote-e10s%2Cfxfn-r%28en-us%29&tochange=a7a46c0605353416a10bdfd42437c222b31cfcd4&fromchange=ecc9cefef68de7ba316fb8d63848e907f649a801&selectedJob=273330199
Henrik, could you please look into this?

Comment 5

[Intermittent Failures Robot]

69 failures in 787 pushes (0.088 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 59
• mozilla-central: 9
• try: 1

Platform breakdown:

• linux64-shippable: 32
• windows7-32-shippable: 21
• windows7-32: 2
• macosx1014-64-shippable: 12
• linux64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2019-10-28&endday=2019-10-28&tree=all

Comment 6

[Henrik Skupin [:whimboo][⌚️UTC+2]]

It's not me who is triaging this component but Dimi. Was there a safebrowsing related change lately?

Cosmin, which branches does it affect? And with backfilling you was not able to find a regression range?

Comment 7

[Alexandru Michis [:malexandru]]

Backfilling only makes it fail further:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=linux%2Cx64%2Cshippable%2Copt%2Cfirefox%2Cfunctional%2Ctests%2C%28remote%29%2Ctest-linux64-shippable%2Fopt-firefox-ui-functional-remote-e10s%2Cfxfn-r%28en-us%29&tochange=ecc9cefef68de7ba316fb8d63848e907f649a801&fromchange=5aa41cf3904b1fbc2143149c1fd892e17466c18f&group_state=expanded&selectedJob=273332246

This failure appears on autoland and central: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=testfailed%2Cbusted%2Cexception&searchStr=en%2Cus&fromchange=d31698ac05594dddbceba44fa99aebc97e1a8a50&tochange=9b2ebbf56577ec44c8c2304564bd003e1ccf0231&selectedJob=273309506

I believe it's not caused by a specific push that was made to autoland/inbound, since retriggering makes it fail regardless of push or date
(see this inbound push https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&group_state=expanded&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&searchStr=en%2Cus&revision=ba30626ccb8c56aec1a6a6ff3643d53e2567111f&selectedJob=273469642).

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The full log actually shows an update error for safebrowsing which is definitely the fault here:

[task 2019-10-29T13:20:14.755Z] 13:20:14 INFO - listmanager: 13:20:14 GMT+0000 (Coordinated Universal Time): update error for mozplugin-block-digest256,ads-track-digest256,social-track-digest256,analytics-track-digest256,content-track-digest256,mozstd-trackwhite-digest256,base-track-digest256,allow-flashallow-digest256,except-flashallow-digest256,block-flash-digest256,except-flash-digest256,block-flashsubdoc-digest256,except-flashsubdoc-digest256,base-fingerprinting-track-digest256,base-cryptomining-track-digest256,social-tracking-protection-digest256,social-tracking-protection-facebook-digest256,social-tracking-protection-linkedin-digest256,social-tracking-protection-twitter-digest256 from https://shavar.services.mozilla.com/downloads?client=navclient-auto-ffox&appver=72.0a&pver=2.2: NS_ERROR_FAILURE

NS_ERROR_FAILURE isn't pretty helpful. Running the test locally I can see the exact same failure and that for Firefox Nightly and Beta too:

mach firefox-ui-functional testing/firefox-ui/tests/functional/safebrowsing/test_initial_download.py -vv --gecko-log -

This is clearly a problem Dimi has to look into.

Comment 9

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Also CC'ing Ethan given that this seems to be a wider exposure for our Firefox users. Maybe a remote service is down to get those updates from?

Comment 10

[Intermittent Failures Robot]

32 failures in 865 pushes (0.037 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-beta: 12
• mozilla-release: 6
• try: 1
• mozilla-central: 1

Platform breakdown:

• macosx1014-64-shippable: 9
• windows7-32-shippable: 8
• macosx1014-64-devedition: 2
• linux64-devedition: 2
• linux64-shippable: 7
• windows7-32-devedition: 2
• linux64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2019-10-29&endday=2019-10-29&tree=all

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This seems to have been gone since 1pm yesterday. Maybe it was really some kind of server outage. Not sure whom to ask about that. But leaving the needinfo for Ethan, and Dimi.

YI, the last affected test job on autoland is:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=firefox-ui&revision=45856f355629679c4f8708fe4d1d97027aa58e8d

Comment 12

[Dimi Lee [:dimi]]

I believe this is because of adding too many sites to our tracking protection whitelist, which caused Safe Browsing failing to update when the size of a list was over a certain threshold.
This issue is now fixed so it doesn't occur anymore!

Comment 14

[Ethan Tseng [:ethan]]

(In reply to Dimi Lee [:dimi][:dlee] from comment #12)

I believe this is because of adding too many sites to our tracking protection whitelist, which caused Safe Browsing failing to update when the size of a list was over a certain threshold.
This issue is now fixed so it doesn't occur anymore!

Thanks for the investigation!

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Ah good to know! Great that we got it fixed.

Comment 16

[Intermittent Failures Robot]

104 failures in 4314 pushes (0.024 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 10
• autoland: 71
• try: 5
• mozilla-beta: 12
• mozilla-release: 6

Platform breakdown:

• windows7-32: 2
• macosx1014-64-shippable: 21
• linux64-shippable: 41
• windows7-32-shippable: 29
• linux64: 5
• macosx1014-64-devedition: 2
• linux64-devedition: 2
• windows7-32-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 18

[Andreea Pavel [:apavel]]

Recent failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=281790896&repo=autoland&lineNumber=20926

Comment 20

[Intermittent Failures Robot]

1 failures in 4582 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2019-12-16&endday=2019-12-22&tree=all

Comment 21

[Intermittent Failures Robot]

2 failures in 1862 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2

Platform breakdown:

• linux64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2019-12-30&endday=2020-01-05&tree=all

Comment 22

[Intermittent Failures Robot]

2 failures in 4690 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• macosx1014-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2020-02-10&endday=2020-02-16&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 5336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 4773 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2020-03-23&endday=2020-03-29&tree=all

Comment 25

[Intermittent Failures Robot]

1 failures in 5015 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1571134&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 26

[Intermittent Failures Robot]

1 failures in 3125 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1014-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1571134&startday=2021-03-29&endday=2021-04-04&tree=all