1282056 - Intermittent test_safe_browsing_initial_download.py TestSafeBrowsingInitialDownload.test_safe_browsing_initial_download | TimeoutException: Timed out after 30.0 seconds with message: Safe Browsing File: ^goog-badbinurl-shavar.cache$ not

Status: RESOLVED FIXED

(Testing :: Firefox UI Tests, defect)

Description

[Carsten Book [:Tomcat]]

https://treeherder.mozilla.org/logviewer.html#?job_id=30590365&repo=mozilla-inbound#L53584

 08:53:51 INFO - TEST-UNEXPECTED-ERROR | test_safe_browsing_initial_download.py TestSafeBrowsingInitialDownload.test_safe_browsing_initial_download | TimeoutException: TimeoutException: Timed out after 30.0 seconds with message: Safe Browsing File: goog-badbinurl-shavar.cache not found!

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

First test failure since we enabled the test via bug 1237396. Lets see how often that happens. It could indicate a slow network or a real failure. At least it is the very first file we check:

https://hg.mozilla.org/mozilla-central/diff/436cebf9fd49/testing/firefox-ui/tests/functional/security/test_safe_browsing_initial_download.py#l1.20

Comment 2

[Carsten Book [:Tomcat]]

whimboo is this bug 1282506 (i guess it is :) but just want to get sure

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

No, this is an intermittent we also hit a couple of days before we got the perm failure. So we have to keep that bug open.

I think it's mainly a networking failure because it requires the download of the safebrowsing files from Google.

Comment 4

[Intermittent Failures Robot]

12 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* fx-team: 8
* mozilla-inbound: 2
* try: 1
* mozilla-central: 1

Platform breakdown:
* linux64: 12

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-06-27&endday=2016-07-03&tree=all

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

Fixed by the proxy changes on bug 1289697.

Comment 6

[Intermittent Failures Robot]

21 automation job failures were associated with this bug yesterday.

Repository breakdown:
* fx-team: 20
* autoland: 1

Platform breakdown:
* linux64: 21

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-08-05&endday=2016-08-05&tree=all

Comment 7

[Intermittent Failures Robot]

31 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* fx-team: 26
* mozilla-inbound: 4
* autoland: 1

Platform breakdown:
* linux64: 31

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-08-01&endday=2016-08-07&tree=all

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

There might still be other networking related issues here. Got another failure yesterday:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=Firefox%20&filter-tier=1&filter-tier=2&filter-tier=3&bugfiler&selectedJob=4666549

Comment 9

[Intermittent Failures Robot]

10 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* try: 6
* mozilla-central: 3
* mozilla-inbound: 1

Platform breakdown:
* linux64: 8
* windows8-64: 1
* windows7-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-08-15&endday=2016-08-21&tree=all

Comment 10

[Intermittent Failures Robot]

7 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* try: 4
* mozilla-inbound: 2
* autoland: 1

Platform breakdown:
* linux64: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-08-22&endday=2016-08-28&tree=all

Comment 11

[BMO Automation]

Bulk assigning P3 to all open intermittent bugs without a priority set in Firefox components per bug 1298978.

Comment 12

[Intermittent Failures Robot]

8 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 5
* autoland: 3

Platform breakdown:
* linux64: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-08-29&endday=2016-09-04&tree=all

Comment 13

[Intermittent Failures Robot]

9 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 5
* try: 1
* mozilla-aurora: 1
* fx-team: 1
* autoland: 1

Platform breakdown:
* linux64: 8
* windows8-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-09-12&endday=2016-09-18&tree=all

Comment 14

[Intermittent Failures Robot]

5 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* try: 1
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* linux64: 4
* windows7-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-09-26&endday=2016-10-02&tree=all

Comment 15

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

Starting with latest beta on Thurday last week we got a high number of failures for this test:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-beta&revision=6efc0964ec62bc4abfdc4cb1dc7cc461c3238634&filter-searchStr=fxfn&filter-tier=3

Comment 16

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

With yesterday beta candidate builds we nearly failed all the tests:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-beta&revision=b7adb2f10487f6f886e047670ba720a248edcb44&filter-tier=3&filter-searchStr=fxfn

Comment 17

[François Marier [:francois]]

Should we start to see the effects of "browser.safebrowsing.debug = true" in the test logs soon?

I don't see it in the logs linked to from comment 15 or comment 16.

Comment 18

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

Both comments are related to beta and not central or aurora where the debug mode has been enabled. Central is currently not showing those problems, and for Aurora we have to wait until tomorrow given that the uplift hasn't made todays nightly build.

Comment 19

[Intermittent Failures Robot]

58 automation job failures were associated with this bug yesterday.

Repository breakdown:
* mozilla-beta: 58

Platform breakdown:
* windows8-64: 10
* windows7-64: 10
* windowsxp: 6
* windows7-32: 6
* linux64: 6
* linux32: 6
* osx-10-10: 5
* windows8-32: 4
* osx-10-11: 3
* osx-10-9: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-10-18&endday=2016-10-18&tree=all

Comment 20

[Intermittent Failures Robot]

69 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-beta: 69

Platform breakdown:
* windows8-64: 12
* windows7-64: 12
* windowsxp: 7
* windows7-32: 7
* linux64: 7
* linux32: 7
* windows8-32: 5
* osx-10-10: 5
* osx-10-11: 4
* osx-10-9: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2016-10-17&endday=2016-10-23&tree=all

Comment 21

[Intermittent Failures Robot]

3 failures in 656 pushes (0.005 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* osx-cross: 1
* osx-10-10: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 22

[Intermittent Failures Robot]

2 failures in 720 pushes (0.003 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 2

Platform breakdown:
* linux64: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1282056&startday=2017-07-10&endday=2017-07-16&tree=all

Comment 23

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

This might be fixed with the patch on bug 1374268, which extends the timeout

Comment 24

[Henrik Skupin [:whimboo][⌚️UTC+2] (away 10/03 - 10/13)]

This should hopefully be fixed now.