1495075 - Intermittent toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is not a tracker - got "no", expected "yes"

Status: RESOLVED DUPLICATE of bug 1495110

(Toolkit :: Safe Browsing, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rgurzau [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=202285666&repo=autoland

https://queue.taskcluster.net/v1/task/TfLIPbSoTIquOJTLfH13xw/runs/0/artifacts/public/logs/live_backing.log

[task 2018-09-28T19:50:26.360Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 12 trackers found 
[task 2018-09-28T19:50:26.362Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 0 tracker blocked 
[task 2018-09-28T19:50:26.364Z] 19:50:26     INFO - Buffered messages logged at 19:50:21
[task 2018-09-28T19:50:26.366Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | resources are loaded 
[task 2018-09-28T19:50:26.368Z] 19:50:26     INFO - Buffered messages logged at 19:50:22
[task 2018-09-28T19:50:26.370Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is not a tracker 
[task 2018-09-28T19:50:26.377Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is a fast tracker 
[task 2018-09-28T19:50:26.378Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is a blocked tracker 
[task 2018-09-28T19:50:26.382Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | fast iframe loaded 
[task 2018-09-28T19:50:26.383Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | slow tracking iframe blocked 
[task 2018-09-28T19:50:26.385Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is not a tracker 
[task 2018-09-28T19:50:26.386Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is a fast tracker 
[task 2018-09-28T19:50:26.387Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is a blocked tracker 
[task 2018-09-28T19:50:26.388Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | redirect to blocked tracker 
[task 2018-09-28T19:50:26.391Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 7 trackers found 
[task 2018-09-28T19:50:26.393Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 4 tracker blocked 
[task 2018-09-28T19:50:26.394Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | the channel is loaded 
[task 2018-09-28T19:50:26.397Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | tracking iframe after load event is loaded 
[task 2018-09-28T19:50:26.398Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | post-load tracking iframe loaded 
[task 2018-09-28T19:50:26.400Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | yes - is not a tracker
[task 2018-09-28T19:50:26.401Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | yes - is a loaded tracker
[task 2018-09-28T19:50:26.404Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | yes - is a loaded tracker
[task 2018-09-28T19:50:26.405Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 10 trackers found 
[task 2018-09-28T19:50:26.406Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 4 tracker blocked 
[task 2018-09-28T19:50:26.410Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | the channel is loaded 
[task 2018-09-28T19:50:26.411Z] 19:50:26     INFO - Buffered messages logged at 19:50:23
[task 2018-09-28T19:50:26.412Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | non tracking iframe is loaded 
[task 2018-09-28T19:50:26.413Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | non tracking iframe is loaded 
[task 2018-09-28T19:50:26.414Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is not a tracker 
[task 2018-09-28T19:50:26.414Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is a loaded tracker 
[task 2018-09-28T19:50:26.416Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is a loaded tracker 
[task 2018-09-28T19:50:26.417Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 12 trackers found 
[task 2018-09-28T19:50:26.418Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | 4 tracker blocked 
[task 2018-09-28T19:50:26.419Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | observer removed 
[task 2018-09-28T19:50:26.420Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | observer removed 
[task 2018-09-28T19:50:26.421Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | observer removed 
[task 2018-09-28T19:50:26.422Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | no suspended request 
[task 2018-09-28T19:50:26.423Z] 19:50:26     INFO - Buffered messages logged at 19:50:25
[task 2018-09-28T19:50:26.424Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is not a tracker 
[task 2018-09-28T19:50:26.425Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | FastBlock is disabled 
[task 2018-09-28T19:50:26.427Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | FastBlock is disabled 
[task 2018-09-28T19:50:26.428Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | fast iframe loaded 
[task 2018-09-28T19:50:26.429Z] 19:50:26     INFO - TEST-PASS | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | FastBlock is disabled 
[task 2018-09-28T19:50:26.430Z] 19:50:26     INFO - Buffered messages finished
[task 2018-09-28T19:50:26.431Z] 19:50:26     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | is not a tracker - got "no", expected "yes"
[task 2018-09-28T19:50:26.433Z] 19:50:26     INFO - SimpleTest.is@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:312:5
[task 2018-09-28T19:50:26.434Z] 19:50:26     INFO - testNoFastBlock@chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:497:3
[task 2018-09-28T19:50:26.439Z] 19:50:26     INFO - async*runTest/</<@chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:296:13
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - async*testOnWindow/</<@chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:123:7
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - process@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:928:23
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - walkerLoop@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:812:29
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - Promise*scheduleWalkerLoop@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:745:11
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - schedulePromise@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:776:7
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - completePromise@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:713:7
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - receiveMessage@resource://testing-common/ContentTask.jsm:112:9
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - MessageListener.receiveMessage*@resource://testing-common/ContentTask.jsm:127:1
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - @resource://testing-common/BrowserTestUtils.jsm:26:1
[task 2018-09-28T19:50:26.443Z] 19:50:26     INFO - @chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:62:1
[task 2018-09-28T19:50:26.444Z] 19:50:26     INFO - Not taking screenshot here: see the one that was previously logged
[task 2018-09-28T19:50:26.445Z] 19:50:26     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html | FastBlock is disabled - got "no", expected "yes"
[task 2018-09-28T19:50:26.446Z] 19:50:26     INFO - SimpleTest.is@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:312:5
[task 2018-09-28T19:50:26.447Z] 19:50:26     INFO - testNoFastBlock@chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:498:3
[task 2018-09-28T19:50:26.449Z] 19:50:26     INFO - async*runTest/</<@chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:296:13
[task 2018-09-28T19:50:26.451Z] 19:50:26     INFO - async*testOnWindow/</<@chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:123:7
[task 2018-09-28T19:50:26.451Z] 19:50:26     INFO - process@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:928:23
[task 2018-09-28T19:50:26.453Z] 19:50:26     INFO - walkerLoop@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:812:29
[task 2018-09-28T19:50:26.457Z] 19:50:26     INFO - Promise*scheduleWalkerLoop@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:745:11
[task 2018-09-28T19:50:26.458Z] 19:50:26     INFO - schedulePromise@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:776:7
[task 2018-09-28T19:50:26.459Z] 19:50:26     INFO - completePromise@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:713:7
[task 2018-09-28T19:50:26.460Z] 19:50:26     INFO - receiveMessage@resource://testing-common/ContentTask.jsm:112:9
[task 2018-09-28T19:50:26.461Z] 19:50:26     INFO - MessageListener.receiveMessage*@resource://testing-common/ContentTask.jsm:127:1
[task 2018-09-28T19:50:26.462Z] 19:50:26     INFO - @resource://testing-common/BrowserTestUtils.jsm:26:1
[task 2018-09-28T19:50:26.463Z] 19:50:26     INFO - @chrome://mochitests/content/chrome/toolkit/components/url-classifier/tests/mochitest/test_fastblock_bug1477046.html:62:1
[task 2018-09-28T19:50:26.465Z] 19:50:26     INFO - Not taking screenshot here: see the one that was previously logged

Comment 1

[François Marier [:francois]]

This might be a dupe of bug 1491260.

Comment 2

[Andreea Pavel [:apavel]]

Based on retriggers, this is caused by bug 1488974 

https://treeherder.mozilla.org/#/jobs?repo=autoland&selectedJob=202285864&tochange=0c1057bba22441122eb5f160752af63f1ba517a5&fromchange=dbe2506cadd0e14699963d226538c1d5b89eea40&searchStr=os,x,10.10,debug,mochitests,test-macosx64%2Fdebug-mochitest-chrome-3,m(c3)&group_state=expanded

Francois, can you please take a look and provide some input here? Can that bug be the cause?

Comment 3

[Intermittent Failures Robot]

14 failures in 2773 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 8
* mozilla-inbound: 5
* mozilla-central: 1

Platform breakdown:
* windows7-32: 1
* osx-10-10: 9
* linux32: 1
* linux64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1495075&startday=2018-09-24&endday=2018-09-30&tree=all

Comment 4

[François Marier [:francois]]

(In reply to Andreea Pavel [:apavel] from comment #2)
> Francois, can you please take a look and provide some input here? Can that
> bug be the cause?

I'm not sure that bug 1488974 is the cause since this test was already intermittently failing before (see bug 1491260, bug 1495133, and bug 1495110).

Comment 5

[Andreea Pavel [:apavel]]

(In reply to François Marier [:francois] from comment #4)
> (In reply to Andreea Pavel [:apavel] from comment #2)
> > Francois, can you please take a look and provide some input here? Can that
> > bug be the cause?
> 
> I'm not sure that bug 1488974 is the cause since this test was already
> intermittently failing before (see bug 1491260, bug 1495133, and bug
> 1495110).

It's the same file but the failure differs from:

is not a tracker - got "no", expected "yes"  to is a fast tracker - got "no", expected "yes", and this failure appeared on the bug you pushed, reason why i ni you. 

Gary, can you please take a look at this too? I see you are assigned in bug 1495110.

Comment 6

[Gary Chen [:xeonchen]]

(In reply to Andreea Pavel [:apavel] from comment #5)
> (In reply to François Marier [:francois] from comment #4)
> > (In reply to Andreea Pavel [:apavel] from comment #2)
> > > Francois, can you please take a look and provide some input here? Can that
> > > bug be the cause?
> > 
> > I'm not sure that bug 1488974 is the cause since this test was already
> > intermittently failing before (see bug 1491260, bug 1495133, and bug
> > 1495110).
> 
> It's the same file but the failure differs from:
> 
> is not a tracker - got "no", expected "yes"  to is a fast tracker - got
> "no", expected "yes", and this failure appeared on the bug you pushed,
> reason why i ni you. 
> 
> Gary, can you please take a look at this too? I see you are assigned in bug
> 1495110.

I think this is not the same as bug 1491260 (see bug 1491260 comment 3).
I'll check this by reproducing with rr, might not update very soon.

Comment 7

[Andreea Pavel [:apavel]]

Thanks Gary.

Comment 8

[Intermittent Failures Robot]

13 failures in 2708 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 3
* mozilla-inbound: 6
* try: 3
* mozilla-central: 1

Platform breakdown:
* linux32: 1
* linux64: 3
* linux64-ccov: 1
* osx-10-10: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1495075&startday=2018-10-01&endday=2018-10-07&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 2740 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1495075&startday=2018-10-08&endday=2018-10-14&tree=all