1449061 - Intermittent browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 4 matched about:blank - Got about:blank, expected http://mochi.test:8888/#4

Status: RESOLVED FIXED

(Firefox :: Tabbed Browser, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: aiakab [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=170431870&repo=autoland

https://queue.taskcluster.net/v1/task/SRXaLN7fTESlXQiWESroiQ/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

1 failures in 822 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1449061&startday=2018-03-20&endday=2018-03-26&tree=trunk

Comment 2

[Intermittent Failures Robot]

16 failures in 161 pushes (0.099 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 9
* mozilla-inbound: 4
* try: 2
* mozilla-central: 1

Platform breakdown:
* linux64: 10
* windows7-32: 3
* windows10-64: 1
* linux64-nightly: 1
* linux64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1449061&startday=2018-03-28&endday=2018-03-28&tree=trunk

Comment 3

[Cristina Coroiu [:ccoroiu]]

Since this bug was created, 2 days ago, there have been 35 failures.

Most of the failures are on Linux x64 platform, but a few of them on Linux, Windows 7 and windows10-64.
Affected build types: pgo, opt and one on asan.

An example of a recent log file:
https://treeherder.mozilla.org/logviewer.html#?job_id=170965420&repo=mozilla-inbound&lineNumber=2800

And the relevant part of the log:
[task 2018-03-29T05:19:04.786Z] 05:19:04     INFO - TEST-START | browser/base/content/test/tabs/browser_new_tab_insert_position.js
[task 2018-03-29T05:19:06.821Z] 05:19:06     INFO - TEST-INFO | started process screentopng
[task 2018-03-29T05:19:07.384Z] 05:19:07     INFO - TEST-INFO | screentopng: exit 0
[task 2018-03-29T05:19:07.385Z] 05:19:07     INFO - Buffered messages logged at 05:19:04
[task 2018-03-29T05:19:07.385Z] 05:19:07     INFO - Entering test bound test_settings_insertRelatedAfter
[task 2018-03-29T05:19:07.386Z] 05:19:07     INFO - Buffered messages logged at 05:19:05
[task 2018-03-29T05:19:07.387Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | Middle click should open site to correct url. - 
[task 2018-03-29T05:19:07.388Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | (aInsertRelatedAfterCurrent=true, aInsertAfterCurrent=false): Middle click should open site in a new tab immediately to the right - 
[task 2018-03-29T05:19:07.389Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab owner is set correctly - 
[task 2018-03-29T05:19:07.389Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | opener tab is set - 
[task 2018-03-29T05:19:07.390Z] 05:19:07     INFO - Console message: [JavaScript Warning: "Key event not available on some keyboard layouts: key=“r” modifiers=“accel,alt” id=“key_toggleReaderMode”" {file: "chrome://mochikit/content/tests/SimpleTest/EventUtils.js" line: 946}]
[task 2018-03-29T05:19:07.392Z] 05:19:07     INFO - Console message: [JavaScript Warning: "Key event not available on some keyboard layouts: key=“i” modifiers=“accel,alt,shift” id=“key_browserToolbox”" {file: "chrome://mochikit/content/tests/SimpleTest/EventUtils.js" line: 946}]
[task 2018-03-29T05:19:07.393Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | (aInsertRelatedAfterCurrent=true, aInsertAfterCurrent=false):  http://example.com/#urlbar should be loaded in the current tab. - 
[task 2018-03-29T05:19:07.394Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | (aInsertRelatedAfterCurrent=true, aInsertAfterCurrent=false):  Alt+Enter in the URL bar should open page in a new tab at rightmost - 
[task 2018-03-29T05:19:07.395Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | owner tab is set correctly - 
[task 2018-03-29T05:19:07.397Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | no opener tab is set - 
[task 2018-03-29T05:19:07.398Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | (aInsertRelatedAfterCurrent=true, aInsertAfterCurrent=false): openerTab should be selected after closing unrelated tab - 
[task 2018-03-29T05:19:07.401Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | (aInsertRelatedAfterCurrent=true, aInsertAfterCurrent=false): openerTab should be selected after closing related tab - 
[task 2018-03-29T05:19:07.402Z] 05:19:07     INFO - Buffered messages logged at 05:19:06
[task 2018-03-29T05:19:07.403Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 0 matched http://mochi.test:8888/#0 - 
[task 2018-03-29T05:19:07.405Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 1 matched http://example.com/browser/browser/base/content/test/tabs/file_new_tab_page.html - 
[task 2018-03-29T05:19:07.406Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 2 matched http://mochi.test:8888/#1 - 
[task 2018-03-29T05:19:07.408Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 3 matched http://mochi.test:8888/#3 - 
[task 2018-03-29T05:19:07.409Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 4 matched http://mochi.test:8888/#4 - 
[task 2018-03-29T05:19:07.411Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 0 matched http://mochi.test:8888/#0 - 
[task 2018-03-29T05:19:07.412Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 1 matched http://example.com/browser/browser/base/content/test/tabs/file_new_tab_page.html - 
[task 2018-03-29T05:19:07.418Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 2 matched http://mochi.test:8888/#1 - 
[task 2018-03-29T05:19:07.419Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 3 matched http://mochi.test:8888/#3 - 
[task 2018-03-29T05:19:07.420Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 4 matched http://mochi.test:8888/#4 - 
[task 2018-03-29T05:19:07.422Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 0 matched http://mochi.test:8888/#0 - 
[task 2018-03-29T05:19:07.423Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 1 matched http://example.com/browser/browser/base/content/test/tabs/file_new_tab_page.html - 
[task 2018-03-29T05:19:07.424Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 2 matched http://mochi.test:8888/#1 - 
[task 2018-03-29T05:19:07.425Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 3 matched http://mochi.test:8888/#3 - 
[task 2018-03-29T05:19:07.426Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 4 matched http://mochi.test:8888/#4 - 
[task 2018-03-29T05:19:07.428Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 0 matched http://mochi.test:8888/#0 - 
[task 2018-03-29T05:19:07.429Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 1 matched http://example.com/browser/browser/base/content/test/tabs/file_new_tab_page.html - 
[task 2018-03-29T05:19:07.431Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 2 matched http://mochi.test:8888/#1 - 
[task 2018-03-29T05:19:07.432Z] 05:19:07     INFO - TEST-PASS | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 3 matched http://mochi.test:8888/#3 - 
[task 2018-03-29T05:19:07.433Z] 05:19:07     INFO - Buffered messages finished
[task 2018-03-29T05:19:07.434Z] 05:19:07     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/tabs/browser_new_tab_insert_position.js | tab pos 4 matched about:blank - Got about:blank, expected http://mochi.test:8888/#4
[task 2018-03-29T05:19:07.435Z] 05:19:07     INFO - Stack trace:
[task 2018-03-29T05:19:07.436Z] 05:19:07     INFO - chrome://mochikit/content/browser-test.js:test_is:1280
[task 2018-03-29T05:19:07.436Z] 05:19:07     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_new_tab_insert_position.js:verifyTabState:43
[task 2018-03-29T05:19:07.437Z] 05:19:07     INFO - chrome://mochitests/content/browser/browser/base/content/test/tabs/browser_new_tab_insert_position.js:doTest:156
[task 2018-03-29T05:19:07.438Z] 05:19:07     INFO - Leaving test bound test_settings_insertRelatedAfter


:dao As you are the triage owner of this component, could you please take a look at this?
Thank you!

Comment 4

[Intermittent Failures Robot]

18 failures in 120 pushes (0.15 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 7
* mozilla-inbound: 6
* try: 3
* mozilla-central: 2

Platform breakdown:
* linux64: 11
* linux32: 4
* windows7-32-nightly: 1
* windows7-32: 1
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1449061&startday=2018-03-29&endday=2018-03-29&tree=trunk

Comment 5

[Noemi Erli[:noemi_erli]]

After some investigation, we have an average of 2 failures out of 20 retriggers.
The push that caused this failure seems to be: https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=e811edda21f3bcb3bc564e85f9f91fda8e318a7a&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=success&filter-resultStatus=pending&filter-resultStatus=running&filter-searchStr=opt-mochitest-browser-chrome-e10s&selectedJob=171207173

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

thanks Noemi for working on this bug- you got a great start on it.  A few things to consider:
1) the job was being retriggered on bc6, but shifted from bc3- we needed to go back a bit further in time.
2) it is a good idea to show the treeherder view for a few failures and a few revisions that don't fail- so we can see the before/after pattern
3) lastly- it looks like a few revisions before the many bc3 failures, this test was freshly added in Bug 1344749

Lets ask :mixedpuppy to look at this bug as he appears to have written the patch.

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

and test-verify said this failed:
https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=aee255d8336cc1ef9aa88964dbe57b6e5ec53fcf&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=success&filter-resultStatus=pending&filter-resultStatus=running&filter-searchStr=verify&selectedJob=170374931

Comment 8

[Intermittent Failures Robot]

76 failures in 718 pushes (0.106 failures/push) were associated with this bug in the last 7 days. 

This is the #14 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 31
* mozilla-inbound: 19
* mozilla-central: 14
* try: 12

Platform breakdown:
* linux64: 45
* linux32: 13
* windows7-32: 6
* linux64-nightly: 6
* windows7-32-nightly: 3
* windows10-64: 1
* linux64-devedition: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1449061&startday=2018-03-26&endday=2018-04-01&tree=trunk

Comment 9

[Shane Caraveo (:mixedpuppy)]

I have a followup patch in bug 1344749 that should address this.

Comment 10

[Intermittent Failures Robot]

15 failures in 165 pushes (0.091 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 7
* autoland: 5
* mozilla-central: 3

Platform breakdown:
* linux64: 8
* linux32: 5
* windows7-32: 1
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1449061&startday=2018-04-03&endday=2018-04-03&tree=trunk

Comment 11

[Shane Caraveo (:mixedpuppy)]

fix in https://hg.mozilla.org/integration/mozilla-inbound/rev/864320860e94d0dd3a8f05976601ed6a7dc5a79d

Comment 12

[Intermittent Failures Robot]

35 failures in 765 pushes (0.046 failures/push) were associated with this bug in the last 7 days. 

This is the #50 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 13
* mozilla-inbound: 12
* mozilla-central: 6
* try: 4

Platform breakdown:
* linux64: 24
* linux32: 6
* windows7-32: 3
* windows7-32-devedition: 1
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1449061&startday=2018-04-02&endday=2018-04-08&tree=trunk

Comment 13

[Shane Caraveo (:mixedpuppy)]

Looking at comment 12, no failures since the patch in comment 11 landed.