1480292 - Intermittent browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct y origin - Got 99, expected 94

Status: RESOLVED FIXED

(WebExtensions :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=191494188&repo=autoland

https://queue.taskcluster.net/v1/task/EDxEgsWUQDeFuUYb8ZYZ4w/runs/0/artifacts/public/logs/live_backing.log

00:21:52     INFO - GECKO(2888) | 1533169312927	Marionette	TRACE	2 -> [0,6,"WebDriver:ExecuteScript",{"scriptTimeout":null,"newSandbox":true,"args":[{"testUrl":"about:blank","flavor":"browser-chr ...  new CustomEvent(\"mochitest-load\", {\"detail\": [flavor, url]});\nwin.dispatchEvent(ev);","sandbox":"default","line":1757}]
00:21:52     INFO - GECKO(2888) | 1533169312936	Marionette	TRACE	2 <- [1,6,null,{"value":null}]
00:21:52     INFO - GECKO(2888) | 1533169312963	Marionette	TRACE	2 -> [0,7,"Marionette:SetContext",{"value":"content"}]
00:21:52     INFO - GECKO(2888) | 1533169312964	Marionette	TRACE	2 <- [1,7,null,{"value":null}]
00:21:52     INFO - GECKO(2888) | 1533169312966	Marionette	TRACE	2 -> [0,8,"WebDriver:DeleteSession",{}]
00:21:52     INFO - GECKO(2888) | 1533169312967	Marionette	TRACE	2 <- [1,8,null,{"value":null}]
00:21:52     INFO - runtests.py | Waiting for browser...
00:21:52     INFO - GECKO(2888) | 1533169312970	Marionette	DEBUG	Closed connection 2
00:21:53     INFO - *** Start BrowserChrome Test Results ***
00:21:53     INFO - checking window state
00:21:53     INFO - TEST-START | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js
00:21:53     INFO - TEST-INFO | started process screenshot
00:21:53     INFO - TEST-INFO | screenshot: exit 0
00:21:53     INFO - Buffered messages logged at 00:21:53
00:21:53     INFO - Entering test bound testPopupSelectPopup
00:21:53     INFO - Extension loaded
00:21:53     INFO - Console message: [JavaScript Warning: "Use of nsIFile in content process is deprecated." {file: "resource://gre/modules/FileUtils.jsm" line: 170}]
00:21:53     INFO - Test browserAction popup
00:21:53     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Expect widget not to be overflowed - 
00:21:53     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct x origin - 
00:21:53     INFO - Buffered messages finished
00:21:53     INFO - TEST-UNEXPECTED-FAIL | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct y origin - Got 99, expected 94
00:21:53     INFO - Stack trace:
00:21:53     INFO - chrome://mochikit/content/browser-test.js:test_is:1305
00:21:53     INFO - chrome://mochitests/content/browser/browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js:testPanel:66
00:21:53     INFO - chrome://mochitests/content/browser/browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js:testPopupSelectPopup:75
00:21:53     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1103
00:21:53     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1094
00:21:53     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:996
00:21:53     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
00:21:53     INFO - GECKO(2888) | JavaScript error: resource://gre/modules/SelectParentHelper.jsm, line 226: TypeError: currentBrowser.messageManager is null
00:21:53     INFO - Test pageAction popup
00:21:53     INFO - Console message: [JavaScript Error: "TypeError: currentBrowser.messageManager is null" {file: "resource://gre/modules/SelectParentHelper.jsm" line: 226}]
00:21:53     INFO - GECKO(2888) | JavaScript error: resource://gre/modules/SelectParentHelper.jsm, line 193: TypeError: currentBrowser.messageManager is undefined
00:21:53     INFO - Console message: [JavaScript Error: "TypeError: currentBrowser.messageManager is undefined" {file: "resource://gre/modules/SelectParentHelper.jsm" line: 193}]
00:21:53     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct x origin - 
00:21:53     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct y origin - 
00:21:53     INFO - GECKO(2888) | JavaScript error: resource://gre/modules/SelectParentHelper.jsm, line 226: TypeError: currentBrowser.messageManager is null
00:21:53     INFO - Console message: [JavaScript Error: "TypeError: currentBrowser.messageManager is null" {file: "resource://gre/modules/SelectParentHelper.jsm" line: 226}]
00:21:53     INFO - Leaving test bound testPopupSelectPopup
00:21:53     INFO - GECKO(2888) | MEMORY STAT | vsize 1723MB | vsizeMaxContiguous 130348901MB | residentFast 249MB | heapAllocated 124MB
00:21:53     INFO - TEST-OK | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | took 795ms

Comment 1

[Intermittent Failures Robot]

43 failures in 2579 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #42 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 18
* mozilla-inbound: 14
* try: 3
* mozilla-central: 8

Platform breakdown:
* windows10-64: 39
* windows10-64-msvc: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480292&startday=2018-08-06&endday=2018-08-12&tree=all

Comment 2

[Dorel Luca [:dluca]]

This bug has failed 48 times in the last 7 days only on windows64 on pgo and opt build types.

Here is a recent log:
https://treeherder.mozilla.org/logviewer.html#?job_id=193246811&repo=mozilla-central&lineNumber=2331

TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct x origin - 
10:40:13     INFO - Buffered messages finished
10:40:13     INFO - TEST-UNEXPECTED-FAIL | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct y origin - Got 99, expected 94
10:40:13     INFO - Stack trace:
10:40:13     INFO - chrome://mochikit/content/browser-test.js:test_is:1308
10:40:13     INFO - chrome://mochitests/content/browser/browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js:testPanel:66
10:40:13     INFO - chrome://mochitests/content/browser/browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js:testPopupSelectPopup:75
10:40:13     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
10:40:13     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
10:40:13     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:999
10:40:13     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
10:40:13     INFO - GECKO(5028) | JavaScript error: resource://gre/modules/SelectParentHelper.jsm, line 226: TypeError: currentBrowser.messageManager is null
10:40:13     INFO - Test pageAction popup
10:40:13     INFO - Console message: [JavaScript Error: "TypeError: currentBrowser.messageManager is null" {file: "resource://gre/modules/SelectParentHelper.jsm" line: 226}]
10:40:13     INFO - GECKO(5028) | JavaScript error: resource://gre/modules/SelectParentHelper.jsm, line 193: TypeError: currentBrowser.messageManager is undefined
10:40:13     INFO - Console message: [JavaScript Error: "TypeError: currentBrowser.messageManager is undefined" {file: "resource://gre/modules/SelectParentHelper.jsm" line: 193}]
10:40:13     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct x origin - 
10:40:13     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | Select popup has the correct y origin - 
10:40:13     INFO - GECKO(5028) | JavaScript error: resource://gre/modules/SelectParentHelper.jsm, line 226: TypeError: currentBrowser.messageManager is null
10:40:13     INFO - Console message: [JavaScript Error: "TypeError: currentBrowser.messageManager is null" {file: "resource://gre/modules/SelectParentHelper.jsm" line: 226}]
10:40:13     INFO - Leaving test bound testPopupSelectPopup
10:40:13     INFO - GECKO(5028) | MEMORY STAT | vsize 1707MB | vsizeMaxContiguous 130866417MB | residentFast 249MB | heapAllocated 125MB
10:40:13     INFO - TEST-OK | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_popup_select.js | took 784ms

ddurst: Can you please take a look at this bug?

Comment 3

[Intermittent Failures Robot]

20 failures in 594 pushes (0.034 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 15
* autoland: 4
* mozilla-central: 1

Platform breakdown:
* windows10-64: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480292&startday=2018-08-14&endday=2018-08-14&tree=all

Comment 4

[Luca Greco [:rpl] [:luca] [:lgreco]]

Attachment: Bug 1480292 - Fix browser_ext_popup_select intermittent failures.

From what I saw by reproducing it locally (e.g. I've also been able to trigger it locally pretty often on linux64 by using "./mach mochitest --verify"), the select popup may sometimes be still using part of its previous position while switching between the test case for the browserAction and the test case for the pageAction.

On linux64 this test was also (from time to time) sending the mouse event when the select element wasn't yet ready to be clicked in the extension popup.

This patch aims to make the behaviors of this test more stable by applying the following changes:
- disable the cosmeticAnimations while running these tests
- explicitly wait the select element in the popup (using ContentTask.spawn and ContentTaskUtils.waitForCondition) before sending it a mouse event
- explicilty close the select popup (and wait the select popup to be hidden) before proceeding to the next test case

The following push to try seems to confirm that these changes are helping to make the test more stable:
- https://treeherder.mozilla.org/#/jobs?repo=try&revision=086c526724ba409068d679036dd3ef13788535b6&selectedJob=194152144

Comment 5

[Intermittent Failures Robot]

34 failures in 494 pushes (0.069 failures/push) were associated with this bug yesterday.

Repository breakdown:
* try: 1
* mozilla-central: 6
* autoland: 6
* mozilla-inbound: 21

Platform breakdown:
* windows10-64-msvc: 1
* windows7-32: 3
* windows10-64: 28
* windows10-64-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480292&startday=2018-08-15&endday=2018-08-15&tree=all

Comment 6

[Shane Caraveo (:mixedpuppy)]

Comment on attachment 9001379 [details]
Bug 1480292 - Fix browser_ext_popup_select intermittent failures.

Shane Caraveo (:mixedpuppy) has approved the revision.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f35fa6e7fb46
Fix browser_ext_popup_select intermittent failures. r=mixedpuppy

Comment 8

[Tiberius Oros[:tiberius_oros]]

https://hg.mozilla.org/mozilla-central/rev/f35fa6e7fb46

Comment 9

[Intermittent Failures Robot]

34 failures in 527 pushes (0.065 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-central: 8
* autoland: 8
* mozilla-inbound: 18

Platform breakdown:
* windows10-64-msvc: 3
* windows10-64: 30
* windows10-64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480292&startday=2018-08-16&endday=2018-08-16&tree=all

Comment 10

[Intermittent Failures Robot]

99 failures in 2672 pushes (0.037 failures/push) were associated with this bug in the last 7 days.

This is the #27 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. ** 

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 1
* mozilla-central: 17
* autoland: 25
* mozilla-inbound: 56

Platform breakdown:
* windows10-64-nightly: 3
* windows10-64-msvc: 5
* windows7-32: 3
* windows10-64: 88

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1480292&startday=2018-08-13&endday=2018-08-19&tree=all