1482004 - Intermittent browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Panel has not shrunk from original size (X >= Y) -

Status: RESOLVED FIXED

(WebExtensions :: Untriaged, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dvarga [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=192911950&repo=autoland

https://queue.taskcluster.net/v1/task/BUKK6neGQHOWDppv5_L1DA/runs/0/artifacts/public/logs/live_backing.log

20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | 61 - 
20:07:59     INFO - Buffered messages finished
20:07:59     INFO - TEST-UNEXPECTED-FAIL | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Panel has not shrunk from original size (672 >= 744) - 
20:07:59     INFO - Stack trace:
20:07:59     INFO - chrome://mochitests/content/browser/browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js:checkPanelPosition:172
20:07:59     INFO - chrome://mochitests/content/browser/browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js:testPopupSize:222
20:07:59     INFO - chrome://mochitests/content/browser/browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js:testBrowserActionMenuResizeQuirks:283
20:07:59     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1103
20:07:59     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1094
20:07:59     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:996
20:07:59     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Bottom of popup should be on-screen. (695 <= 1120) - 
20:07:59     INFO - Increase body children's width and height. Expect them to wrap, and the frame to grow vertically rather than widen.
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Browser height should increase (632 > 176) - 
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Window width should not change - 
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Window height should increase (632 >= 560) - 
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Document should not be vertically scrollable - 0 <= 1 - 
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Panel arrow is positioned as expected - 
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | 61 - 
20:07:59     INFO - TEST-PASS | browser/components/extensions/test/browser/browser_ext_browserAction_popup_resize.js | Panel has not shrunk from original size (744 >= 744) -

Comment 1

[Intermittent Failures Robot]

6 failures in 2579 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 6

Platform breakdown:
* osx-10-10: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-08-06&endday=2018-08-12&tree=all

Comment 2

[Natalia Csoregi [:nataliaCs]]

The frequency of these failures has started to increase lately on Windows 10 x64 QuantumRender opt

@ddurst @miko is there any chance you could point me to the person that might be able to help with this?
Thank you

Comment 3

[Natalia Csoregi [:nataliaCs]]

Example of recent failure log:
https://treeherder.mozilla.org/logviewer.html#?job_id=197436380&repo=autoland&lineNumber=23781

18:43:56     INFO - REFTEST TEST-START | file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1.xml == file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1-ref.xml
18:43:56     INFO - REFTEST TEST-LOAD | file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1.xml | 857 / 2043 (41%)
18:43:56     INFO - REFTEST TEST-LOAD | file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1-ref.xml | 857 / 2043 (41%)
18:43:56     INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1.xml == file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1-ref.xml | image comparison, max difference: 255, number of differing pixels: 900
18:43:56     INFO - REFTEST INFO | Saved log: START file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1.xml
18:43:56     INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
18:43:56     INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
18:43:56     INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
18:43:56     INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
18:43:56     INFO - REFTEST INFO | Saved log: RecordResult fired
18:43:56     INFO - REFTEST INFO | Saved log: START file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1-ref.xml
18:43:56     INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
18:43:56     INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
18:43:56     INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
18:43:56     INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
18:43:56     INFO - REFTEST INFO | Saved log: RecordResult fired
18:43:56     INFO - REFTEST TEST-END | file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1.xml == file:///C:/Users/task_1536085859/build/tests/reftest/tests/layout/reftests/bugs/403181-1-ref.xml

Comment 4

[Natalia Csoregi [:nataliaCs]]

Please ignore this, the comments are not related to this issue. Thank you, and my apologies.

Comment 5

[Raul Gurzau (:RaulG)]

This started to occur more often:

https://treeherder.mozilla.org/#/jobs?repo=autoland&fromchange=de3ad2046aa56e664cfd4460541d15fa81945169&filter-searchStr=OS%20X%2010.10%20debug%20Mochitests%20with%20e10s%20test-macosx64%2Fdebug-mochitest-browser-chrome-e10s-7%20M-e10s(bc7)

ddurst, can you please take a look?

Comment 7

[Intermittent Failures Robot]

69 failures in 515 pushes (0.134 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 1
* autoland: 67
* mozilla-inbound: 1

Platform breakdown:
* windows10-64-qr: 26
* osx-10-10: 43

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-09-04&endday=2018-09-04&tree=all

Comment 8

[Intermittent Failures Robot]

60 failures in 588 pushes (0.102 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 10
* autoland: 25
* mozilla-inbound: 24
* try: 1

Platform breakdown:
* osx-10-10: 60

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-09-05&endday=2018-09-05&tree=all

Comment 9

[Intermittent Failures Robot]

45 failures in 531 pushes (0.085 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-central: 4
* mozilla-inbound: 9
* autoland: 32

Platform breakdown:
* osx-10-10: 45

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-09-06&endday=2018-09-06&tree=all

Comment 10

[Intermittent Failures Robot]

37 failures in 492 pushes (0.075 failures/push) were associated with this bug yesterday.

Repository breakdown:
* autoland: 23
* mozilla-central: 1
* mozilla-inbound: 13

Platform breakdown:
* osx-10-10: 37

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-09-07&endday=2018-09-07&tree=all

Comment 11

[Cristina Coroiu [:ccoroiu]]

Attachment: Disabling browser_ext_browserAction_popup_resize.js on mac debug

Comment 12

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 9007418 [details] [diff] [review]
Disabling browser_ext_browserAction_popup_resize.js on mac debug

Review of attachment 9007418 [details] [diff] [review]:
-----------------------------------------------------------------

::: browser/components/extensions/test/browser/browser-common.ini
@@ +59,4 @@
>  [browser_ext_browserAction_popup_preload.js]
>  skip-if = (os == 'win' && !debug) || (verify && debug && (os == 'mac')) # bug 1352668
>  [browser_ext_browserAction_popup_resize.js]
> +skip-if = (os == 'mac' && debug) # Bug 1482004

I would really like to keep context that this fails in verify mode.  Can you add in the comment that it also fails specifically in test-verify mode:
# Bug 1482004, also fails in test-verify

Comment 13

[Cristina Coroiu [:ccoroiu]]

Attachment: Disable browser_net_statistics_01.js for frequent failures

Comment 14

[Cristina Coroiu [:ccoroiu]]

Attachment: Disabling browser_ext_browserAction_popup_resize.js on mac debug

Comment 15

[Cristina Coroiu [:ccoroiu]]

Attachment: Disabling browser_ext_browserAction_popup_resize.js on mac debugbug1482004.patch

Sorry, when trying to land I've noticed that in the commit message it was another file.

Comment 16

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 9007427 [details] [diff] [review]
Disabling browser_ext_browserAction_popup_resize.js on mac debugbug1482004.patch

Review of attachment 9007427 [details] [diff] [review]:
-----------------------------------------------------------------

good catch

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/c27c3aaafcb6
Disable browser_ext_browserAction_popup_resize.js for frequent failures r=jmaher

Comment 18

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/c27c3aaafcb6

Comment 19

[Intermittent Failures Robot]

214 failures in 2667 pushes (0.08 failures/push) were associated with this bug in the last 7 days.

This is the #1 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. ** 

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 16
* try: 1
* mozilla-inbound: 49
* autoland: 148

Platform breakdown:
* osx-10-10: 188
* windows10-64-qr: 26

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-09-03&endday=2018-09-09&tree=all

Comment 20

[Intermittent Failures Robot]

1 failures in 2902 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1

Platform breakdown:
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-09-17&endday=2018-09-23&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 2708 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-10-01&endday=2018-10-07&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 2759 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-10-15&endday=2018-10-21&tree=all

Comment 23

[Intermittent Failures Robot]

2 failures in 2808 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 2

Platform breakdown:
* linux32: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 24

[Intermittent Failures Robot]

2 failures in 2383 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1482004&startday=2019-01-21&endday=2019-01-27&tree=all

Comment 25

[Luca Greco [:rpl] [:luca] [:lgreco]]

Marking as fixed, this test has been re-enabled in Bug 1483701.

Comment 26

[Victor Carciu]

From my understanding this issue is related to the addon tests. Is there any need of manual QA here? If not can you please mark it as "qe-verify- "