1459913 - Intermittent failure - browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 0 in nav-bar should match expectations. - Got forward-button, expected back-button

Status: RESOLVED FIXED

(Firefox :: Toolbars and Customization, defect)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=177416036&repo=autoland

https://queue.taskcluster.net/v1/task/UmXgQ3Q-R6WM55_dYPykuw/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Andreea Pavel [:apavel]]

:Gijs tie1 failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=177591230&repo=autoland&lineNumber=4362

02:33:26     INFO -  1109 INFO TEST-START | browser/components/customizableui/test/browser_allow_dragging_removable_false.js
02:33:26     INFO -  TEST-INFO | started process screenshot
02:33:26     INFO -  TEST-INFO | screenshot: exit 0
02:33:26     INFO -  Buffered messages logged at 02:33:26
02:33:26     INFO -  1110 INFO Entering test bound
02:33:26     INFO -  1111 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | forward-button should not be removable -
02:33:26     INFO -  1112 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Should start in default state. -
02:33:26     INFO -  1113 INFO Actual placements: forward-button, back-button, stop-reload-button, home-button, customizableui-special-spring1, urlbar-container, customizableui-special-spring2, downloads-button, library-button, sidebar-button
02:33:26     INFO -  1114 INFO Expected placements: back-button, stop-reload-button, home-button, customizableui-special-spring1, forward-button, urlbar-container, customizableui-special-spring2, downloads-button, library-button, sidebar-button
02:33:26     INFO -  1115 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Area nav-bar should have 10 items. -
02:33:26     INFO -  Buffered messages finished
02:33:26    ERROR -  1116 INFO TEST-UNEXPECTED-FAIL | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 0 in nav-bar should match expectations. - Got forward-button, expected back-button
02:33:26     INFO -  Stack trace:
02:33:26     INFO -  chrome://mochikit/content/browser-test.js:test_is:1290
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:placementArraysEqual:143
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:assertAreaPlacements:132
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/browser_allow_dragging_removable_false.js:null:17
02:33:26     INFO -  Not taking screenshot here: see the one that was previously logged
02:33:26    ERROR -  1117 INFO TEST-UNEXPECTED-FAIL | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 1 in nav-bar should match expectations. - Got back-button, expected stop-reload-button
02:33:26     INFO -  Stack trace:
02:33:26     INFO -  chrome://mochikit/content/browser-test.js:test_is:1290
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:placementArraysEqual:143
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:assertAreaPlacements:132
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/browser_allow_dragging_removable_false.js:null:17
02:33:26     INFO -  Not taking screenshot here: see the one that was previously logged
02:33:26    ERROR -  1118 INFO TEST-UNEXPECTED-FAIL | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 2 in nav-bar should match expectations. - Got stop-reload-button, expected home-button
02:33:26     INFO -  Stack trace:
02:33:26     INFO -  chrome://mochikit/content/browser-test.js:test_is:1290
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:placementArraysEqual:143
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:assertAreaPlacements:132
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/browser_allow_dragging_removable_false.js:null:17
02:33:26     INFO -  Not taking screenshot here: see the one that was previously logged
02:33:26    ERROR -  1119 INFO TEST-UNEXPECTED-FAIL | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 3 in nav-bar should match expectations. - Got home-button, expected customizableui-special-spring1
02:33:26     INFO -  Stack trace:
02:33:26     INFO -  chrome://mochikit/content/browser-test.js:test_is:1290
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:placementArraysEqual:143
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:assertAreaPlacements:132
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/browser_allow_dragging_removable_false.js:null:17
02:33:26     INFO -  Not taking screenshot here: see the one that was previously logged
02:33:26    ERROR -  1120 INFO TEST-UNEXPECTED-FAIL | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 4 in nav-bar should match expectations. - Got customizableui-special-spring1, expected forward-button
02:33:26     INFO -  Stack trace:
02:33:26     INFO -  chrome://mochikit/content/browser-test.js:test_is:1290
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:placementArraysEqual:143
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/head.js:assertAreaPlacements:132
02:33:26     INFO -  chrome://mochitests/content/browser/browser/components/customizableui/test/browser_allow_dragging_removable_false.js:null:17
02:33:26     INFO -  1121 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 5 in nav-bar should match expectations. -
02:33:26     INFO -  1122 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 6 in nav-bar should match expectations. -
02:33:26     INFO -  1123 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 7 in nav-bar should match expectations. -
02:33:26     INFO -  1124 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 8 in nav-bar should match expectations. -
02:33:26     INFO -  1125 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Item 9 in nav-bar should match expectations. -
02:33:26     INFO -  1126 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Should no longer be in default state. -
02:33:26     INFO -  1127 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | forward-button was not able to move to palette -
02:33:26     INFO -  1128 INFO TEST-PASS | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | Should be in default state again. -
02:33:26     INFO -  1129 INFO Leaving test bound
02:33:26     INFO -  GECKO(2712) | MEMORY STAT | vsize 808MB | vsizeMaxContiguous 616MB | residentFast 290MB | heapAllocated 130MB
02:33:26     INFO -  1130 INFO TEST-OK | browser/components/customizableui/test/browser_allow_dragging_removable_false.js | took 277ms

Comment 2

[Eliza Balazs [:ebalazs_]]

Did some retriggers and we have 1 failure out of 20 jobs.
The push that started this is: https://treeherder.mozilla.org/#/jobs?repo=autoland&filter-searchStr=opt-mochitest-browser-chrome-e10s-7&tochange=16ac0e4e24839794dc2e63b5b9c68b64f71b7945&fromchange=632bb768b1dd4b96a196412e8f7b669ca09d6d91&selectedJob=177618665

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Thanks Eliza- TV failed and now we see 5%+ failure rate on this.  The identified root cause seems valid as the test was changed there (Bug 1438490)

:Gijs, I see that you authored bug 1438490, any chance you can take a look at this?  It seems to be osx/win:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1459913

Comment 4

[Intermittent Failures Robot]

22 failures in 127 pushes (0.173 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 12
* mozilla-inbound: 7
* mozilla-central: 2
* try: 1

Platform breakdown:
* windows7-32: 9
* windows10-64: 9
* osx-10-10: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459913&startday=2018-05-09&endday=2018-05-09&tree=trunk

Comment 5

[:Gijs (he/him)]

I have a patch but inbound is closed. :-\

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/184216421caa
fix removable_false test to always execute the correct drag (layout race), rs=test-only

Comment 7

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/184216421caa

Comment 8

[:Gijs (he/him)]

No new failures since this landed -> FIXED.

Comment 9

[Intermittent Failures Robot]

45 failures in 660 pushes (0.068 failures/push) were associated with this bug in the last 7 days. 

This is the #29 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 25
* mozilla-inbound: 9
* mozilla-central: 8
* try: 3

Platform breakdown:
* windows7-32: 16
* windows10-64: 15
* osx-10-10: 8
* linux64: 3
* windows7-32-nightly: 2
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459913&startday=2018-05-07&endday=2018-05-13&tree=trunk