1267534 - Intermittent browser_menu_item_02.js | Test timed out

Status: RESOLVED FIXED

(DevTools :: Responsive Design Mode, defect, P1)

Description

[Phil Ringnalda (:philor)]

Apparently we don't run devtools tests on Linux32 opt very often, at least that's my guess for how we got a 30-40% failure already merged around onto every tree before it was even filed.

https://treeherder.mozilla.org/logviewer.html#?job_id=8984525&repo=fx-team
https://treeherder.mozilla.org/logviewer.html#?job_id=8987251&repo=fx-team
https://treeherder.mozilla.org/logviewer.html#?job_id=8987257&repo=fx-team
https://treeherder.mozilla.org/logviewer.html#?job_id=26602271&repo=mozilla-inbound
https://treeherder.mozilla.org/logviewer.html#?job_id=26612018&repo=mozilla-inbound
https://treeherder.mozilla.org/logviewer.html#?job_id=26612023&repo=mozilla-inbound
https://treeherder.mozilla.org/logviewer.html#?job_id=26612024&repo=mozilla-inbound

Comment 1

[J. Ryan Stinnett [:jryans] (Use needinfo, replies may be slow)]

We may need to disable on Linux opt as well...  I fear the test is just racy in general, and only some platforms happen to show it.  :zer0, could you take a look?

Comment 2

[Intermittent Failures Robot]

27 automation job failures were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 16
* fx-team: 8
* try: 2
* mozilla-central: 1

Platform breakdown:
* linux32: 25
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267534&startday=2016-04-26&endday=2016-04-26&tree=all

Comment 3

[Intermittent Failures Robot]

17 automation job failures were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 13
* try: 2
* mozilla-central: 1
* fx-team: 1

Platform breakdown:
* linux32: 11
* linux64: 5
* windows8-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267534&startday=2016-04-27&endday=2016-04-27&tree=all

Comment 4

[Matteo Ferretti [:zer0] [:matteo]]

I'm working on bug 1267278, it's likely that fixing that would fixes also this bug.

Comment 5

[Intermittent Failures Robot]

15 automation job failures were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 10
* fx-team: 4
* mozilla-central: 1

Platform breakdown:
* linux32: 13
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267534&startday=2016-04-28&endday=2016-04-28&tree=all

Comment 6

[Intermittent Failures Robot]

72 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 46
* fx-team: 15
* try: 7
* mozilla-central: 4

Platform breakdown:
* linux32: 61
* linux64: 10
* windows8-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267534&startday=2016-04-25&endday=2016-05-01&tree=all

Comment 7

[J. Ryan Stinnett [:jryans] (Use needinfo, replies may be slow)]

I did notice while working on bug 1240913 that this test doesn't actually open a tab with the data URL like you would think from reading it.  It does open a new browser window with just an about:blank tab I believe.

With my page state work, I had to change this to actually use the data URL.  Not sure if this has any impact on the failures here.

Comment 8

[Intermittent Failures Robot]

75 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 32
* fx-team: 29
* try: 8
* mozilla-central: 6

Platform breakdown:
* linux32: 42
* linux64: 31
* windows8-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267534&startday=2016-05-10&endday=2016-05-16&tree=all

Comment 9

[Brian Grinstead [:bgrins]]

This is the #2 most frequent devtools intermittent right now

Comment 10

[Matteo Ferretti [:zer0] [:matteo]]

I'm currently working on this on bug 1267278.

Comment 11

[Alexandre Poirot [:ochameau]]

Try run to debug that intermittent:
  https://treeherder.mozilla.org/#/jobs?repo=try&revision=672e2783226f

Comment 12

[Alexandre Poirot [:ochameau]]

It seems to fail very early during the test as there is no info/assertion, during one of these calls:

  const window1 = yield openBrowserWindow()
  yield startup(window1);
  yield BrowserTestUtils.openNewForegroundTab(window1.gBrowser, TEST_URL);

Comment 13

[Alexandre Poirot [:ochameau]]

At least during this run:
  https://treeherder.mozilla.org/logviewer.html#?job_id=21133913&repo=try#L4084

Comment 14

[Intermittent Failures Robot]

42 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 20
* fx-team: 16
* mozilla-central: 5
* try: 1

Platform breakdown:
* linux32: 22
* linux64: 20

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267534&startday=2016-05-16&endday=2016-05-22&tree=all

Comment 15

[Alexandre Poirot [:ochameau]]

Note able to reproduce it on try with additional debug.
Seems to be gone since last friday?

https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267534&startday=2016-05-01&endday=2016-05-24&tree=trunk&includefiltertype=quicksearch&includefilterdetailsexcludeResolved=true&includefilterdetailsexcludeDisabled=false&includefilterdetailsquicksearch=1078284%2C1091669%2C1131012%2C1132375%2C1185045%2C1210685%2C1217690%2C1220974%2C1221911%2C1222194%2C1222289%2C1231006%2C1239205%2C1240580%2C1242221%2C1245498%2C1252641%2C1253037%2C1253511%2C1271820%2C1232949%2C1242318%2C1199472%2C1235144%2C1239132%2C1241019%2C1242826%2C1243502%2C1266329%2C1268227%2C1268265%2C1246457%2C1220534%2C1227792%2C1236174%2C1237492%2C1237882%2C1238824%2C1242114%2C1244707%2C1246043%2C1251516%2C1253035%2C1254746%2C1263303%2C1265565%2C1267534%2C1269977%2C1270711%2C1250523%2C1210671%2C1214439%2C1115779%2C1099389%2C1199632%2C1232931

Comment 16

[J. Ryan Stinnett [:jryans] (Use needinfo, replies may be slow)]

It looks like this went away by May 20th.  Bug 1240913 landed around that time, and seems like it could have improved this.  We also just landed bug 1267278 which should improve things as well.