1378525 - Intermittent browser_startup_images.js | Loaded image chrome://browser/skin/tabbrowser/newtab.svg should have been shown. -

Status: RESOLVED INCOMPLETE

(Firefox :: General, defect)

Description

[Treeherder Bug Filer]

Filed by: wkocher [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=111966246&repo=autoland

https://queue.taskcluster.net/v1/task/cA47Q6orS2CyP_eu23N3Ew/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

4 failures in 656 pushes (0.006 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 3
* mozilla-inbound: 1

Platform breakdown:
* linux64: 3
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 2

[Intermittent Failures Robot]

3 failures in 720 pushes (0.004 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* cedar: 2
* mozilla-inbound: 1

Platform breakdown:
* windows7-32-vm: 1
* osx-cross: 1
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-07-10&endday=2017-07-16&tree=all

Comment 3

[Intermittent Failures Robot]

7 failures in 822 pushes (0.009 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 6
* autoland: 1

Platform breakdown:
* windows10-64: 6
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 4

[Intermittent Failures Robot]

13 failures in 1008 pushes (0.013 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 12
* try: 1

Platform breakdown:
* windows7-32: 9
* windows8-64: 2
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-07-24&endday=2017-07-30&tree=all

Comment 5

[Intermittent Failures Robot]

7 failures in 888 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 7

Platform breakdown:
* windows8-64: 5
* linux64: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-07-31&endday=2017-08-06&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 901 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-08-07&endday=2017-08-13&tree=all

Comment 7

[Intermittent Failures Robot]

10 failures in 949 pushes (0.011 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 6
* try: 2
* mozilla-central: 2

Platform breakdown:
* windows7-32-stylo: 5
* windows7-32: 3
* windows10-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 8

[Intermittent Failures Robot]

2 failures in 908 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 2

Platform breakdown:
* windows10-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-08-21&endday=2017-08-27&tree=all

Comment 9

[Intermittent Failures Robot]

1 failures in 939 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-08-28&endday=2017-09-03&tree=all

Comment 10

[Intermittent Failures Robot]

2 failures in 943 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 912 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 12

[Intermittent Failures Robot]

12 failures in 792 pushes (0.015 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 12

Platform breakdown:
* osx-10-10: 12

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2017-11-27&endday=2017-12-03&tree=all

Comment 13

[Intermittent Failures Robot]

29 failures in 149 pushes (0.195 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 19
* autoland: 6
* mozilla-central: 4

Platform breakdown:
* osx-10-10: 29

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2018-01-11&endday=2018-01-11&tree=all

Comment 14

[Stefan Hindli [:stefan_hindli]]

Over the last 7 days this bug has failed 44 times. ALL of the fails happen on OS X 10.10.

Here is the most recent log: https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=155805883&lineNumber=2514

Here is a relevant snippet from the aforementioned log:

18:47:24     INFO - Buffered messages finished
18:47:24     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_images.js | Loaded image chrome://browser/skin/places/folder.svg should have been shown. - 
18:47:24     INFO - Stack trace:
18:47:24     INFO - chrome://mochitests/content/browser/browser/base/content/test/performance/browser_startup_images.js:null:112
18:47:24     INFO - Not taking screenshot here: see the one that was previously logged
18:47:24     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_images.js | Loaded image chrome://browser/skin/places/[e-mail] should have been shown. - 
18:47:24     INFO - Stack trace:
18:47:24     INFO - chrome://mochitests/content/browser/browser/base/content/test/performance/browser_startup_images.js:null:112
18:47:24     INFO - GECKO(1879) | ++DOMWINDOW == 7 (0x1238f3c00) [pid = 1880] [serial = 7] [outer = 0x117f763f0]
18:47:24     INFO - Not taking screenshot here: see the one that was previously logged
18:47:24     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_images.js | Loaded image chrome://browser/skin/places/unfiledBookmarks.png should have been shown. -

Comment 15

[Panos Astithas (he/him) [:past] (please ni?)]

Maybe caused by bug 1410072? Florian, Johann, any ideas?

Comment 16

[Intermittent Failures Robot]

47 failures in 148 pushes (0.318 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 33
* autoland: 11
* try: 2
* mozilla-beta: 1

Platform breakdown:
* osx-10-10: 47

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2018-01-12&endday=2018-01-12&tree=all

Comment 17

[Intermittent Failures Robot]

77 failures in 788 pushes (0.098 failures/push) were associated with this bug in the last 7 days. 

This is the #14 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* mozilla-inbound: 50
* autoland: 19
* mozilla-central: 5
* try: 2
* mozilla-beta: 1

Platform breakdown:
* osx-10-10: 77

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2018-01-08&endday=2018-01-14&tree=all

Comment 18

[Johann Hofmann [:johannh]]

Uhm, this is not the same failure as the one in the title.

Intermittent browser_startup_images.js | Loaded image chrome://browser/skin/tabbrowser/newtab.svg should have been shown.

should be treated as separate from

01:39:59     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_images.js | Loaded image chrome://browser/skin/places/folder.svg should have been shown. - 
01:39:59     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_images.js | Loaded image chrome://browser/skin/places/bookmarksToolbar.png should have been shown. - 
01:39:59     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/performance/browser_startup_images.js | Loaded image chrome://browser/skin/places/unfiledBookmarks.png should have been shown. -

which is the only failure I can see in the latest runs. Can we somehow ensure that we file separate bugs for separate failures for this bug?

So, something changed that makes us intermittently load places toolbar resources without showing them, or something changed around timing that makes us record these load events only now.

All these images were in the list once but I removed them as part of the code that made us record raster images properly:

https://hg.mozilla.org/mozilla-central/rev/c3c007933d81

This could have something to do with the "Bookmarks" menu entry in the top OSX menu, since these are the images that are shown there.

I'm not sure what's going on. I can try to reproduce on my machine, but if anyone has a better idea feel free to investigate.

In case we don't find a good reason for this I suggest we just put the whitelist entries back in...

Comment 19

[Johann Hofmann [:johannh]]

Another thought: maybe the observer mechanism that notifies us of drawing raster images has an intermittent issue?

Comment 20

[Johann Hofmann [:johannh]]

I think it died.

Comment 21

[Intermittent Failures Robot]

4 failures in 701 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 4

Platform breakdown:
* linux64-stylo-disabled: 1
* linux64: 1
* linux32-stylo-disabled: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1378525&startday=2018-01-22&endday=2018-01-28&tree=all

Comment 22

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Closing this one as INCOMPLETE and removing the keyword 'checkin-needed' so it doesn't get suggested in Treeherder anymore.

Comment 23

[Florian Quèze [:florian]]

New failures of browser_startup_images.js should be filed in separate bugs for separate failure messages. This bug as is (with different files being reported in the failures from comment 1, comment 18 and comment 21) was not actionable.