1455602 - Intermittent browser/components/sessionstore/test/browser_restore_reversed_z_order.js | Third restored tab is correct - "About About" == "New Tab" - JS frame :: chrome://mochitests/content/browser/browser/components/sessionstore/test/browser_restore

Status: RESOLVED INCOMPLETE

(Firefox :: Session Restore, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=174739782&repo=autoland

https://queue.taskcluster.net/v1/task/SnpywL7lQgyJdQaa8vjbgA/runs/0/artifacts/public/logs/live_backing.log

04:25:38     INFO - TEST-PASS | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | First restored tab should be last used tab - "Gort! Klaatu barada nikto!" == "Gort! Klaatu barada nikto!" - 
04:25:38     INFO - TEST-PASS | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | Second restored tab is correct - "Licenses" == "Licenses" - 
04:25:38     INFO - Buffered messages finished
04:25:38     INFO - TEST-UNEXPECTED-FAIL | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | Third restored tab is correct - "About About" == "New Tab" - JS frame :: chrome://mochitests/content/browser/browser/components/sessionstore/test/browser_restore_reversed_z_order.js :: test_windows_are_restored_in_reversed_z_order :: line 73
04:25:38     INFO - Stack trace:
04:25:38     INFO - chrome://mochitests/content/browser/browser/components/sessionstore/test/browser_restore_reversed_z_order.js:test_windows_are_restored_in_reversed_z_order:73
04:25:38     INFO - TEST-PASS | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | Last restored tab should be a minimized window - "The Book of Mozilla, 11:14" == "The Book of Mozilla, 11:14" - 
04:25:38     INFO - Leaving test bound test_windows_are_restored_in_reversed_z_order
04:25:38     INFO - GECKO(871) | MEMORY STAT | vsize 4859MB | residentFast 961MB | heapAllocated 345MB
04:25:38     INFO - TEST-OK | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | took 11945ms

Seems that this push has changed the file mentioned above https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=74478b16e546d7c5c9c77552efb5f16a49811502&group_state=expanded&filter-searchStr=bc5

Comment 1

[Intermittent Failures Robot]

9 failures in 782 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 7
* try: 1
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 8
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-04-16&endday=2018-04-22&tree=trunk

Comment 2

[Mike de Boer [:mikedeboer]]

Looking at the test I can't tell straight away what the issue may be that the tab/ page in question ('about:about') doesn't load and stays at about:newtab for the entirety of the restore process.
It would be great if I could reproduce this locally, but so far I've been unlucky in that regard.

Comment 3

[Intermittent Failures Robot]

10 failures in 780 pushes (0.013 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 4
* autoland: 3
* try: 2
* mozilla-central: 1

Platform breakdown:
* osx-10-10: 8
* windows10-64: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-04-23&endday=2018-04-29&tree=trunk

Comment 4

[Intermittent Failures Robot]

8 failures in 551 pushes (0.015 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 3
* try: 2
* mozilla-inbound: 1
* mozilla-beta: 1
* autoland: 1

Platform breakdown:
* windows10-64: 3
* osx-10-10: 3
* linux64-nightly: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-04-30&endday=2018-05-06&tree=trunk

Comment 5

[Intermittent Failures Robot]

9 failures in 660 pushes (0.014 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* try: 2
* mozilla-beta: 2
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* osx-10-10: 5
* windows10-64: 2
* linux64-devedition: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-05-07&endday=2018-05-13&tree=trunk

Comment 6

[Intermittent Failures Robot]

7 failures in 639 pushes (0.011 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* mozilla-beta: 2
* autoland: 2

Platform breakdown:
* osx-10-10: 6
* macosx64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-05-14&endday=2018-05-20&tree=trunk

Comment 7

[Intermittent Failures Robot]

9 failures in 632 pushes (0.014 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* try: 2
* mozilla-beta: 2
* autoland: 2

Platform breakdown:
* osx-10-10: 6
* windows7-32: 1
* windows10-64: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-05-21&endday=2018-05-27&tree=trunk

Comment 8

[Intermittent Failures Robot]

17 failures in 655 pushes (0.026 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 10
* autoland: 4
* mozilla-beta: 2
* try: 1

Platform breakdown:
* osx-10-10: 11
* windows10-64: 3
* windows7-32: 1
* linux64: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-05-28&endday=2018-06-03&tree=trunk

Comment 9

[Intermittent Failures Robot]

20 failures in 669 pushes (0.03 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 11
* mozilla-inbound: 3
* try: 2
* mozilla-central: 2
* mozilla-beta: 2

Platform breakdown:
* osx-10-10: 9
* linux64: 4
* windows10-64: 3
* linux32: 2
* macosx64-nightly: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-06-04&endday=2018-06-10&tree=trunk

Comment 10

[Intermittent Failures Robot]

15 failures in 408 pushes (0.037 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 5
* try: 4
* mozilla-beta: 3
* autoland: 2
* mozilla-central: 1

Platform breakdown:
* osx-10-10: 10
* linux32: 2
* macosx64-nightly: 1
* linux64: 1
* linux32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-06-11&endday=2018-06-17&tree=trunk

Comment 11

[Intermittent Failures Robot]

14 failures in 521 pushes (0.027 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 5
* try: 3
* mozilla-central: 2
* mozilla-beta: 2
* autoland: 2

Platform breakdown:
* osx-10-10: 6
* linux32: 3
* linux64-devedition: 2
* linux64: 2
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-06-18&endday=2018-06-24&tree=trunk

Comment 12

[Intermittent Failures Robot]

21 failures in 718 pushes (0.029 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 9
* autoland: 7
* try: 3
* mozilla-central: 2

Platform breakdown:
* osx-10-10: 16
* linux64: 3
* linux32-nightly: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-06-25&endday=2018-07-01&tree=trunk

Comment 13

[Intermittent Failures Robot]

11 failures in 622 pushes (0.018 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 6
* mozilla-central: 3
* mozilla-inbound: 1
* mozilla-beta: 1

Platform breakdown:
* osx-10-10: 5
* linux64: 3
* windows7-32: 1
* linux32-devedition: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-07-02&endday=2018-07-08&tree=trunk

Comment 14

[Intermittent Failures Robot]

13 failures in 623 pushes (0.021 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 5
* mozilla-beta: 4
* mozilla-inbound: 3
* try: 1

Platform breakdown:
* macosx64-nightly: 4
* linux32: 4
* osx-10-10: 3
* linux64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-07-09&endday=2018-07-15&tree=trunk

Comment 15

[Intermittent Failures Robot]

14 failures in 653 pushes (0.021 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 5
* try: 4
* mozilla-central: 3
* mozilla-beta: 2

Platform breakdown:
* osx-10-10: 8
* linux32: 3
* windows10-64-ccov: 1
* macosx64-nightly: 1
* macosx64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-07-16&endday=2018-07-22&tree=trunk

Comment 16

[Intermittent Failures Robot]

33 failures in 760 pushes (0.043 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 12
* autoland: 12
* mozilla-central: 5
* mozilla-beta: 3
* try: 1

Platform breakdown:
* osx-10-10: 24
* linux64: 3
* macosx64-nightly: 2
* windows7-32: 1
* macosx64-devedition: 1
* linux64-ccov: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 17

[Intermittent Failures Robot]

15 failures in 549 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 5
* mozilla-beta: 2
* mozilla-central: 3
* autoland: 5

Platform breakdown:
* macosx64-nightly: 1
* linux64: 1
* osx-10-10: 10
* linux64-devedition: 1
* linux32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-08-09&endday=2018-08-09&tree=all

Comment 18

[Intermittent Failures Robot]

45 failures in 2579 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #39 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 12
* mozilla-central: 13
* try: 2
* mozilla-inbound: 14
* mozilla-beta: 4

Platform breakdown:
* linux64-devedition: 1
* windows10-64: 1
* macosx64-nightly: 2
* linux32: 5
* osx-10-10: 23
* linux64-ccov: 1
* linux32-devedition: 1
* linux32-nightly: 1
* linux64: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-08-06&endday=2018-08-12&tree=all

Comment 19

[Intermittent Failures Robot]

18 failures in 527 pushes (0.034 failures/push) were associated with this bug yesterday.

Repository breakdown:
* try: 2
* autoland: 6
* mozilla-inbound: 10

Platform breakdown:
* windows7-32: 1
* linux32: 1
* windows10-64: 1
* osx-10-10: 6
* linux32-devedition: 1
* linux64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-08-16&endday=2018-08-16&tree=all

Comment 20

[Tiberius Oros[:tiberius_oros]]

There have been 67 failures in the last 7 days.

Failures per platform and build type:
- osx-10-10 / debug & opt: 27
- linux64 / opt, pgo, debug, asan: 21
- windows10-64 / debug & asan: 8
- linux32 / opt & debug: 7
- windows7-32 / pgo & opt: 2
- linux64-ccov / debug: 1
- macosx64-nightly / opt: 1

Recent relevant log file and snippet with the failure:
https://treeherder.mozilla.org/logviewer.html#?job_id=194666559&repo=mozilla-inbound&lineNumber=3482

00:08:34     INFO - TEST-PASS | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | First restored tab should be last used tab - "Gort! Klaatu barada nikto!" == "Gort! Klaatu barada nikto!" - 
00:08:34     INFO - TEST-PASS | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | Second restored tab is correct - "Licenses" == "Licenses" - 
00:08:34     INFO - Buffered messages finished
00:08:34     INFO - TEST-UNEXPECTED-FAIL | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | Third restored tab is correct - "About About" == "New Tab" - JS frame :: chrome://mochitests/content/browser/browser/components/sessionstore/test/browser_restore_reversed_z_order.js :: test_windows_are_restored_in_reversed_z_order :: line 73
00:08:34     INFO - Stack trace:
00:08:34     INFO - chrome://mochitests/content/browser/browser/components/sessionstore/test/browser_restore_reversed_z_order.js:test_windows_are_restored_in_reversed_z_order:73
00:08:34     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
00:08:34     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
00:08:34     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:999
00:08:34     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
00:08:34     INFO - TEST-PASS | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | Last restored tab should be a minimized window - "The Book of Mozilla, 11:14" == "The Book of Mozilla, 11:14" - 
00:08:34     INFO - Leaving test bound test_windows_are_restored_in_reversed_z_order
00:08:34     INFO - GECKO(2144) | MEMORY STAT | vsize 4769MB | residentFast 702MB | heapAllocated 310MB
00:08:34     INFO - TEST-OK | browser/components/sessionstore/test/browser_restore_reversed_z_order.js | took 5082ms

Comment 21

[Intermittent Failures Robot]

77 failures in 2672 pushes (0.029 failures/push) were associated with this bug in the last 7 days.

This is the #36 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. ** 

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 6
* try: 5
* mozilla-beta: 4
* autoland: 25
* mozilla-inbound: 37

Platform breakdown:
* linux32-devedition: 2
* windows7-32: 2
* linux32: 8
* macosx64-nightly: 3
* windows10-64: 10
* linux64: 21
* linux32-nightly: 1
* osx-10-10: 30

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 22

[Intermittent Failures Robot]

20 failures in 492 pushes (0.041 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* autoland: 9
* mozilla-central: 1
* try: 2
* mozilla-inbound: 8

Platform breakdown:
* windows10-64: 1
* linux32: 2
* windows7-32: 2
* linux64: 4
* macosx64-nightly: 1
* osx-10-10: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-08-21&endday=2018-08-21&tree=all

Comment 23

[Cosmin Sabou [:CosminS]]

Attachment: Disable on multiple platforms

Comment 24

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 9003108 [details] [diff] [review]
Disable on multiple platforms

Review of attachment 9003108 [details] [diff] [review]:
-----------------------------------------------------------------

::: browser/components/sessionstore/test/browser.ini
@@ +286,4 @@
>  [browser_speculative_connect.js]
>  [browser_1446343-windowsize.js]
>  [browser_restore_reversed_z_order.js]
> +skip-if = (os == 'linux') || (os == 'mac') || (os == 'win' && os_version == '10.0' && debug) #Bug 1455602

I would just put:
skip-if = true # Bug 1455602

we have some win7 failures as well, so why not disable it 100%

Comment 25

[Cosmin Sabou [:CosminS]]

Attachment: disablebug1455602.patch

Made the changes.

Comment 26

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/b80407ff63a9
Disable browser/components/sessionstore/test/browser_restore_reversed_z_order.js for frequent failures. r=jmaher

Comment 27

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/b80407ff63a9

Comment 28

[Intermittent Failures Robot]

49 failures in 2568 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #42 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 6
* mozilla-beta: 4
* try: 4
* mozilla-inbound: 17
* autoland: 18

Platform breakdown:
* linux64: 10
* windows10-64-msvc: 1
* windows7-32: 4
* linux64-nightly: 1
* osx-10-10: 19
* linux32: 4
* macosx64-nightly: 3
* windows10-64: 6
* windows7-32-msvc: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 29

[Intermittent Failures Robot]

1 failures in 2902 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-09-17&endday=2018-09-23&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 2740 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-release: 1

Platform breakdown:
* macosx64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1455602&startday=2018-10-08&endday=2018-10-14&tree=all

Comment 31

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.