1465508 - Intermittent browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | Test timed out -

Status: RESOLVED FIXED

(WebExtensions :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rgurzau [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=180887975&repo=autoland

https://queue.taskcluster.net/v1/task/R7zTeutwQPGDPW3HP60hcw/runs/0/artifacts/public/logs/live_backing.log

12:06:04     INFO -  1318 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is initially closed -
12:06:04     INFO -  1319 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not initially set for this extension -
12:06:04     INFO -  1320 INFO Console message: Warning: attempting to write 26513 bytes to preference extensions.webextensions.uuids. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes.
12:06:04     INFO -  1321 INFO Console message: [JavaScript Error: "The character encoding of the HTML document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the page must be declared in the document or in the transfer protocol." {file: "moz-extension://45cf2ff0-0d01-4f80-9d9c-0b4025ddee5d/restore.html" line: 0}]
12:06:04     INFO -  Buffered messages logged at 12:04:40
12:06:04     INFO -  1322 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The add-on is enabled at first -
12:06:04     INFO -  1323 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is open after opening New Tab -
12:06:04     INFO -  1324 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not set for this extension -
12:06:04     INFO -  1325 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is closed after click -
12:06:04     INFO -  1326 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not set after restoring the settings -
12:06:04     INFO -  1327 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The extension is now disabled -
12:06:04     INFO -  1328 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The user has been redirected to about:newtab -
12:06:04     INFO -  1329 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is not opened after keeping the changes -
12:06:04     INFO -  Buffered messages logged at 12:04:41
12:06:04     INFO -  1330 INFO Leaving test bound test_new_tab_restore_settings
12:06:04     INFO -  1331 INFO Entering test bound test_new_tab_restore_settings_multiple
12:06:04     INFO -  1332 INFO Extension loaded
12:06:04     INFO -  1333 INFO Extension loaded
12:06:04     INFO -  1334 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is initially closed -
12:06:04     INFO -  1335 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not initially set for this extension -
12:06:04     INFO -  1336 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not initially set for this extension -
12:06:04     INFO -  1337 INFO Console message: Warning: attempting to write 26447 bytes to preference extensions.webextensions.uuids. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes.
12:06:04     INFO -  1338 INFO Console message: Warning: attempting to write 26516 bytes to preference extensions.webextensions.uuids. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes.
12:06:04     INFO -  1339 INFO Console message: Warning: attempting to write 26585 bytes to preference extensions.webextensions.uuids. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes.
12:06:04     INFO -  1340 INFO Console message: [JavaScript Error: "The character encoding of the HTML document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the page must be declared in the document or in the transfer protocol." {file: "moz-extension://4fe21f4b-ad7f-4456-a627-1008e9dd999f/restore-two.html" line: 0}]
12:06:04     INFO -  1341 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The add-on is enabled at first -
12:06:04     INFO -  1342 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is open after opening New Tab -
12:06:04     INFO -  1343 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not set for this extension -
12:06:04     INFO -  Buffered messages logged at 12:04:42
12:06:04     INFO -  1344 INFO Console message: [JavaScript Error: "The character encoding of the HTML document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the page must be declared in the document or in the transfer protocol." {file: "moz-extension://3090352b-4a9e-428d-ba18-f5772e7c1c52/restore-one.html" line: 0}]
12:06:04     INFO -  1345 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not set after restoring the settings -
12:06:04     INFO -  1346 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The extension is now disabled -
12:06:04     INFO -  1347 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The extension is enabled before making a choice -
12:06:04     INFO -  1348 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not set before making a choice -
12:06:04     INFO -  1349 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is open after opening New Tab -
12:06:04     INFO -  1350 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The user is now on the next extension's New Tab page -
12:06:04     INFO -  Buffered messages finished
12:06:04    ERROR -  1351 INFO TEST-UNEXPECTED-FAIL | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | Test timed out -

Comment 1

[Intermittent Failures Robot]

6 failures in 655 pushes (0.009 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* try: 1
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* osx-10-10: 4
* windows7-32: 1
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-05-28&endday=2018-06-03&tree=trunk

Comment 2

[Intermittent Failures Robot]

8 failures in 669 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* mozilla-central: 2
* autoland: 2
* try: 1

Platform breakdown:
* windows7-32: 4
* windows10-64: 1
* osx-10-10: 1
* linux64: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-06-04&endday=2018-06-10&tree=trunk

Comment 3

[Intermittent Failures Robot]

6 failures in 408 pushes (0.015 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* mozilla-central: 2
* autoland: 1

Platform breakdown:
* windows7-32: 4
* osx-10-10: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-06-11&endday=2018-06-17&tree=trunk

Comment 4

[Intermittent Failures Robot]

15 failures in 521 pushes (0.029 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 6
* autoland: 6
* mozilla-beta: 2
* try: 1

Platform breakdown:
* windows7-32: 6
* windows10-64: 5
* windows7-32-devedition: 1
* osx-10-10: 1
* linux64: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-06-18&endday=2018-06-24&tree=trunk

Comment 5

[Intermittent Failures Robot]

17 failures in 718 pushes (0.024 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 6
* autoland: 6
* try: 3
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* windows10-64: 7
* osx-10-10: 6
* windows7-32: 3
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-06-25&endday=2018-07-01&tree=trunk

Comment 6

[Intermittent Failures Robot]

8 failures in 622 pushes (0.013 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 5
* try: 1
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* windows10-64: 3
* windows7-32: 2
* osx-10-10: 2
* windows7-32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-07-02&endday=2018-07-08&tree=trunk

Comment 7

[Intermittent Failures Robot]

10 failures in 623 pushes (0.016 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* autoland: 3
* try: 2
* mozilla-central: 2

Platform breakdown:
* windows7-32: 3
* windows10-64: 3
* windows10-64-devedition: 2
* osx-10-10: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-07-09&endday=2018-07-15&tree=trunk

Comment 8

[Intermittent Failures Robot]

18 failures in 653 pushes (0.028 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 9
* autoland: 5
* mozilla-central: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* osx-10-10: 7
* linux32: 4
* windows7-32: 2
* windows10-64: 2
* linux64: 2
* windows10-64-msvc: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-07-16&endday=2018-07-22&tree=trunk

Comment 9

[Intermittent Failures Robot]

21 failures in 760 pushes (0.028 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 12
* mozilla-central: 4
* mozilla-inbound: 3
* try: 2

Platform breakdown:
* windows7-32: 6
* osx-10-10: 5
* linux32: 5
* windows10-64: 3
* windows7-32-msvc: 1
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 10

[Tiberius Oros[:tiberius_oros]]

There have been 36 failures in the last 7 days, all on debug.

- windows7-32: 11
- windows10-64: 10
- osx-10-10: 7
- linux32: 6
- windows7-32-msvc: 1
- linux64: 1

Recent log file and snippet with the failure:
https://treeherder.mozilla.org/logviewer.html#?job_id=191512764&repo=mozilla-inbound&lineNumber=57987

03:07:47     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not set after restoring the settings - 
03:07:47     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The extension is now disabled - 
03:07:47     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The extension is enabled before making a choice - 
03:07:47     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The New Tab notification is not set before making a choice - 
03:07:47     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The notification panel is open after opening New Tab - 
03:07:47     INFO - TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | The user is now on the next extension's New Tab page - 
03:07:47     INFO - Buffered messages finished
03:07:47     INFO - TEST-UNEXPECTED-FAIL | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | Test timed out - 
03:07:47     INFO - Not taking screenshot here: see the one that was previously logged
03:07:47     INFO - TEST-UNEXPECTED-FAIL | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_url_overrides_newtab.js | Extension left running at test shutdown - 
03:07:47     INFO - Stack trace:
03:07:47     INFO - chrome://mochikit/content/tests/SimpleTest/ExtensionTestUtils.js:ExtensionTestUtils.loadExtension/<:109
03:07:47     INFO - chrome://mochikit/content/browser-test.js:nextTest:705
03:07:47     INFO - chrome://mochikit/content/browser-test.js:timeoutFn:1200
03:07:47     INFO - setTimeout handler*chrome://mochikit/content/browser-test.js:Tester_execTest:1162

Comment 11

[Intermittent Failures Robot]

15 failures in 505 pushes (0.03 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-beta: 1
* mozilla-central: 2
* autoland: 5
* mozilla-inbound: 7

Platform breakdown:
* windows7-32: 3
* linux64: 2
* windows10-64: 7
* linux32: 2
* osx-10-10: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-07&endday=2018-08-07&tree=all

Comment 12

[Intermittent Failures Robot]

17 failures in 549 pushes (0.031 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 7
* autoland: 9
* mozilla-central: 1

Platform breakdown:
* windows10-64: 4
* osx-10-10: 4
* windows7-32: 4
* linux64: 4
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-09&endday=2018-08-09&tree=all

Comment 13

[Cristina Coroiu [:ccoroiu]]

:ddurst did you have the chance to look at Comment 10?

Comment 14

[Intermittent Failures Robot]

71 failures in 2579 pushes (0.028 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 30
* mozilla-central: 10
* try: 4
* mozilla-beta: 1
* mozilla-inbound: 26

Platform breakdown:
* windows7-32: 19
* windows10-64: 22
* linux32: 12
* osx-10-10: 10
* linux64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-06&endday=2018-08-12&tree=all

Comment 15

[Intermittent Failures Robot]

17 failures in 594 pushes (0.029 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-inbound: 9
* autoland: 7
* mozilla-central: 1

Platform breakdown:
* windows10-64: 3
* osx-10-10: 4
* windows7-32: 6
* linux64: 3
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-14&endday=2018-08-14&tree=all

Comment 16

[Intermittent Failures Robot]

32 failures in 494 pushes (0.065 failures/push) were associated with this bug yesterday.

Repository breakdown:
* autoland: 9
* mozilla-central: 4
* try: 3
* mozilla-inbound: 16

Platform breakdown:
* windows7-32: 8
* osx-10-10: 4
* windows10-64: 3
* linux32: 9
* linux64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-15&endday=2018-08-15&tree=all

Comment 17

[Eliza Balazs [:ebalazs_]]

Attachment: Disable on linux and win debug

Comment 18

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/c94a29385a3a
Disable browser_ext_url_overrides_newtab.js on linux and win for frequent failures. r=jmaher

Comment 19

[Tiberius Oros[:tiberius_oros]]

https://hg.mozilla.org/mozilla-central/rev/c94a29385a3a

Comment 20

[Intermittent Failures Robot]

28 failures in 527 pushes (0.053 failures/push) were associated with this bug yesterday.

Repository breakdown:
* try: 3
* mozilla-central: 1
* autoland: 13
* mozilla-inbound: 11

Platform breakdown:
* windows7-32: 5
* linux32: 4
* windows10-64: 3
* osx-10-10: 7
* linux64-ccov: 1
* linux64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-16&endday=2018-08-16&tree=all

Comment 21

[Intermittent Failures Robot]

96 failures in 2672 pushes (0.036 failures/push) were associated with this bug in the last 7 days.

This is the #29 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. ** 

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 6
* mozilla-beta: 1
* mozilla-central: 10
* autoland: 38
* mozilla-inbound: 41

Platform breakdown:
* windows7-32: 22
* linux32: 16
* windows10-64-nightly: 1
* linux64-ccov: 1
* windows10-64: 9
* linux64: 23
* windows10-64-msvc: 1
* macosx64-nightly: 1
* osx-10-10: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 22

[Intermittent Failures Robot]

34 failures in 2568 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 5
* mozilla-beta: 1
* try: 5
* mozilla-inbound: 14
* autoland: 9

Platform breakdown:
* linux64: 9
* linux64-nightly: 1
* osx-10-10: 17
* linux32: 4
* linux64-devedition: 1
* windows10-64: 1
* linux32-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 23

[Rob Wu [:robwu]]

Attachment: Bug 1465508 - Fix intermittent browser_ext_url_overrides_newtab.js

Comment 24

[Shane Caraveo (:mixedpuppy)]

Comment on attachment 9005142 [details]
Bug 1465508 - Fix intermittent browser_ext_url_overrides_newtab.js

Shane Caraveo (:mixedpuppy) has approved the revision.

Comment 25

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4a462d6e9c46
Fix intermittent browser_ext_url_overrides_newtab.js r=mixedpuppy

Comment 26

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/4a462d6e9c46

Comment 27

[Intermittent Failures Robot]

24 failures in 2545 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 3
* mozilla-central: 2
* mozilla-inbound: 10
* autoland: 8
* mozilla-beta: 1

Platform breakdown:
* linux32-nightly: 1
* linux32: 1
* osx-10-10: 17
* linux64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1465508&startday=2018-08-27&endday=2018-09-02&tree=all

Comment 28

[Rob Wu [:robwu]]

The graph of intermittents flat-lined, so this has been fixed.

Comment 29

[Rob Wu [:robwu]]

Why is the bug not auto-closed and the stockwell whiteboard auto-updated?

Comment 30

[Ryan VanderMeulen [:RyanVM]]

I have no clue about how the Stockwell stuff gets set, but the bug resolution didn't happen because it was set to leave-open. Normally, bug resolution happens at the time of merging to m-c.

Comment 31

[Vlad Jiman]

Will this fix require manual validation? please provide some info on how to correctly validate it if so, otherwise set the 'qe-validate-' flag, thank you