1517538 - Intermittent Wd | <random> - setup error (Bad canary value 0x534dc0f5 in FromData)

Status: RESOLVED WORKSFORME

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=219517171&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/eIb_A6NhQIeCzw5wp678Ww/runs/0/artifacts/public/logs/live_backing.log

21:13:27     INFO - STDOUT: >           _current_session.start()
21:13:27     INFO - STDOUT: capabilities = {}
21:13:27     INFO - STDOUT: caps       = {'alwaysMatch': {'moz:firefoxOptions': {'binary': 'Z:\task_1546376327\build\application\firefox\firefox.exe', 'prefs':...w1.not-web-platform.test,www.not-web-platform.test,www.web-platform.test,xn--n8j6ds53lwwkrqhv28a.web-platform.test'}}}}
21:13:27     INFO - STDOUT: configuration = {'capabilities': {'moz:firefoxOptions': {'binary': 'Z:\task_1546376327\build\application\firefox\firefox.exe', 'prefs'...b-platform.test,www.web-platform.test,xn--n8j6ds53lwwkrqhv28a.web-platform.test'}}}, 'host': '127.0.0.1', 'port': 4444}
21:13:27     INFO - STDOUT: request    = <SubRequest 'session' for <Function 'test_null_response_value'>>
21:13:27     INFO - STDOUT: tests\web-platform\tests\webdriver\tests\support\fixtures.py
21:13:27     INFO - STDOUT: :150: 
21:13:27     INFO - STDOUT: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
21:13:27     INFO - STDOUT: tests\web-platform\tests\tools\webdriver\webdriver\client.py
21:13:27     INFO - STDOUT: :421: in start
21:13:27     INFO - STDOUT:     value = self.send_command("POST", "session", body=body)
21:13:27     INFO - STDOUT: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
21:13:27     INFO - STDOUT: self = <Session (disconnected)>, method = 'POST', url = 'session'
21:13:27     INFO - STDOUT: body = {'capabilities': {'alwaysMatch': {'moz:firefoxOptions': {'binary': 'Z:\task_1546376327\build\application\firefox\firef...1.not-web-platform.test,www.not-web-platform.test,www.web-platform.test,xn--n8j6ds53lwwkrqhv28a.web-platform.test'}}}}}
21:13:27     INFO - STDOUT:     def send_command(self, method, url, body=None):
21:13:27     INFO - STDOUT:         """
21:13:27     INFO - STDOUT:             Send a command to the remote end and validate its success.
21:13:27     INFO - STDOUT:     
21:13:27     INFO - STDOUT:             :param method: HTTP method to use in request.
21:13:27     INFO - STDOUT:             :param uri: "Command part" of the HTTP request URL,
21:13:27     INFO - STDOUT:                 e.g. `window/rect`.
21:13:27     INFO - STDOUT:             :param body: Optional body of the HTTP request.
21:13:27     INFO - STDOUT:     
21:13:27     INFO - STDOUT:             :return: `None` if the HTTP response body was empty, otherwise
21:13:27     INFO - STDOUT:                 the `value` field returned after parsing the response
21:13:27     INFO - STDOUT:                 body as JSON.
21:13:27     INFO - STDOUT:     
21:13:27     INFO - STDOUT:             :raises error.WebDriverException: If the remote end returns
21:13:27     INFO - STDOUT:                 an error.
21:13:27     INFO - STDOUT:             :raises ValueError: If the response body does not contain a
21:13:27     INFO - STDOUT:                 `value` key.
21:13:27     INFO - STDOUT:             """
21:13:27     INFO - STDOUT:         response = self.transport.send(
21:13:27     INFO - STDOUT:             method, url, body,
21:13:27     INFO - STDOUT:             encoder=protocol.Encoder, decoder=protocol.Decoder,
21:13:27     INFO - STDOUT:             session=self)
21:13:27     INFO - STDOUT:     
21:13:27     INFO - STDOUT:         if response.status != 200:
21:13:27     INFO - STDOUT:             err = error.from_response(response)
21:13:27     INFO - STDOUT:     
21:13:27     INFO - STDOUT:             if isinstance(err, error.InvalidSessionIdException):
21:13:27     INFO - STDOUT:                 # The driver could have already been deleted the session.
21:13:27     INFO - STDOUT:                 self.session_id = None
21:13:27     INFO - STDOUT:     
21:13:27     INFO - STDOUT: >           raise err
21:13:27     INFO - STDOUT: E           UnknownErrorException: unknown error (500): permission denied
21:13:27     INFO - STDOUT: body       = {'capabilities': {'alwaysMatch': {'moz:firefoxOptions': {'binary': 'Z:\task_1546376327\build\application\firefox\firef...1.not-web-platform.test,www.not-web-platform.test,www.web-platform.test,xn--n8j6ds53lwwkrqhv28a.web-platform.test'}}}}}
21:13:27     INFO - STDOUT: err        = <UnknownErrorException http_status=500>
21:13:27     INFO - STDOUT: method     = 'POST'
21:13:27     INFO - STDOUT: response   = <Response status=500 error=<UnknownErrorException http_status=500>>
21:13:27     INFO - STDOUT: self       = <Session (disconnected)>
21:13:27     INFO - STDOUT: url        = 'session'
21:13:27     INFO - STDOUT: tests\web-platform\tests\tools\webdriver\webdriver\client.py
21:13:27     INFO - STDOUT: :472: UnknownErrorException
21:13:27     INFO - STDOUT: ============================== warnings summary ===============================
21:13:27     INFO - STDOUT: <undetermined location>
21:13:27     INFO - STDOUT:   Module already imported so cannot be rewritten: mozlog
21:13:27     INFO - STDOUT: -- Docs: http://doc.pytest.org/en/latest/warnings.html
21:13:27     INFO - STDOUT: ================ 1 passed, 1 warnings, 1 error in 6.01 seconds ================
21:13:27     INFO - 
21:13:27     INFO - TEST-UNEXPECTED-ERROR | /webdriver/tests/delete_all_cookies/delete.py | test_null_response_value - setup error

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The problematic part here is:

> 21:13:21     INFO - PID 5624 | 1546377201588	mozrunner::runner	INFO	Running command: "Z:\\task_1546376327\\build\\application\\firefox\\firefox.exe" "-marionette" "-foreground" "-no-remote" "-profile" "C:\\Users\\task_1546376327\\AppData\\Local\\Temp\\rust_mozprofile.m1pt53PQtiEC"
> 21:13:21     INFO - PID 5624 | 1546377201593	geckodriver::marionette	DEBUG	Waiting 60s to connect to browser on 127.0.0.1:2828
> 21:13:21     INFO - PID 5624 | [2136, Main Thread] WARNING: Failed to load startupcache file correctly, removing!: file z:/build/build/src/startupcache/StartupCache.cpp, line 204
> 21:13:21     INFO - PID 5624 | Hit MOZ_CRASH(Bad canary value 0x534dc0f5 in FromData) at z:/build/build/src/xpcom/string/nsSubstring.cpp:330
> 21:13:22     INFO - PID 5624 | 1546377202695	mozrunner::runner	DEBUG	Killing process 6084
> 21:13:22     INFO - PID 5624 | 1546377202695	webdriver::server	DEBUG	<- 500 Internal Server Error {"value":{"error":"unknown error","message":"permission denied","stacktrace":""}}

There is a startup crash happening: "Bad canary value 0x534dc0f5 in FromData".

Sadly we don't have any further crash information here, so not sure if this bug is actionable yet. But maybe it is related to the startupcache failure a line before. Paul, do you have any idea?

Comment 2

[Paul Bone [:pbone]]

I don't have any good idea.  How reproducible is it?  Does it happen when running with rr?

We added this change because we thought something in the JS GC might have been corrupting DOM data, or corrupting the JS heap so that it pointed to bad DOM data.  We never found such corruption, but it has caught several unrelated bugs.  However none of them have been in code that I'm familiar with but because I added the canary people ask me (which is fine, just how it is).  So I'm afraid I probably don't know for this one either.

I suggest finding a regression range so that you can ask someone who might know.  Or work on reproducibility & capturing an execution with rr.  However I'll NI mccr8 in case he knows.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Orange Factor shows only a single instance of the crash for a windows7-32 debug build. It means at this point it is very unlikely a regression check would be helpful. Maybe we should just wait and see if more of those crashes happen.

Comment 4

[Intermittent Failures Robot]

1 failures in 1668 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2018-12-31&endday=2019-01-06&tree=all

Comment 5

[Andrew McCreight [:mccr8]]

Like whimboo said, a crash that only happened once is going to be hard to debug.

Comment 6

[Paul Bone [:pbone]]

At the risk of stepping on anyone's toes I'll close this and it can be re-opened if there are more crashes / crashes increase.

It could be any other bug that had a different signature this one time :-(.

Comment 9

[Henrik Skupin [:whimboo][⌚️UTC+1]]

As other crashes show this is a Windows7 32 bit related crash.

Comment 11

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 13

[Henrik Skupin [:whimboo][⌚️UTC+1]]

New failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=250534671&repo=mozilla-inbound&lineNumber=101520

Comment 14

[Intermittent Failures Robot]

1 failures in 5197 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 4608 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-07-22&endday=2019-07-28&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 4408 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-09-02&endday=2019-09-08&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 4637 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 3964 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-10-14&endday=2019-10-20&tree=all

Comment 25

[Intermittent Failures Robot]

2 failures in 4314 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform breakdown:

• windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 26

[Intermittent Failures Robot]

1 failures in 4850 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-11-04&endday=2019-11-10&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures in 4207 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2019-11-11&endday=2019-11-17&tree=all

Comment 28

[Intermittent Failures Robot]

1 failures in 3773 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-01-13&endday=2020-01-19&tree=all

Comment 29

[Intermittent Failures Robot]

1 failures in 5483 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-03-02&endday=2020-03-08&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 5336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 31

[Intermittent Failures Robot]

2 failures in 5488 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• windows10-64: 1
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 4035 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 33

[Intermittent Failures Robot]

2 failures in 4014 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 4100 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-08-17&endday=2020-08-23&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 4130 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 36

[Intermittent Failures Robot]

2 failures in 4230 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1517538&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 4040 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 3810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 39

[Intermittent Failures Robot]

1 failures in 4322 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 40

[Intermittent Failures Robot]

1 failures in 3737 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 3125 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-03-29&endday=2021-04-04&tree=all

Comment 42

[Intermittent Failures Robot]

1 failures in 4255 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-04-12&endday=2021-04-18&tree=all

Comment 43

[Intermittent Failures Robot]

1 failures in 2888 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 44

[Intermittent Failures Robot]

2 failures in 2387 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• macosx1015-64-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 45

[Intermittent Failures Robot]

1 failures in 3131 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2021-07-26&endday=2021-08-01&tree=all

Comment 46

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Not a single failure within the last 6 months. I'm going to close.

Comment 47

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=365562308&repo=mozilla-esr91

Comment 48

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to Treeherder Bug Filer from comment #47)

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=365562308&repo=mozilla-esr91

This is bug 1720748 and not that one.

Comment 49

[Intermittent Failures Robot]

1 failures in 3558 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2022-12-12&endday=2022-12-18&tree=all

Comment 50

[Intermittent Failures Robot]

2 failures in 2999 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 1

Platform and build breakdown:

• macosx1015-64-qr: 2
  • opt: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1517538&startday=2022-12-19&endday=2022-12-25&tree=all

Comment 51

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.