1719677 - [mozlog] Permanent Windows Marionette UnicodeEncodeError: 'charmap' codec can't encode character '\U0001f36a' in position 194: character maps to <undefined> - DO NOT USE FOR CLASSIFICATION

Status: NEW

(Testing :: Mozbase, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=344671000&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/by4mVM-nS1aRRwYDmMiZ4w/runs/0/artifacts/public/logs/live_backing.log

---

Not new and not reported as failure.

[task 2021-07-08T11:01:46.907Z] 11:01:46     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_profile_management.py TestSwitchProfileWithoutWorkspace.test_new_named_profile_unicode
[task 2021-07-08T11:01:46.908Z] 11:01:46     INFO -  1625742106907	Marionette	DEBUG	Accepted connection 3 from 127.0.0.1:52564
[task 2021-07-08T11:01:46.919Z] 11:01:46     INFO -  1625742106919	Marionette	DEBUG	3 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2021-07-08T11:01:46.921Z] 11:01:46     INFO -  1625742106920	Marionette	DEBUG	3 <- [1,1,null,{"sessionId":"aefd1621-6c15-466f-8e9f-bd732e85f334","capabilities":{"browserName":"firefox","browserVersion":"91.0a ... n.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true,"proxy":{}}}]
[task 2021-07-08T11:01:46.922Z] 11:01:46     INFO -  1625742106921	Marionette	DEBUG	3 -> [0,2,"WebDriver:SetTimeouts",{"script":30000}]
[task 2021-07-08T11:01:46.922Z] 11:01:46     INFO -  1625742106922	Marionette	DEBUG	3 <- [1,2,null,{"value":null}]
[task 2021-07-08T11:01:46.923Z] 11:01:46     INFO -  1625742106923	Marionette	DEBUG	3 -> [0,3,"WebDriver:SetTimeouts",{"pageLoad":300000}]
[task 2021-07-08T11:01:46.923Z] 11:01:46     INFO -  1625742106923	Marionette	DEBUG	3 <- [1,3,null,{"value":null}]
[task 2021-07-08T11:01:46.924Z] 11:01:46     INFO -  1625742106924	Marionette	DEBUG	3 -> [0,4,"WebDriver:SetTimeouts",{"implicit":0}]
[task 2021-07-08T11:01:46.924Z] 11:01:46     INFO -  1625742106924	Marionette	DEBUG	3 <- [1,4,null,{"value":null}]
[task 2021-07-08T11:01:47.205Z] 11:01:47     INFO -  mozlog.structuredlog: Failure calling log handler:
[task 2021-07-08T11:01:47.206Z] 11:01:47     INFO -  Traceback (most recent call last):
[task 2021-07-08T11:01:47.206Z] 11:01:47     INFO -    File "C:\Users\task_1625733998\build\venv\lib\site-packages\mozlog\structuredlog.py", line 294, in _handle_log
[task 2021-07-08T11:01:47.207Z] 11:01:47     INFO -      handler(data)
[task 2021-07-08T11:01:47.207Z] 11:01:47     INFO -    File "C:\Users\task_1625733998\build\venv\lib\site-packages\mozlog\handlers\base.py", line 90, in __call__
[task 2021-07-08T11:01:47.207Z] 11:01:47     INFO -      self.stream.write(formatted)
[task 2021-07-08T11:01:47.208Z] 11:01:47     INFO -    File "c:\mozilla-build\python3\lib\encodings\cp1252.py", line 19, in encode
[task 2021-07-08T11:01:47.208Z] 11:01:47     INFO -      return codecs.charmap_encode(input,self.errors,encoding_table)[0]
[task 2021-07-08T11:01:47.209Z] 11:01:47     INFO -  UnicodeEncodeError: 'charmap' codec can't encode character '\U0001f36a' in position 194: character maps to <undefined>

[task 2021-07-08T11:01:52.182Z] 11:01:52     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_profile_management.py TestSwitchProfileWithoutWorkspace.test_new_named_profile_unicode_escape_characters
[task 2021-07-08T11:01:52.182Z] 11:01:52     INFO -  1625742112182	Marionette	DEBUG	Accepted connection 3 from 127.0.0.1:52626
[task 2021-07-08T11:01:52.183Z] 11:01:52     INFO -  1625742112182	Marionette	DEBUG	3 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2021-07-08T11:01:52.184Z] 11:01:52     INFO -  1625742112184	Marionette	DEBUG	3 <- [1,1,null,{"sessionId":"47d7f7a8-09c1-47fa-b8e4-dfb06535d73c","capabilities":{"browserName":"firefox","browserVersion":"91.0a ... b.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true,"proxy":{}}}]
[task 2021-07-08T11:01:52.185Z] 11:01:52     INFO -  1625742112185	Marionette	DEBUG	3 -> [0,2,"WebDriver:SetTimeouts",{"script":30000}]
[task 2021-07-08T11:01:52.185Z] 11:01:52     INFO -  1625742112185	Marionette	DEBUG	3 <- [1,2,null,{"value":null}]
[task 2021-07-08T11:01:52.186Z] 11:01:52     INFO -  1625742112186	Marionette	DEBUG	3 -> [0,3,"WebDriver:SetTimeouts",{"pageLoad":300000}]
[task 2021-07-08T11:01:52.187Z] 11:01:52     INFO -  1625742112186	Marionette	DEBUG	3 <- [1,3,null,{"value":null}]
[task 2021-07-08T11:01:52.187Z] 11:01:52     INFO -  1625742112187	Marionette	DEBUG	3 -> [0,4,"WebDriver:SetTimeouts",{"implicit":0}]
[task 2021-07-08T11:01:52.187Z] 11:01:52     INFO -  1625742112187	Marionette	DEBUG	3 <- [1,4,null,{"value":null}]
[task 2021-07-08T11:01:52.439Z] 11:01:52     INFO -  mozlog.structuredlog: Failure calling log handler:
[task 2021-07-08T11:01:52.439Z] 11:01:52     INFO -  Traceback (most recent call last):
[task 2021-07-08T11:01:52.439Z] 11:01:52     INFO -    File "C:\Users\task_1625733998\build\venv\lib\site-packages\mozlog\structuredlog.py", line 294, in _handle_log
[task 2021-07-08T11:01:52.439Z] 11:01:52     INFO -      handler(data)
[task 2021-07-08T11:01:52.440Z] 11:01:52     INFO -    File "C:\Users\task_1625733998\build\venv\lib\site-packages\mozlog\handlers\base.py", line 90, in __call__
[task 2021-07-08T11:01:52.440Z] 11:01:52     INFO -      self.stream.write(formatted)
[task 2021-07-08T11:01:52.441Z] 11:01:52     INFO -    File "c:\mozilla-build\python3\lib\encodings\cp1252.py", line 19, in encode
[task 2021-07-08T11:01:52.441Z] 11:01:52     INFO -      return codecs.charmap_encode(input,self.errors,encoding_table)[0]
[task 2021-07-08T11:01:52.442Z] 11:01:52     INFO -  UnicodeEncodeError: 'charmap' codec can't encode character '\u1f36' in position 194: character maps to <undefined>

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to James Graham [:jgraham] from bug 1705844 comment #3)

It looks like we're trying to encode the character in the Windows-1252 character set and that's failing. So the question is why something is trying to use that rather than UTF-8. It's possible that the output stream is being opened in a mode that defaults to windows-1252 encoding on Windows, or something, but I'm not sure without looking more.

Comment 3

[Intermittent Failures Robot]

1 failures in 2387 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 2286 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• autoland: 1

Platform and build breakdown:

• windows10-64-2004-asan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2021-12-20&endday=2021-12-26&tree=all

Comment 5

[Intermittent Failures Robot]

4 failures in 3165 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 4

Platform and build breakdown:

• windows10-64-2004-qr: 3
  • opt: 1
  • debug: 2
• windows10-64-2004-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-01-31&endday=2022-02-06&tree=all

Comment 7

[Intermittent Failures Robot]

2 failures in 3339 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1
• mozilla-central: 1

Platform and build breakdown:

• windows10-64-2004-asan-qr: 1
  • opt: 1
• windows10-32-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-08-08&endday=2022-08-14&tree=all

Comment 8

[Intermittent Failures Robot]

4 failures in 2916 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• windows10-32-2004-shippable-qr: 3
  • opt: 3
• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-08-15&endday=2022-08-21&tree=all

Comment 9

[Intermittent Failures Robot]

9 failures in 3293 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1
• mozilla-central: 7
• autoland: 1

Platform and build breakdown:

• windows10-64-2004-shippable-qr: 4
  • opt: 4
• windows10-32-2004-shippable-qr: 4
  • opt: 4
• windows10-64-2004-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-08-22&endday=2022-08-28&tree=all

Comment 10

[Intermittent Failures Robot]

11 failures in 3537 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 8
• mozilla-beta: 1

Platform and build breakdown:

• windows10-64-2004-asan-qr: 3
  • opt: 3
• windows10-32-2004-shippable-qr: 1
  • opt: 1
• windows10-32-2004-qr: 1
  • debug: 1
• windows10-64-2004-ccov-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 11

[Intermittent Failures Robot]

6 failures in 3616 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5
• autoland: 1

Platform and build breakdown:

• windows10-64-2004-ccov-qr: 5
  • opt: 5
• windows10-64-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-09-05&endday=2022-09-11&tree=all

Comment 12

[Intermittent Failures Robot]

7 failures in 3023 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 3
• mozilla-beta: 1

Platform and build breakdown:

• windows10-32-2004-qr: 2
  • debug: 2
• windows10-64-2004-ccov-qr: 3
  • opt: 3
• windows10-64-2004-asan-qr: 1
  • opt: 1
• windows10-64-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 13

[Intermittent Failures Robot]

16 failures in 2909 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 5
• autoland: 4
• mozilla-esr102: 1
• try: 4

Platform and build breakdown:

• windows10-64-2004-qr: 6
  • debug: 5
  • opt: 1
• windows10-64-2004-asan-qr: 4
  • opt: 4
• windows10-64-2004-ccov-qr: 2
  • opt: 2
• windows10-32-2004-shippable-qr: 1
  • opt: 1
• windows10-32-2004-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-09-19&endday=2022-09-25&tree=all

Comment 14

[Intermittent Failures Robot]

10 failures in 2041 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-beta: 4
• mozilla-central: 1
• try: 1

Platform and build breakdown:

• windows10-32-2004-qr: 4
  • debug: 4
• windows10-64-2004-qr: 3
  • debug: 3
• windows10-64-2004-asan-qr: 1
  • opt: 1
• windows10-64-2004-devedition-qr: 1
  • opt: 1
• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1719677&startday=2022-09-26&endday=2022-10-02&tree=all