1728739 - Permanent Windows tp6 failure lines for successful tasks UnicodeEncodeError: 'charmap' codec can't encode character '\u03c3' in position 94: character maps to <undefined>

Status: RESOLVED FIXED

(Testing :: Performance, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=350071080&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RPHJyOxbTsSLbz7ZbdVpCw/runs/0/artifacts/public/logs/live_backing.log

---

Since the browsertime update in bug 1727780, there are 2 unicode encoding errors for each (?) tp6 task on Windows 10, even if the tasks exist successfully. The failure should be fixed to keep the task easy to debug when it actually fails.

[task 2021-08-31T15:21:05.367Z] 15:21:05     INFO -  perftest-output Info: PERFHERDER_DATA: {"framework": {"name": "browsertime"}, "suites": [{"name": "google-search", "type": "pageload", "extraOptions": ["cold", "webrender"], "tags": ["cold", "webrender"], "lowerIsBetter": true, "unit": "ms", "alertThreshold": 2.0, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "replicates": [311, 279, 270, 273, 277, 279, 279, 277, 273, 278, 270, 279, 274, 283, 277, 279, 286, 276, 274, 278, 273, 270, 272, 274, 292], "value": 277.0}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "shouldAlert": true, "replicates": [289, 274, 264, 267, 271, 273, 257, 270, 251, 272, 265, 272, 270, 276, 270, 271, 280, 255, 251, 272, 268, 266, 267, 268, 287], "value": 270.0}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "replicates": [292, 275, 266, 270, 272, 275, 260, 272, 255, 275, 268, 275, 271, 279, 273, 275, 283, 257, 253, 274, 269, 267, 269, 270, 289], "value": 271.5}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "shouldAlert": true, "replicates": [1115, 996, 960, 977, 995, 987, 1058, 1010, 1066, 1104, 988, 1001, 1102, 973, 1096, 995, 1021, 1094, 1014, 948, 974, 1007, 1001, 977, 1029], "value": 1001.0}]}, {"name": "google-search", "type": "pageload", "extraOptions": ["webrender", "warm"], "tags": ["webrender", "warm"], "lowerIsBetter": true, "unit": "ms", "alertThreshold": 2.0, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "replicates": [227, 221, 211, 224, 214, 208, 239, 211, 224, 228, 225, 228, 220, 228, 237, 252, 223, 224, 221, 223, 224, 210, 224, 210, 223], "value": 223.5}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "shouldAlert": true, "replicates": [221, 214, 205, 219, 207, 202, 219, 205, 218, 223, 219, 223, 216, 222, 219, 232, 218, 219, 216, 204, 218, 204, 218, 201, 217], "value": 218.0}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "replicates": [223, 217, 208, 221, 211, 205, 236, 208, 221, 226, 222, 225, 218, 225, 222, 249, 221, 221, 219, 208, 221, 207, 221, 207, 220], "value": 221.0}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "unit": "ms", "shouldAlert": true, "replicates": [267, 266, 253, 264, 257, 485, 485, 254, 259, 269, 267, 262, 260, 271, 514, 270, 258, 261, 260, 489, 266, 252, 266, 253, 258], "value": 263.0}]}], "application": {"name": "firefox", "version": "93.0a1"}}
[task 2021-08-31T15:21:05.368Z] 15:21:05     INFO -  perftest-output Info: results can also be found locally at: C:\Users\task_1630412877\build\raptor.json
[task 2021-08-31T15:21:05.370Z] 15:21:05     INFO -  perftest-results-handler Info: Validating PERFHERDER_DATA against C:\Users\task_1630412877\mozharness\external_tools\performance-artifact-schema.json
[task 2021-08-31T15:21:05.374Z] 15:21:05     INFO -  perftest-results-handler Info: Writing video jobs and application data {'jobs': [{'browsertime_json_path': 'browsertime-results/google-search/cold-browsertime.json', 'test_name': 'google-search', 'extra_options': ['cold', 'webrender'], 'accept_zero_vismet': False}, {'browsertime_json_path': 'browsertime-results/google-search/warm-browsertime.json', 'test_name': 'google-search', 'extra_options': ['webrender', 'warm'], 'accept_zero_vismet': False}], 'application': {'name': 'firefox', 'version': '93.0a1'}, 'extra_options': ['cold', 'webrender']} into C:\Users\task_1630412877\build\blobber_upload_dir\browsertime-results\jobs.json
[task 2021-08-31T15:21:05.375Z] 15:21:05     INFO -  raptor-perftest Info: Removing temporary directory: C:\Users\task_1630412877\AppData\Local\Temp\tmpzuj4g7wy
[task 2021-08-31T15:21:05.414Z] 15:21:05     INFO -  raptor-main Info: Creating tarball at C:\Users\task_1630412877\build\blobber_upload_dir\browsertime-results.tgz
[task 2021-08-31T15:21:05.875Z] 15:21:05     INFO -  raptor-main Info: Removing C:\Users\task_1630412877\build\blobber_upload_dir\browsertime-results
[task 2021-08-31T15:21:05.910Z] 15:21:05     INFO -  mozlog.structuredlog: Failure calling log handler:
[task 2021-08-31T15:21:05.910Z] 15:21:05    ERROR -  Traceback (most recent call last):
[task 2021-08-31T15:21:05.910Z] 15:21:05     INFO -    File "C:\Users\task_1630412877\build\venv\lib\site-packages\mozlog\structuredlog.py", line 294, in _handle_log
[task 2021-08-31T15:21:05.911Z] 15:21:05     INFO -      handler(data)
[task 2021-08-31T15:21:05.911Z] 15:21:05     INFO -    File "C:\Users\task_1630412877\build\venv\lib\site-packages\mozlog\handlers\base.py", line 90, in __call__
[task 2021-08-31T15:21:05.911Z] 15:21:05     INFO -      self.stream.write(formatted)
[task 2021-08-31T15:21:05.912Z] 15:21:05     INFO -    File "c:\mozilla-build\python3\lib\encodings\cp1252.py", line 19, in encode
[task 2021-08-31T15:21:05.912Z] 15:21:05     INFO -      return codecs.charmap_encode(input,self.errors,encoding_table)[0]
[task 2021-08-31T15:21:05.912Z] 15:21:05     INFO -  UnicodeEncodeError: 'charmap' codec can't encode character '\u03c3' in position 94: character maps to <undefined>
[task 2021-08-31T15:21:05.913Z] 15:21:05     INFO -  mozlog.structuredlog: Failure calling log handler:
[task 2021-08-31T15:21:05.913Z] 15:21:05    ERROR -  Traceback (most recent call last):
[task 2021-08-31T15:21:05.913Z] 15:21:05     INFO -    File "C:\Users\task_1630412877\build\venv\lib\site-packages\mozlog\structuredlog.py", line 294, in _handle_log
[task 2021-08-31T15:21:05.913Z] 15:21:05     INFO -      handler(data)
[task 2021-08-31T15:21:05.914Z] 15:21:05     INFO -    File "C:\Users\task_1630412877\build\venv\lib\site-packages\mozlog\handlers\base.py", line 90, in __call__
[task 2021-08-31T15:21:05.914Z] 15:21:05     INFO -      self.stream.write(formatted)
[task 2021-08-31T15:21:05.914Z] 15:21:05     INFO -    File "c:\mozilla-build\python3\lib\encodings\cp1252.py", line 19, in encode
[task 2021-08-31T15:21:05.915Z] 15:21:05     INFO -      return codecs.charmap_encode(input,self.errors,encoding_table)[0]
[task 2021-08-31T15:21:05.915Z] 15:21:05     INFO -  UnicodeEncodeError: 'charmap' codec can't encode character '\u03c3' in position 113: character maps to <undefined>
[task 2021-08-31T15:21:05.972Z] 15:21:05     INFO - Return code: 0

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1727780

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

this might be fixed by Bug 1727802.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1728739 - Fix unicode error on when logging browsertime results on windows. r=ahal

Comment 4

[Intermittent Failures Robot]

1 failures in 3084 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1728739&startday=2021-08-30&endday=2021-09-05&tree=all

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6d971483a819
Fix unicode error on when logging browsertime results on windows. r=ahal,perftest-reviewers,kimberlythegeek

Comment 6

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/6d971483a819

Comment 7

[Pascal Chevrel:pascalc (PTO until April 26)]

https://hg.mozilla.org/releases/mozilla-beta/rev/c4709e536692